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FOREWORD 


Employing  research  to  improve  the  effectiveness 
and  efficiency  of  the  systems  acquisition  and 
support  process  has  long  been  advocated.  One 
of  the  recommendations  stemming  from  the  1967 
000  Pricing  Conference  held  at  Hershey, 
Pennsylvania,  dealt  with  the  need  for  a  Depart¬ 
ment  of  Defense  Procurement  Research  Laboratory. 
A  series  of  events  and  activities  followed 
which  endorsed  the  need  and  provided  momentum 
for  the  concept. 

In  1969  the  Army  Procurement  Research  Office 
was  established  and  in  1970  the  House  Govern¬ 
ment  Operations  Conmittee  concluded  that  there 
was  a  need  for  a  procurement  research  laboratory 
for  001.  In  1971  the  Department  of  Defense 
established  a  Procurement  Research  Coordinating 
Committee;  and  in  1972  the  Commission  on  Govern¬ 
ment  Procurement  advocated  establishment  of  a 
Federal  Procurement  Institute  with  responsibil¬ 
ity,  amonq  other  things,  for  conducting  and 
sponsoring  research  in  procurement  policy  and 
procedure. 

The  Air  Force  Business  Research  Management  Cen¬ 
ter  was  established  in  1973,  and  the  Naval  Cen¬ 
ter  for  Acquisition  Research  and  the  Federal 
Acquisition  Institute  were  established  in  1977. 
Also  in  1977,  the  Defense  Department  Issued  a 
directive  to  formalize  the  Acquisition  Research 
Program  of  the  D00  and  to  coordinate  Its  program 
with  the  Federal  Acquisition  Institute.  The 
same  year  the  General  Accounting  Office  Issued 
a  report  which  called  for  establishment  of  a 
strong  Government-wide  program  of  procurement 
and  acquisition  research. 


Beginning  in  1972  the  Department  of  Defense 
has  hosted  an  annual  sympo: lum  to  share  procure¬ 
ment  research  results  among  the  academic,  busi¬ 
ness,  and  acquisition  management  communities. 
From  a  modest  beginning  (12  papti..,,  the  Pro¬ 
curement  Research  Symposium  has  grown  to  100 
papers  scheduled  for  presentation  this  year. 

^The  title  change  of  this  seventh  symposium 
from  the  DOD  Procurement  Research  Symposium  to,* 
the  Acquisition  Research  Symposium  reflects 
The  broader  scope  and  responsibility  being  ' 
accepted  by  the  acquisition  research  community. 
Acquisition  research  is  moving  rapidly  to  be 
responsive  to  the  needs  of  the  total  acquisi¬ 
tion  process  and  the  applicability  of  the 
results  throughout  the  Federal  Government. 

The  theme  of  this  year's  symposium  recognizes 
that  research  Into  the  integrated  contracting 
and  acquisition  processes  should  be  respon¬ 
sive  to  both  today's  and  tomorrow's  needs  and 
that  tomorrow's  contracting  and  acquisition 
systems  rest  In  part  upon  knowledge  developed 
by  today's  research. 

The  Hershey  Pricing  Conference  In  1967  may  be 
said  to  have  Initiated  an  era  concerned  with 
discovering  and  refining  the  concept  of  acqui¬ 
sition  research.  With  dedication  and  insight¬ 
ful  management,  this  "Return  to  Hershey"  can 
begin  an  era  where  acquisition  research 
becomes  a  participating  factor  In  formulating 
tomorrow's  contracting  and  acquisition  systems. 


The  views  expressed  In  this  proceedings  are  those  of  the 
authors  and  do  not  necessarily  reflect  the  views  of  the 
organizations  with  which  the  authors  are  associated. 


Additional  copies  of  the  proceedings  may  be  obtained  by 
telephoning  or  writing: 

Air  Force  Business  Research  Management  Center 

AFBRMC/LGPB 

Building  125,  Area  B 

Wright-Patterson  AFB,  Ohio  45433 

Autovon:  785-6221 

Commercial:  Area  Code  513-255-6221 
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ACQUISITION  RESEARCH  WITHIN  DOD 


Within  the  Department  of  Defense  acquisition 
research  is  performed  by  studying,  reviewing, 
digesting,  analyzing,  appraising,  or  summariz¬ 
ing  data  or  information  related  to  the  acqui¬ 
sition  process.  The  purpose  of  acquisition 
research  is  to  develop  new  or  improved  manage¬ 
ment  concepts  and  more  effective  acquisition 
methods.  The  aim  of  acquisition  research  is 
to  provide  information  of  benefit  to  those 
responsible  for  identifying  policy  deficiencies 
and  solving  management  problems  in  functional 
areas  such  as,  but  not  limited  to,  requirements 
analysis  and  operational  needs,  engineering, 
development,  planning,  programing,  budgeting, 
contracting,  cost  and  price  analyses,  perfor¬ 
mance  measurement,  source  selection,  quality 
assurance,  production  capacity,  test  and 
evaluation,  and  adequacy  of  the  support  capa¬ 
bility  for  the  Defense  acquisition  programs. 


An  Acquisition  Research  Council  (ARC)  provides 
overall  guidance  to  the  acquisition  research 
effort.  The  council  is  composed  of: 


Mr.  Dale  Church  (Chairman) 

Deputy  Under  Secretary  of  Defense 
(Acquisition  Policy) 

Office  of  the  Under  Secretary  of 
Defense  (Research  4  Engineering) 


Mr.  Floyd  H.  Trogdon 
Director  Materiel  Acquisition  Policy 
Office  of  the  Under  Secretary  of 
Defense  (Research  &  Engineering) 


Mr.  Dale  Babione 

Director  (Contracts  System  Acquisition) 
Office  of  the  Under  Secretary  of 
Defense  (Research  &  Engineering) 


Dr.  John  J.  Bennett 
Director 

Federal  Acquisition  Institute 


Rear  Admiral  Roland  G.  Freeman  III,  USN 
Commandant 

Defense  Systems  Management  College 


Mrs.  Sally  Clements 

Director  of  Materiel  Acquisition 

Assistant  Secretary  of  the  Army 

(Research,  Development  &  Logistics) 


Mr.  William  V.  Gorden 
Assistant  Deputy  Director,  CAS 
Defense  Logistics  Agency 


Mr.  Harvey  J.  Gordon 
Deputy  for  Procurement 
Office  of  Assistant  Secretary  of 
the  Air  Force  (Research, 
Development  &  Logistics) 


Mr.  Gerald  A.  Cann 
Deputy  Assistant  Secretary  of  the 
Navy  (Systems) 


Mr.  Euerett  Pyatt 
Principal  Deputy  Assistant  of  the 
Navy  (Logistics) 


Lt  Col  Robert  B.  Machen,  USA 

Executive  Secretary 

Defense  Systems  Management  College 


Acquisition  research  elements  responsible  for 
conducting  the  DOD  acquisition  research  program 
are: 


Defense  Systems  Management  College 
Fort  Belvoir,  Virginia  22060 


Army  Procurement  Research  Office 
Army  Logistics  Management  Center 
Fort  Lee,  Virginia  23801 


Air  Force  Business  Research  Manage¬ 
ment  Center 

Wright-Patterson  AFB,  Ohio  45433 


Naval  Center  for  Acquisition  Research 
Naval  Postgraduate  School 
Monterey,  California  93940 
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INTRODUCTION 


Managing  modernisation  Is  the  primary  focus  of 
our  efforts  within  DCS/R&D.  There  have  been 
a  number  of  recent  Air  Force  initiatives  in 
acquisition  management  which  have  significantly 
influenced  how  we  do  that.  Each  of  the  two 
major  areas,  the  resource  allocation  decision 
process,  and  the  program  initiation  review 
process,  have  been  and  continue  to  be  undergo¬ 
ing  major  changes.  This  paper  will  present 
results  of  the  recent  period  of  signficant 
development  of  new  procedures  and  techniques 
in  both  areas. 

First,  the  mission  area  planning,  programming, 
and  budgeting  processes  currently  evolving 
are  designed  to  ensure  that  programs  are 
judged  on  the  basis  of  validated  mission  needs 
and  that  scarce  resources  are  allocated  on  the 
basia  of  a  prioritized  heirarchy  of  these 
needs.  Development  of  this  three  step 
resource  allocation  decision  process  culminated 
in  the  preparation  of  the  FY  79  Budget  Esti¬ 
mate  Submission  and  President's  Budget.  The 
tools  and  techniques  used  are  the  result  of 
several  years  of  hard  developmental  staff  work 
and  are  the  major  "research"  product  of  this 
paper.  The  pressure  from  Congress  and  others 
to  present  and  defend  our  programs  in  a  mis¬ 
sion  oriented  structure  no  doubt  helped  keep 
our  efforts  going  during  difficult  periods, 
but  mission  area  planning  and  analysis  is  an 
idea  whose  time  has  come. 

Another  forcing  function  toward  mission  orien¬ 
tation  was  directed  primarily  at  the  individual 
system  program  initiation  and  decision  process. 
OMB  Circular  A- 109  and  the  implementing  DOD 
Directives  5000.1  and  5000.2  require  new  pro¬ 
grams  to  be  conceived  and  approved,  not  from 
specific  solution  oriented  proposals  but  from 
statements  of  mission  needs.  The  source  of 
these  mission  needs  statements  is  again  mis¬ 
sion  area  analysis  which  identifies  deficien¬ 
cies  in  capability.  This  mission  analysis 
may  be  done  slightly  differently  at  first, 
and  be  more  detailed  in  its  specific  focus, 
but  the  same  concerns  and  considerations  for 
mission  deficiency  identification  prevail. 

The  aecond  part  of  this  paper  will  present 
the  Air  Force's  implementation  of  these  new 
policies  and  requirements  for  system  program 
initiation  and  review. 


involved  in  their  ongoing  integration,  and  an 
opportunity  for  future  research  into  acquisi¬ 
tion  methods  and  procedures. 


RESOURCE  ALLOCATION  DECISION  PROCESS 


This  first  major  section  of  this  paper,  and 
the  part  which  details  the  developed  method¬ 
ology,  is  the  di8Cuasion  of  the  Mission  Area 
Planning  activity  used  for  resource  alloca¬ 
tion  during  the  FY  79  Budget  Estimate  Sub¬ 
mittal.  During  the  preparation  of  that  sub¬ 
mittal,  we  applied  the  mission  area  planning 
process  to  the  formulation  of  the  Research, 
Development,  Test,  6  Evaluation  program  for 
the  Air  Force.  The  relative  success  of  this 
venture,  and  the  greater  understanding  it 
provided,  led  to  Air  Staff-wide  application 
of  the  methodology  for  the  FY  80  Program 
Objective  Memorandum  cycle. 

Mission  Area  Planning  is  a  logical  three  part 
process  composed  of  Mission  Area  Analysis, 
Development  Planning,  and  Zero-Base  Budgeting. 
The  first  part,  Mission  Area  Analysis,  is  the 
technique  used  to  define  the  problem(s)  which 
the  Air  Force  program  should  address,  and  is 
mainly  an  operator  responsibility.  Subsequent 
applications  of  the  method  will  reflect  Lhis 
responsibility  more  strongly,  with  DCS/Plans 
and  Operation  leadership  and  heavy  MAJCOM 
participation.  The  second  part,  Development 
Planning,  is  the  segment  which  defines 
alternative  solutions  to  the  problem(s),  and 
requires  strong  developer  involvement, 
especially  when  the  solutions  involve  RDT&E 
activity  and  funding.  DCS/RSD  lead  is 
required  with  heavy  participation  by  AFSC. 
Zero-Base  Budgeting  is  the  third  part  of  the 
process,  where  we  select  affordable  solutions 
from  the  defined  alternatives.  At  the 
integrated  formulation  level  appropriate  to 
the  Air  Staff,  this  is  really  programming 
with  fiscal  constraints.  Integration  of  the 
various  parts  of  the  total  Air  Force  program 
is  a  significant  challenge  under  sny  pro¬ 
cedure,  and  ve  find  the  appropriate  DCS/Pro- 
grams  and  Resources  and  Air  Force  Comptroller 
leadership  here,  DCS/R&D  handles  the  RDT&E, 
and  the  Air  Force  Board  Structure  plays  a 
major  role  in  integrating  the  total  program. 
These  three  major  parts  of  the  process  will 
be  further  broken  down  end  described  in  the 
subsequent  paragraphs. 


Finally,  the  neceaaary  interrelationship  of 
these  two  major  processes  will  be  briefly 
discuseed,  to  point  out  come  problems 
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the  problem,  is  itself  a  basic  three  step 
exercise.  The  first  step  is  to  build  a 
framework  for  the  analysis,  based  on  the 
missions  which  the  Air  Force  must  perform. 

The  second  step  identifies  deficiencies  ir.  the 
capability  to  accomplish  those  missions.  The 
third  step  is  Co  assess  the  overall  mission 
area  needs. 

To  build  an  appropriate  framework,  we  must 
first  break  the  total  program,  in  this  case 
Che  RDT&E  program,  into  appropriate  missions 
and  mission  areas.  Each  mission  area  is  then 
further  broken  down  into  a  matrix  based  on 
the  functions  which  must  be  performed  to  accom- 
pl'sh  the  mission,  and  the  conditions  under 
winch  the  functions  will  need  to  be  performed. 
The  con-'  I'li  •"  considered  could  be  such  things 
as  the  type  01  conflict,  environmental  con¬ 
siderations,  or  any  ocher  set  of  conditions 
which  have  the  most  significant  impact  on  the 
conduct  of  the  functions  which  make  up  the 
individual  mission  area. 

A  wide  variety  of  possible  mission  area 
structure  approaches  are  possible.  The  RD 
Mission  Area  Structure  which  we  used  has 
evolved  over  the  past  couple  of  years  lr 
response  to  the  uses  and  needs  It  must  serve. 
One  objective  of  the  structure  we  use  is  to 
group  mission  related  programs  together  so 
reasonable  trade-offs  can  be  made  and  similar 
condition  considerations  are  applied  to  the 
analysis  of  mission  related  programs.  Our 
structure  (see  figure  1)  has  the  same  basic 
problem  os  most  If  not  all  other  mission  area 
breakouts,  in  that  some  functional  areas 
apply  across  the  mission  areas  and  are  dif¬ 
ficult  to  place,  neatly  Into  the  mission  frame¬ 
work.  We  put  those  functional  areas  of 
Technology  Base  and  Management  and  Support 
along  with  the  other  across-the-board  things 
like  C-*  md  Defense-Wide  Systems. 


FIGURE  1 


RD  MISSION  AREA  STRUCTURE 
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These  eleven  mission  areas  are  further  broken 
down  into  major  functions,  tailored  to  each 
mission  area,  then  even  further  to  the  lowest 
level  of  task  or  capability  which  is  reason¬ 
able  for  that  particular  mlaslon  area.  This 
detailed  atructure  of  the  tasko  and  capabil¬ 
ities  required  in  each  mission  area  forma  one 
side  f  a  matrix  for  the  mission  area  in 
question.  An  example  will  help  to  illustrate 
the  point.  Strategic  Offense  is  considered  to 


consist  of  two  major  functions  or  tasks, 
Survivability  and  Retaliatory  Capability. 

See  Figure  2.  Retaliatory  capability  is 
likewise  composed  of  three  elements;  Enroute/ 
Penetration,  Delivery /Target  Damage,  and  Post 
Attack.  Finally,  in  this  example,  Enroute/ 
Penetration  breaks  down  to  seven  more 
specific  elements  of  capability  required  to 
have  or  generate  strategic  offense. 


STRATEGIC  OFFENSE 
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This  example  serves  to  Illustrate  the  level  of 
detail  necessary  to  analyze  the  mission 
requirements  and  our  capability  and  deficien¬ 
cies  in  a  meaningful  way.  These  seven  func¬ 
tional  tasks  are  now  arrayed,  with  the  cor¬ 
responding  entries  for  the  other  portions  of 
the  Strategic  Offense  Mission  Area,  across 
one  side  of  the  Strategic  Offense  matrix. 

The  other  side  of  the  matrix,  please  recall, 
was  to  reflect  the  conditions  under  which  the 
various  functional  tasks  of  the  mission  area 
are  to  be  performed.  These  arc  unique  to  each 
mission  area  and  should  reflect  the  conditions 
which  exert  the  most  influence  on  the  require¬ 
ments  and  abilities  to  perform  the  functions, 
such  as  the  type  of  conflict,  environmental 
and  visibility  conditions,  etc.  In  the 
Strategic  Offense  mission  area,  the  type  of 
conflict  conditions  of  General  War,  Limited 
War,  and  Crisis  are  the  most  meaningful. 
Because  these  conditions  affect  che  ICBM 
portion  of  our  Strategic  Offensive  force  so 
differently  from  the  aircraft  or  airbrenthlng 
portion,  we  further  divided  each  type  of  con¬ 
flict  condition  Into  an  ICBM  portion  and  an 
aircraft  portion.  The  condition  side  of  the 
Strategic  Offense  matrix,  therefore,  has  six 
elements. 

There  is  now  only  one  thing  left  to  do  to 
complete  the  framework  for  the  analysis,  and 
that  is  to  assign  importance  weights  to  both 
the  functional  tasks  and  the  conditions. 
Weights  were  assigned  to  the  functional  tasks 
based  on  how  important  each  task  is  to  mission 


accomplishment.  The  total  of  these  weights 
for  each  complete  mission  area  adds  to  100. 
Weights  were  assigned  to  the  conditions 
depending  on  how  important  the  condition  is  ns 
a  basis  tor  planning,  and  these  weights  add  to 
1.0.  The  allocation  of  both  sets  of  weighting 
factors  is  developed  by  the  mission  area 
analyst  with  the  support  of  the  operations 
community.  These  provide  an  objective  basis 
for  determining  the  relative  importance  of 
various  deficiencies  and  capabilities. 

To  again  use  the  Strategic  Offense  mission 
area  as  an  example,  the  conditions  were  assign¬ 
ed  weights  of  0.5  for  general  war,  0.3  for 
limited  war,  and  0.2  for  crisis.  More  that 
these  weights  add  to  1.0  because  these  three 
conditions  are  the  only  ones  considered 
throughout  the  Strategic  Offense  matrix.  As 
a  strictly  notations!  example  of  the  functional 
task  side  of  the  matrix,  the  seven  tasks  could 
have  been  assigned  weights  ranging  from  8  to  3 
as  shown  in  figure  3.  These  weights  cover  only 
a  portion  of  the  functional  task  side  of  the 
Strategic  Offense  matrix,  and  therefore  add  to 
less  than  the  100  total  for  the  entire  mission 


FIGURE  3 
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We  have  now  completed  building  the  framework 
for  our  mission  area  analysis,  and  are  ready 
to  go  on  to  the  second  step  in  defining  the 
problem,  the  identification  of  deficiencies. 
Each  cell  in  the  matrix  we  have  built  repre¬ 
sents  a  combination  of  a  functional  task  which 
must  be  accomplished  and  the  possible  condi¬ 
tions  under  which  it  must  be  done.  To  identify 
deficiencies  in  capability,  we  compared  our 
capability  at  each  cell  of  the  matrix  against 
the  threat.  Each  of  these  comparisons  could 
itself  be  the  subject  of  a  rather  rigorous 
analysis,  but  for  this  purpose  and  time 
these  comparisons  were  subjective  Judgements 
based  upon  objective  criteria  made  by  the 
individual  analysts.  Because  of  the  sub¬ 
jective  nature  of  these  evaluations,  only 
three  categories 'of  evaluation  were  used: 


Inadequate,  marginal,  and  adequate.  For 
quickness  and  ease  of  understanding,  these 
evaluations  were  represented  by  the  colors 
red,  yellow,  and  green,  respectively.  The 
natrices  soon  became  refered  to  as  stop  light 
charts. 

Deficiencies,  of  course,  are  tine  dependent 
since  both  our  capability  and  the  threat  change 
over  time.  Our  analysis  for  the  FY  79  Budget 
Estimate  submission  considered  pertinent  time 
periods  from  FY  78  to  FY  85.  Future  appli¬ 
cations  of  the  besic  technique  will  probably 
look  even  farther  into  the  future  than  that. 
Today's  deficiencies  are  depicted  by  eval¬ 
uating  the  FY  78  capability  versus  the  FY  78 
threat,  and  this  serves  as  a  baseline  for 
later  consideration.  We  also  consideied  the 
Impact  on  our  capability  if  we  made  no  further 
Improvement  or  investment  in  the  mission  area, 
by  looking  at  the  FY  78  capability  versus 
the  FY  85  threat.  Finally,  wo  looked  at  the 
effect  if  we  made  no  changes  in  the  currently 
approved  investment  program  by  looking  at  the 
FY  85  capability  versus  the  FY  85  threat. 

P.ach  mission  area  thus  yields  a  family  of 
matrices  with  the  the  cells  colored  green, 
yellow,  and  red.  The  extent  and  location  of 
yellow  and  red  cells  indicate  the  magnitude 
and  nature  of  the  deficiencies  in  the  dif¬ 
ferent  time  periods  portrayed.  Figure  3 
shows  ,  again,  the  notatlonal  example  with 
colors  Indicated  by  the  letters  R,  Y,  and  G. 

We  are  now  ready  for  the  third  and  final  step 
of  the  mission  area  analysis,  and  we  have 
almost  finished  defining  the  problem.  This 
last  step  is  necessary  because  a  deficiency 
along  does  not  define  a  problem.  We  must 
also  consider  the  importance  of  the  deficiency 
times  some  measure  of  the  importance  of  the 
capability  found  to  be  deficient.  We  also 
need  to  este.blish  a  quantitative  way  of 
treating  the  degree  of  deficiency  which  has 
been  represented  by  the  colors  of  red,  yellow, 
and  green.  First,  therefore,  we  assigned 
arbitrary  numbers  to  the  colors:  5  for  red 

3  for  yellow,  and  1  for  green.  Then,  we  went 
back  to  'he  weight  factors  assigned  to  the 
functional  tasks  and  conditions  to  develop  a 
qualitative  measure  of  the  relative  importance 
of  each  cell  of  the  matrix.  For  example,  the 
Range/Payload  function  for  the  General  War 
condition  has  a  relative  importance  weight  of 

4  (8  x  0.5).  It  is  now  possible  to  determine 
a  relative  assessment  of  the  degree  of 
deficiency  for  each  cell  of  the  matrix  by 
multiplying  the  deficiency  score  by  the  func¬ 
tion  importance  weight  and  the  condition 
weight.  The  absolute  value  of  these  numbers 
has  no  significance,  but  their  relative  size 
within  the  possible  range  for  the  mission  area 
indicator)  the  significance  of  the  problem. 

The  familiar  notatlonal  example  of  the 
Strategic  Offense  matrix  will  Illustrate.  The 
high  possible  need  score  would  be  20  (5  points 
for  a  red  cell,  times  8  for  the  most  Important 
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function  weight,  times  0.8  for  the  General 
War  condition.  The  lowest  need  would  have 
a  score  of  4.  A  marginal  in  Range  Payload  for 
aircraft  under  a  General  War  condition  would 
present  a  medium  sized  problem  with  a  score 
of  12.  Sec  figure  4. 


FIGURE  4 


IMPORTANCE  WEIGHT 


KUllATOW  CAPABILITY 


KROUIE/PntTBATlOK 


In  a  very  similar  fashion ,  we  can  make  an  ovt  .- 
all  assessment  of  the  functional  tasks  by 
summing  the  need  for  the  various  functions 
over  all  conditions.  This  provides  an  indi¬ 
cator  of  the  need  for  effort  to  be  expended 
on  the  particular  functions.  Again,  the 
number  itself  has  significance  only  in 
relation  to  the  possible  range  of  overall 
funccion  scores.  Extending  the  previous  logic 
to  the  functional  task  level  for  the  Strategic 
Offense  example,  we.  get  a  possible  range  of 
80  for  a  high  need  to  16  for  a  low  need.  The 
score  o:  44  for  the  Range/Payload  task 
(figure  4)  would  be  in  the  middle  range  and 
represent,  again,  a  middle  size  problem  overall 
in  Range/Payload  capability  of  our  Strategic 
Offensive  force. 

We  have  now  generated  a  comprehensive  view  ;>f 
the  needs  which  our  development  and  invest¬ 
ment  programs  should  address.  Deficiencies 
in  individual  funecior  under  specific  condi¬ 
tions  are  revealed  as  -ill  as  overall  func¬ 
tional  shortcomings  in  a  mission  area  undev  «ul 
conditions.  The  time  sensitivity  of  needs  can 
be  seen,  and  che  effects  of  our  program  pro¬ 
gress  assessed,  as  well  as  the  effects  of  a 
changing  threat  represented  by  che  progress 
of  our  adversaries.  Areas  where  technology 
is  needed  in  the  longer  tern  can  bo  found, 
as  well  as  the  needt  for  specific  system  or 
subsystem  development. 

This  completes  the  first  part  of  Mission  Area 
Planr Ing,  the  Mission  Area  Analysis.  Berore 
1  go  on  to  the  second  part.  Development 
Planning,  i  will  discuss  the  modifications 
and  extrapolations  made  in  the  m-nslon  area 


analysis  procedure  tor  subsequent  Air  Force¬ 
wide1  application.  In  its  extrapolation  to  the 
overall  Air  Force  problem,  the  methodology  for 
the  FY  80  Program  Objective  Memorandum  and  sub¬ 
sequent  applications  reflects  a  few  changes. 

The  scope  of  the  analysis  has  t/St-n  enlarged  to 
include  both  a  force  size  and  a  readiness 
analysis,  in  addition  to  the  previous  capabil¬ 
ity  and  RAD  hardware  analysis.  The  detailed 
matrix  view  has  oeen  abstracted  into  "incre¬ 
ments  of  capability"  to  provide  macro  measures 
of  "what"  and  "how  much"  to  support  the 
htoader  Air  Force-wide  application.  This 
•ncreased  scope  of  mission  area  analysis 
allows  t,  more  comprehensive  interface  with  all 
aspects  of  Air  Force  activity  such  as:  (1) 
specialized  analyses  and  I">nR  range  planning; 

(2)  changes  to  strategy  and  tncti.'s,  readiness 
and  logistics,  force  structures,  and  equipment; 

(3)  the  front  end  of  major  systr.ms  acquisition; 
and  (4)  guidance  to  the  planning,  programming, 
and  budgeting  system.  The  interface  with  the 
front  end  of  major  systems  acquisition  will 

be  discussed  later  in  connection  with  the  Air 
Force  program  initiation  process.  The  Inter¬ 
face  with  the  PPES  provides  the  necessary 
transition  into  the  second  step  in  Mission 
Area  Planning,  called  Development  Planning 
for  the  RAD  community. 

The  kind  of  Mission  Area  Analysis  done  for  the 
FY  80  POM,  provides  the  connecting  link  be¬ 
tween  the  Planning  in  the  PPBS  and  the  Pro¬ 
gramming  and  Budgeting.  Mission  Area  Analysis 
forms  a  bridge  which  brings  the  output  of  the 
Joint  Strategic  Planning  System  and  the  Devel¬ 
opment  Planning  System  together.  This  merger 
generates  the  program  submittals  of  the  PPBS 
which  ultimately  result  in  force  structure 
which  Operational  Planning  deploys  and  employs. 
The  initial  cut  at  such  a  comprehensive  nlr 
Force-wide  analysis  was  completed  in  December 
1977,  and  was  published  as  th"  Ait  Force 
Planning  Guide.  This  document  I-.  tht-  pro¬ 
duct  of  a  thoroughly  integrated  and  coordi¬ 
nated  set  of  mission  area  analyses  done  at  the 
KAJCOMS  and  in  the  Air  Staff  with  muttnl  Input 
f; loint  and  intcrservlce  sources,  DOD 
gui.l  .c  and  other  available  studies  and 
analyses,  .ne  final  integrated  mission  area 
analysis  was  formally  coordinated  with  the 
Commands  and  become  the  Air  Force  Planning 
Cuide.  It  is  the  basis  for  the  functional 
planning  by  the  MAJCOMS  and  the  Air  Staff, 
such  os  Personnel  Planning  in  DCS/Personnel , 
Development  Planning  lu  DCS/RAD,  Logistics 
Planning  in  DCS/SAL,  and  Force  Planning  in 
DCS/Plans  and  Operation.  This  detailed 
functional  planning  and  the  associated  pro¬ 
gramming  during  the  POM  perparation  /ill 
result  in  the  Air  Force  Program  for  the  FYDP 
period  FY  80-84.  Ultimate;,-  that  program, 
after  review  and  decision  by  OSD,  wn!  be 
the  basis  for  preparation  of  the  Air  Force 
Budget  for  FY  SO.  The  Development  Planning 
just  mentioned  Is  the  same  process  which  is 
the  second  part  of  Mission  Area  Planning  as 
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we  defined  it  at  the  beglnn'ng  of  this  paper, 
the  part  where  ue  define  alternative  solution1 . 
So  whether  the  mission  area  analysis  is  done  in 
the  context  of  R&D  and  investment  opportunities, 
or  done  Air  Force-wide  and  provided  as  an  input 
to  the  development  community,  it  is  still  only 
the  first  of  the  three  steps  in  the  ,»ocess. 

In  reality,  a  significant  amount  of  .•  dat.ail- 
ed  mission  analysis  we  did  for  FY  7  5  -I  .*  .icve> 
to  be  done  by  the  developers  to  arcv :  ..i 

understanding  needed  for  :\veetn '..  iiC-^.'-ns. 

Development  Planning,  the  secon.'.  -tep  „> 

Mission  Area  Planning  process,  is  .n.--. .  ve 
define  alternative  solutions.  Just  5"<e  the 
Mission  Area  Analysis  portion,  it  is  -omposed 
of  three  logical  steps.  The  first  --.‘p  de¬ 
velops  viable  alternatives  for  tne  >:  .j 

R&D  programs.  The  second  step  asses  ■  fhp 
contribution  of  each  alternative  tying 

the  deficiencies  and  needs  previousl  i-snti- 
fied.  The  third  step  builds  development 
strategies  for  consideration  by  the  decision 
makers  in  allocating  resources. 

In  performing  step  one,  ue  must  first  realize 
that  for  any  deficiency  there  are  several 
alternatives  to  consider.  It  could  be  that  a 
change  in  tactics  of  deployment  or  employment 
would  satisfy  the  deficiency,  or  perhaps  a 
modification  of  existing  systems  would  fill 
the  need.  Probably  the  least  attractive 
alternative  from  n  resource  and  time  stand 
point  is  the  development  of  a  new  system. 
However,  for  each  deficiency  which  can  and 
does  require  an  RDr&E  alternative,  we  define 
viable  alternative  programs  to  respond  to 
the  need.  The  technical  content  and  schedule 
constraints  which  effect  each  of  these  alter¬ 
natives  are  key  cy.siderations  In  determining 
which  will  be  con.  '  >red.  This  step  was 
largely  done  in  H'  USAF  for  the  Budget 
Estimate  Submission,  but  AFSC  and  field  input 
will  play  heavily  in  the  FY  80  POh  and  sub¬ 
sequent  cycles. 

Step  two  of  the  Development  Planning  process  is 
to  assess  the  value  of  eech  alternative.  This 
assessment  Is  based  on  two  key  considerations; 
the  contribution  the  program  can  make  to 
satisfying  the  need,  and  how  important  the  need 
is.  The  importance  of  the  need  or  problem  is 
already  represented  quantitatively  by  the 
function  task  weights  we  determined  during  the 
Mission  Area  Analysis  phase.  During  the 
Budget  Estimate  Submission,  we  used  an  app  iach 
which  assigned  a  numerical  value  from  0  to  9 
to  the  contribution  each  program  element  made 
to  each  functional  task  in  the  matrix.  The 
value  of  the  program  element  to  each  function 
is  thus  the  function  importance  weight  times 
the  program  element  contribution,  as  shown 
in  figure  5.  The  totr.l  for  any  given  program 
clement  can  then  be  caressed  against  the 
relative  totals  for  competing  alternative  pro- 
grama  . 
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With  the  assessment  of  alternative  solutions 
ii.  this  quantitative  relative  sense,  we  can 
now  conceive  various  possible  fiscally 
reasonable,  but  still  unconstrained  develop¬ 
ment  strategies.  This  is  the  th'rd  step  of 
the  Development  Planning  process:  building 
uevelopment  strategies.  Applies  .ion  of  fiscal 
constraints  comes  next,  but  thats  the  final 
part  of  the  Mission  Area  Planning  process. 

Tre  FY  79  BES  was  the  first  use  of  Rero-Ba6e 
Budgeting  within  the  Air  Force,  but  it  caused 
primarily  administrative  burdens  and  did  not 
significantly  interfere  with  the  next  portion 
of  the  Mission  Area  Planning  process,  select¬ 
ing  affordable  solutions.  This  portion  con¬ 
sists  of  tour  steps.  First,  we  group  the 
program  elements  into  decision  units,  then 
generate  decision  packages.  Next,  we  formu¬ 
late  mission  area  investment  strategies,  and 
finally,  we  integrate  the  RPT&E  program  with 
the  rest  of  the  Air  Force  BES. 

The  first  of  these  four  step3  is  falrlv  easy 
and  straightforward,  but  sometimes  leads  to 
consternation  and  disagreement.  We  must 
identify  related  groups  of  program  elements 
to  be  grouped  into  something  called  decision 
units.  This  grouping  is  done  in  basically 
the  sane  mission  area  structure  we  used  for 
the  analysis,  but  individual  programs  make 
contributions  to  more  than  one  mission  area 
and  the  allocation  is  not  always  as  easy  as 
it  might  seam.  Tie  objective  is  to  make 
trade-offs  easier  and  more  meaningful  among 
competing  alternative  programs  to  satisfy 
the  same  or  related  needs. 

The  second  step  is  to  generate  decision 
packages.  The  packages  each  represent  a 
possible  alternative  for  the  decision  unit 
based  upon  a  particular  development  sfatigy. 
In  our  familiar  Strategic  Offense  example, 
their  might  be  packages  for  a  cruise  miss.1 1e 
strategy,  an  ICBH  strategy,  etc.  This  is  an 
arduous  and  painfully  iterative  process  which 
consumes  far  more  time  than  the  description 
of  it  would  indicate.  The  decision  packages 
must  provide  r-sal  choices  in  response  to  the 
needs  and  balance  the  contributions  of  the 
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programs  to  get  high  payoff  from  the  resources 
Involved. 

The  third  step  in  Zero-Base  Budgeting  is  to 
formulate  mission  urea  investment  strategies. 
This  srep  introduces  fiscal  cc-ctralnts  as  we 
devise  the  best  possible  investment  strategies 
based  on  the  previously  developed  decision 
packages.  Xr.  the  ..SB  environment  of  the  BES, 
we  formulated  programs  at  three  levels  of 
funding.  So  far,  it  appears  that  the  minimum 
level  is  probab’v  the  most  important  since  it 
is  most  likely  to  uc  selected.  Again,  much 
iteration  and  consideration  go  into  this 
step,  for  this  is  what  determines  the  Air 
For  e  R&D  program. 


four  phases,  similar  to  what  they  were  in 
the  past.  First  in  the  Program  Initiation  or 
Conceptual  Phase,  '"allowing  MENS  approval  or 
Milestone  Zero.  Nest,  is  the  Demonstration 
and  Validation  Phase  after  Milestone  1. 

After  the  Milestone  II  decision  to  spend 
really  big  dollars,  c^raes  the  full-scale 
Engineer'ng  Development  Phase.  Finally, 
after  Mi .estone  III,  the  Production  and  De- 
ploymep  phase.  Note  that  a  time  axis  i.'  not 
shown  b  .ause  the  pace  of  progress  through 
the  pha 'as  will  vary  widely  between  individual 
programs.  See  figure  6. 
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Tne  foart  >  am.  '"iral  step  in  the  Zero-Base 
Budgeting  portion  it  to  integrate  the  RDT&E 
program.  This  involves  getting  RDT&E  bogies 
or  overall  funding  levels  at  each  cf  the 
tnree  fiscal  levels,  and  applying  those  con¬ 
strain;  s  to  the  final  make-up  of  each  mission 
area  pngram.  Then,  we  provide  the  RDT&E 
solutions  in  each  decision  package  to  the 
functional  elements  elsewhere  In  the  Air  Staff. 
It  Is  Important  to  be  sure  that  the  RDT&E 
program  us  i onslstent  with  and  supports  "he 
rent  of  tne  Air  Force  program.  RDT&E  will 
be  driven  by  the  top  1  overall  Air  Force 
objectives,  and  we  won.  closely  with  the 
Program  Review  Committi u  and  the  rest  of  the 
Air  Force  Board  Structure  to  ensure  that 
consistency  is  maintained. 

This  completes  the  discussion  of  the  resource 
allocation  methodology  using  Mission  Area 
Planning.  Mission  Area  Planning  has  provided 
the  logical  basis  for  the  program  we  sub¬ 
mit  and  de i end  to  OSD  and  the  Congress,  and 
whlc.i  we  will  ultimately  direct  on  the 
developers. 


AIR  FORCE  PROCRAM  INITIATION  AND  REVIEW  PROCESS 


The  second  major  sectiju  of  tills  paper  deals 
wi'h  the  program  Initiation  and  review  process 
which  has  evolved  In  response  to  OMB  Circular 
A-109  and  the  DOD  Directives  which  implement 
it,  5000.1  and  5000.7  If  the  first  major 
section  of  this  pape.  n  resource  allocation 
can  be  thought  of  as  the  planning  portion  of 
the  discussion,  this  acction  will  be  the 
Implementation  portion.  This  portion  will 
discuss  basically  three  subjects:  Mission 
Element  Needs  Statements  and  the  related 
requirements  process;  Air  Force  Designated 
Acquisition  Programs  and  their  review  and 
approval  processes;  and  the  Air  Force  Systens 
Acquisition  Review  Council  and  Its  role  and 
relationship  to  the  Defense  Systcn  Acquisition 
Review  Council. 

By  w  y  of  review,  lets  take  a  quick  look  at 
the  ysten  ncqulsl'  Ion  life  cycle,  to  be 
sure  and  undernfnnd  the  framework.  There  arc 
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The  primary  focus  cf  DODD  5000.1  and  5000.2 
is  the  Cormiltzation  of  the  front  end  of  this 
acquisition  process.  The  key  element  in  that 
formalization  is  the  Mission  Element  Need 
Statement.  Tnva  statement  is  used  to  document 
the  deficiencies  sr.d  needs  which  can  be 
expected  to  lead  to  •  "ajor  system  acquisi¬ 
tion  piogram.  It  Js  ;.  vcanted  by  the 
Service  to  the  Secretary  or  Defense  for  a 
Milestone  Zero  decision  to  pursue  a  solution 
to  the  need.  The  need  expressed  In  the 
MF.NS  will  be  reviewed,  reevaluated  end 
revalidated  at  each  subsequent  nllesu 
decision  point. 

We  have  developed  the  concept  of  a  companion, 
Air  Force  level  document  called  an  AFHENS. 

The  AFMENS  also  documents  a  deficiency  or  a 
need,  but  one  which  can  be  expected  to  lead 
to  an  acquisition  program  conducted  solely 
with  Air  Force  level  decisions.  Milestone 
Zero  approval  would  be  a  Secretary  of  the  Air 
Force  decision,  and  the  resulting  prog-am 
would  be  called  an  Air  Force  Designated 
Acquisition  Program  (AFDAP).  Again,  the 
need  would  be  reviewed,  reevaluated  and 
revalidated  ut  each  subsequent  milestone, 
but  the  milestone  reviews  acr  decisions  would 
be  made  at  Air  Force  rather  than  OSD  level. 

Determination  of  which  of  these  two  documents 
is  appropriate,  a  MENS  or  an  AFMENS, is  based 
on  a  subjective  consideration  wilh  only 
general  criteria.  When  the  anticipated  pro¬ 
gram  Impact  la  brood,  highly  significant 
nationally,  and  major  in  -ope,  the  OSD 
level  MENS  Is  probably  the  appro* - 'ate 
document.  If  the  impact  of  the  anticipated 
program  is  more  purely  Air  Force,  but  still 
large  In  scope,  the  AFMDJS  Is  likely  the 
proper  choice.  Dollar  threshold:  are 
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difficult  to  apply  since  the  needs  are  not 
supposed  to  be  solution  oriented,  but  the 
major  program  thresholds  formerly  used  of 
$50M  RDT&E  and/or  $200M  procurement  provide 
an  order  of  magnitude  guideline  that  at  least 
an  AFMENS  should  be  considered. 

Here  is  an  outline  of  the  key  items  which  will 
be  incorporated  in  either  HENS  or  AFMENS  pre¬ 
pared  by  the  Air  Force.  Keep  in  mind  that  the 
MENS  or  AFMENS  is  a  needs  oriented  document, 
not  a  requirements  document.  It  should  state 
clearly  what  the  deficiency  or  ’ceded, 
capability  is  in  mission  terms  at.d  not  be  a 
solution  description  with  specific  performance 
parameters  for  hardware. 
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The  approval  of  a  MENS  or  AFMENS  and  a  Mile¬ 
stone  Zero  decision  is  really  the  culmination 
of  the  requirements  process  as  it  i3  being 
conducted  by  the  Air  Force  at  the  present 
time.  The  process  begins  with  the  prepara¬ 
tion  of  a  Statement  of  Operational  Need  (SON) , 
normally  by  the  operating  WA.JCOM.  This  SON 
replaces  the  old  Required  Operational 
Capability  (ROC)  document  end  reflects  the 
seme  concentration  on  needs  rather  than 
requirements  that  characterizes  the  MENS.  The 
SON  derives  from  the  awareness  of  a  need  by 
the  operator,  based  on  mission  area  analytic, 
a  life  cycle  cos*,  analysis,  tome  technological 
opportunity,  etc.  The  Air  Force  Planning 
Guide,  which  results  from  the  Air  Force-wide 
fission  area  analysis,  la  a  key  input  to  this 
awareness. 


The  originator  sends  a  dratt  of  the  SON  u> 

AFSC  end  API.C  Headquarters,  and  any  others 
who  are  appropriate  for  comment.  The  Draft 
Threat  Assessment  is  sent  to  HQ  AFSC  (Intel). 
When  comments  have  been  received  from  thene 
parties,  the  originator  revises  the  SON  as 
necessary  and  sends  it  to  HQ  USAF,  with  copies 
to  the  MAJCOMS  and  others.  Recipients  of  the 
SON  send  their  comments  to  HQ  USAF  also,  to 
complete  this  part  of  the  SON  cycle. 

The  SON  and  all  the  related  MAJCOM  comments 
are  received  at  HQ  USAF  by  the  Requirements 
Review  Group  (RRG)  Secretariat ,  who  refers 
it  ail  to  an  R&D  action  officer  for  initial 
staffing  and  review.  If  it  is  determined 
that  it  is  not  appropriate  to  turn  the  SON 
into  a  MENS,  the  SON  will  be  processed 
through  the  Requirements  Review  Croup  for 
validation  and  approval,  Just  as  the  former 
ROCs  were.  If,  however,  a  MENS  is  recom¬ 
mended,  a  MENS  Planning  Group,  made  up  of 
action  officer  level  representatives  of  the 
RRG  member  organizations,  will  evaluate  the 
SON  and  develop  a  plan  for  generating  a  MENS. 
Actual  preparation  of  the  MENS  will  be  by  an 
Air  Staff  team  led  from  the  operations  side 
with  heavy  Intelligence  and  R&D  participation. 
The  MENS  will  ultimately  be  processed  through 
the  RRG  just  as  the  SON  was.  After  valida¬ 
tion  by  the  RRG,  the  MENS  will  be  processed 
through  the  Air  Staff  and  the  Air  Force 
Acquisition  Executive  (SAF/AL)  to  the 
Secretary  of  the  Air  Force  for  decision.  He 
may  approve  the  document  as  an  AFMENS, 
forward  it  as  a  MENS  to  the  SECDEF  through 
the  Defense  Acquisition  Executive,  or  dis¬ 
approve  the  document  and  either  terminate 
the  effort  or  send  it  back  for  further  work. 
Should  he  approve  it  as  an  AFMENS,  a  copy  of 
the  document  will  be  provided  to  the  Defense 
Acquisition  Executive  who  can  always  require 
OSD  review.  This  total  process  takes 
approximately  210  calendar  days.  Field  and 
initial  staff  comments  are  received  during 
the  first  sixty  days.  Following  preparation 
of  the  MENS,  OSD,  OJCS,  field  and  other 
Service  comments  are  solicited.  The  RRG 
review  constitutes  basic  corporate  senior 
management  review,  prior  to  submittal  for 
decision  at  the  Secretariate  level.  Mile¬ 
stone  Zero  decision  completes  the  require¬ 
ments  process  and  our  discussion  of  MENS  and 
Milestone  Zero.  The  next  subject  is  Air  Force 
Designated  Acquisition  Programs  or  AFDAPS. 

Air  Force  Designated  Acquisition  Programs, 
AFDAPs,  are  a  special  category  of  system 
acquisition  programs,  for  which  Secretary  of 
the  Air  Force  level  milestone  decisions  are 
more  appropriate  than  Secretary  of  Defense 
level  decisions.  In  our  previous  discussion 
about  MENS  and  AFMENS,  if  the  Secretary  of 
the  Air  Force  had  decided,  based  on  the 
earlier  subjective  criteria,  to  approve  the 
need  statement  as  an  AFMENS,  the  ensuelng 
program,  would  be  an  AFDAP.  An  AFDAP  is  still 
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a  major  cfforc  with  significant  impact  of  Air 
Force  capability.  It  is  expected  to  remain 
below  the  "major"  program  thresholds  of 
$75M  FDT&E  or  $300M  procurement.  AFDAPs  will 
replace  the  previous  Program  Memorandum  pro¬ 
grams,  but  the  OSD  staff  will  be  kept  informed 
of  progress  and  decisions  of  interest  to  them. 
With  the  Introduction  of  AFDAPs,  the  Air  Force 
will  have  three  levels  of  programs  from  a 
management  viewpoint;  major  systems  with 
SECDEF  milestone  decisions;  AFDAPs  with  SEOAF 
milestone  decisions;  and  non-designated  pro¬ 
grams  which  arc  less  than  major  system  and 
for  which  milestone  decisions  will  normally 
he  telegated  to  AFSC. 

Tlie  review  jnu  approval  of  AFDAPs  brings  us 
now  to  the  subject  of  the  acquisition  review 
process  and  the  Air  Force  System  Acquisition 
Review  Council  and  Defense  System  Acquisition 
Review  Council.  Both  the  AFSARC  and  DSARC 
serve  as  executive  corporate  advisory  bodies 
to  their  respective  Secretaries.  Both  are 
chaired  by  the  respective  Acquisition 
Executive:  the  AFSARC  by  the  Air  Force 
Acquisition  Executive,  SAF/AL;  and  the  DSARC 
by  the  Defense  Acquisition  Executive,  IKDRE. 
The  AFSARC  membership  Includes  key  SAF  and 
Air  Staff  principals,  vhlle  the  DSARC  Includes 
key  OSD  staff  principals.  Xey  OSD  staff 
principals  are  invited  to  AFSARC  meetings  of 
Interest  almost  as  a  matter  of  course.  The 
AFSARC  reviews  major  systems  prior  to  DS*RC 
review,  as  well  as  AFDAPs  for  Air  Force 
milestone  and  status  review.  It  is  envisioned 
that  the  AFSARC  can  review  major  programs 
prior  to  SECDEF  decision  and  thus  preclude 
the  requirement  for  DSARC  review.  The  DSARC 
is  required  to  review  major  programs  in  the 
strategic,  nuclear,  intelligence,  Joint- 
service.  C^,  or  multi-national  areas  at  Mile¬ 
stone  I.  It  will  review  only  the  major  pro¬ 
grams  designated  by  SECDEF  at  Milestone  XI 
and  III.  Kon-railltary  DOD  programs  will  also 
be  reviewed  by  the  DSARC. 

Hie  system  acquisition  review  process  Itself 
Is  an  orderly  scries  of  reviews  and  coordina¬ 
tion  cycles  which  depend  on  a  document  called 
the  Decision  Ccordinat'ng  Paper  (DCP).  The 
DCP,  or  Air  Force  DC'  or  AFDAPs,  is  the  data 
base  used  throughout  ne  coordination  and  re¬ 
view  process  at  Milestones  I,  II,  or  III.  The 
review  process  Itself  begins  with  a  DCP  plan¬ 
ning  conference  where  representatives  from 
each  of  the  key  activities  meet  to  set  up  a 
specific  schedule  of  events  and  target  datc3 
for  the  remainder  of  the  process.  The  ob¬ 
jective  of  thin  conference  i#  to  organise  the 
prorons  and  ensure  that  all  the  necessary  data 
inputs  aru  made  available  at  the  start  of  the 
Drteflng  and  rovlcw  cycle.  Thaea  inputa 
Include,  as  applicable,  the  Indepandent  Cose 
Aua'ynis.  Development  Test  and  Evaluation 
(DT-1-'.)  roport,  Operational  Test  and  Rvalua- 
tioi'  (OTtF.)  report,  and  the  production 
rend ir.se*  report.  One  of  the.  tosk3  of  the  key 


players  is  to  see  that  these  and  other 
critical  Inputs  are  available  before  the 
firpt  corporate  review  leading  to  AFSARC/ DSARC.. 

i  : 

Following  review  by  the  AFSARC,  the  Secretary 
of  the  Air  Force  will  make  a  milestone 
decision  for  AFDAPs,  or  forward  the  DCP  up 
the  chain  through  the  Defense  Acquisition 
Executive  to  the  DSARC  for  a  milestone 
decision  by  the  SECDEF.  Regardless  which 
Secretary  makes  tne  milestone  decision,  it  is 
documented  in  an  Action  Memorandum  to  the 
Air  Staff.  Action  Memos  Issued  by  the  SECAF 
-iso  forwarded  to  the  Defense  Acquisition 
Executive  i\..E>  for  information.  At  his 
option,  the  DAK  may  request  that  a  SACAF  mile¬ 
stone  decision  be  held  in  abvywe  pending 
review  by  the  DSARC.  Finally,  actual  Imple¬ 
mentation  of  a  Secretarial  decision  is  accom¬ 
plished  by  che  Program  Management  Directive 
issued  to  the  field  by  HQ  USAF. 

This  tctal  process  takes  takes  approximately 
180  day.-..  The  schedule  is  structured  to 
ensure  that  all  documentation  and  coordination 
is  completed  prior  to  the  start  of  the 
briefing  cycle. 


INTEGRATION’  OF  THE  RESOURCE  ALLOCATION 
AND  PROCRAM  DECISION  PROCESSES 


The  first  two  major  portions  of  this  paper 
have  dealt  with  related  separate  aspects  of 
Air  Force  acquisition.  The  integration  of 
those  two  aspects  has  been,  and  will  continue 
to-be  a  problem  area.  The  resource  allocation 
process  which  ip  described  in  this  paper  has 
been  developed  to  provide  a  mission  oriented 
rational  to  the  development  of  the  Air  Force 
program  in  the  PPBS  cycle.  On  the  other 
hand,  the  program  initiation  and  decision 
process  deals  with  the  generation  and 
continuation  of  any  individual  major  acquisi¬ 
tion  program  which  would  be  a  part  of  that 
overall  Air  Force  program.  It  is  obvious 
that  actions  in  cither  of  the  processes  can 
have  a  direct  effect  on  the  options  and 
activity  in  the  other.  There  is  today  little, 
if  any,  established  regimen  that  ties  the 
two  together. 

From  the  beginning  of  the  planning  cycle  to 
the  end  of  the  execution  of  any  fiscal  year 
program  is  a  time  span  of  about  four  years. 
That  the  PPBS  system  stretches  any  given 
year's  cyclo  that  far  is  logical  and  under¬ 
standable,  but  the  result  is  at  111  a  problem. 
At  any  one  tine,  there  are  three  or  four 
different  FYDP  programs  'n  various  stages  of 
preparation  and  review.  Thus,  there  is  an 
almost  constant  source  of  uncurl-, ally  and 
Instability  in  Individual  acquisition  programs 
which  is  totally  unrelated  to  anything  within 
the  programs  themselves.  • Also  a  problem,  is 
chat  each  of  these  FYDP  jvrograros  Is  undergoing 
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CONCLUSION 


perhaps  Its  greatest  changes  in  the  year  Just 
prior  to  execution,  during  the  enactment  cycle 
in  the  Congress.  On  other  hand,  the  lead 
time  to  influence  the  content  of  any  fiscal 
year's  FYDP  program  is  never  less  than  nine 
months  and  can  be  a  much  as  two  years.  The 
implications  of  this  on  a  milestone  decision 
are  significant.  After  Milestone  Zero  ap¬ 
proval,  the  only  way  to  fund  a  new  start 
during  this  lead  time  period  is  be  reprogram¬ 
ming  funds  from  some  other  program.  The  same 
is  true  of  adjustments  desired  at  any  other 
milestone  point  in  a  program.  Here  again,  duiv 
lng  the  enactment  year,  that  year's  FYDP  pro¬ 
gram  is  unavailable  to  the  Air  Force  for 
adjustment  or  modification  in  response  to 
individual  program  decisions  or  problems. 

The  introduction  of  Mission  Area  Analysis  tc 
the  resource  allocation  process,  and  the  con¬ 
centration  on  mission  requirements  in  the 
program  initiation  process,  are  Introducing 
a  common  element  to  the  two  activities. 

Mission  Area  Analysis  seems  the  best  hope 
for  providing  a  tie  between  these  processes. 
Just  how  to  apply  the  techniques  and  tools  to 
achieve  the  necessary  consistency  of 
direction  and  decisions  deserves  considerable 
attention.  That  challenge  is  perhaps  the 
single  most  important  focus  for  continued 
policy  and  procedure  development  in  this 
area  of  acquisition  research. 


This  paper  has  concentrated  on  the  Mission 
Area  Analysis  tools  and  techniques  developed 
to  support  resource  allocation  decisions  in 
the  Air  Force  RDT&E  program.  Subsequent 
applications  of  similar  methodology  to  the 
Air  Force-wide  resource  allocation  problem, 
and  to  the  development  of  need  statements  for 
individual  program  initiation  have  also  been 
covered,  but  less  thoroughly.  All  of  these 
aspects  of  acquisition  are  undergoing  change 
in  response  to  new  policy  initiatives 
external  to  the  Air  Force,  as  well  as  to  the 
commitment  within  the  Air  Force  to  approach 
system  acquisition  and  resource  allocation 
from  a  strongly  mission  oriented  viewpoint. 
Considerable  need  exists  for  continued 
development  of  Innovative  policies  and  pro¬ 
cedures  to  further  enhance  this  mission 
orientation,  to  provide  better  resource 
allocation  decision*,  and  to  smooth  the  system 
program  initiation  and  decialon  procesa. 

A  special  and  more  urgent  challenge  la  to 
find  ways  to  improve  the  tie*  between  the 
PPBS  and  the  syatem  acquisition  cycle. 
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DETERMINING  VALUE:  A  PROCESS  FOR  QUANTIFYING  SUBJECTIVE  BELIEFS 

Charles  Carter  Waid,  Wharton  Applied  Research  Center 
The  Wharton  School,  University  of  Pennsylvania 


INTRODUCTION 


Over  the  past  decade,  the  world  of  military 
procurement  has  moved  from  an  environment 
constrained  by  technology  to  one  constrained 
by  available  resources.  In  this  climate  of 
decreasing  resources,  acquisition  managers  are 
facing  increasing  pressure  to  provide  more 
rational  (itself lcatlon  for  their  programs  and 
to  make  m.  i  >  i-  'ficient  use  of  their  resources. 
It  would  appear  that  the  best  strategy  for 
dealing  with  these  pressures  is  to  develop  as 
objectively  as  possible  an  estimate  of  the 
relative  values  of  the  programs  and  activities 
under  the  manager's  control  and  to  use  these 
estimates  to  make  better  allocation  of  re¬ 
sources,  both  manpower  and  dollars. 

The  defining  of  value  within  his  organization 
is 'a  function  every  manager  performs  to  -ome 
extent*  the  very  act  of  setting  priorities  and 
allocating  resources  essentially  defines  what 
is  valuable  and  what  is  not.  In  order  for 
those  values  to  be  rotlonal  and  justifiable, 
they  must  be  logically  derived  from  the 
organization's  mission  and  in  r  manner  that  is 
comprehensible  to  others,  both  internal  and 
external  to  the  organization.  Moreover,  the 
organization's  values  must  be  communicated  to 
Its  members  so  chat  they  may  better  plan  for 
and  justify  the  particular  programs  for  which 
they  are  responsible. 

During  the  past  few  years,  the  theory  of  ana¬ 
lytic  hierarchies  has  been  developed  and 
applied  to  many  different  areas  of  multi- 
criteria  decision  making  (1),  (4),  (61,  (71. 

The  methods  of  this  theory  are  used  to  elicit 
from  decision  makers  quantitative  estimates  of 
the  values  they  intuitively  use  when  making 
decisions;  values  they  have  built  up  from  past 
experience.  We  have  recently  applied  this 
theory  to  several  decision  situations  within 
a  DOD  material  ncqulsif  a  organization  and  wc 
are  briefly  reporting  re  the  results  of  one 
application  made  in  che  area  of  resource 
allocation.  Generalizing  from  this  experience, 
we  describe  a  process  which  organizations 
having  similar  structure  and  management  style 
can  use  to  istlmatc  the  relative  values  of 
their  programs  and  activities. 


COMPARISON  MATRICES 


A  ko*  element  in  the  theory  of  analytic 
hierarchies  is  the  use  of  comparison  matrices. 
They  provide  a  method  for  obtaining  estimates 
of  the  relative  values  of  n  items  from  a 


matrix  of  estimates  of  the  ratios  of  these 
values.  To  begin,  a  person  or  group  of  persons 
are  asked  to  compare  the  items  two  at  a  time 
and  to  give  a  numerical  estimate  as  to  how 
many  times  more  valuable  one  is  than  the  other. 
This  gives  a  matrix  A  of  pair-wise  comparisons 
of  the  n  items.  Theoretical  considerations 
<ndicate  that  the  relative  values  of  the  n 
items  iuher'  '*■  in  the  comparisons  are  estimated 
by  the  coefficients  x«...,  xn  of  the  eigen¬ 
vector  S  corresponding  to  lL?  maximum  eigen¬ 
value  A  of  the  matrix  A.  That  is,  X  is  the 
(normalized)  solution  to  the  equation  AX”AX, 
with  A  maximal.  See  (3)  and  (5)  for  the 
technical  details  of  this  and  other  aspects  of 
anslytlc  hierarchies. 

Example:  -,n  experiment  was  conducted  in  search 
of  a  relationship  between  the  illumination 
received  by  four  identical  chairs,  C^,  C2,  C3, 
C4,  placed  on  a  line  at  distances  of  9,  15,  21 
and  28  yards  from  a  light  source.  Judges  were 
asked  to  compare  the  illumination  of  the  chairs 
pair-wise,  producing  the  following  comparison 
matrix: 


C1 

C2 

C3 

C4 

C1 

1 

5 

6 

7 

c2 

1/5 

1 

4 

6 

C3 

1/6 

1/4 

1 

4 

C4 

1/7 

1/6 

1/4 

1 

The  normalized  eigenvector  corresponding  to 
the  maximum  eigenvalue  of  this  matrix  produced 
relative  illumination  values  of  the  chairs  of 
O'. 61,  0.24  ,  0.10  ,  0.05,  respectively.  It  is 
well  known  that  the  Illumination  varies 
proportionally  with  the  inverse  square  of  the 
distance.  The  normalized  vector  of  inverse 
squares  of  the  distances  of  the  chairs  to  the 
light  source  is  0.607,  0.219,  0.112,  0.063. 

We  have  had  similar  accuracy  of  results  In 
other  experimental  applications  of  this  method 
to  situations  where  the  "answer"  could  be 
determined  by  objective  measures  (51,  (61. 


AN  APPLICATION 


A  Budget  Review  Board  in  the  subject  organiza¬ 
tion  was  formed  and  charged  with  the  respon¬ 
sibility  of  recommending -the  priorities  to  be 
placed  on  programs  being  included  in  the 
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organization's  budget  proposal.  The  Board 
obtained  its  information  about  the  various 
programs  under  consideration  via  written 
justifications  and  oral  presentations  by  the 
program  managers.  T.  Saaty  of  The  Wharton 
School  and  the  author  worked  with  the  Board  to 
test  the  applicability  of  analytic  hierarchies 
to  their  problem. 

The  Board  was  first  asked  to  define  the  primary 
purpose  for  prioritizing  the  programs  under 
review.  After  considerable  discussion,  it  was 
decided  that  the  fundamental  purpose  was  "To 
maximize  the  organization's  contribution  to 
the  improvement  of  field  operational  readiness 
and  capability."  As  it  stood,  this  purpose 
was  so  broad  that  it  was  of  little  help  in 
establishing  preference  between  any  two 
programs.  However,  to  people  experienced  in 
the  material  acquisition  process,  this  objec¬ 
tive  has  enormous  implicit  informational 
concent.  The  objective  of  the  exercise  was  to 
extract  this  content  from  the  Board  members. 
Taking  this  broad  objective  as  its  apex  (the 
top  level  of  the  hierarchy),  a  downward 
branching  hierarchy  of  sub-objectives  and 
factors  was  developed  until  a  level  of  detail 
was  reached  that  was  considered  to  be  opera¬ 
tionally  useful  for  setting  priorities  (Figure 
1).  Simultaneous  weighting  of  the  branches 
made  it  possible  to  keep  the  process  tractable 
by  "pruning"  those  branches  with  low  weights. 

Program  Management  and  Project  Management  were 
determined  to  be  the  most  Important  factors 
contributing  to  tl.e  fundamental  objective. 

Since  the  organization  dealt  primarily  with 
programs  rather  than  projects,  it  is  not 
surprising  that  project  management  was  given 
a  low  weight.  Consequently,  only  the  Program 
Management  branch  was  developed  further. 

Because  of  time  constraints,  it  was  also 
decided  to  concentrate  only  on  New  Programs. 

It  was  decided  that  the  most  Important  dimen¬ 
sions  along  which  New  Programs  should  be 
evaluated  were: 

-Improvement  of  Existing  Materials 
-Development  of  New  Materials 
-Development  of  New-  and  Improved  Systems 
-Cost  Savings 

A  comparison  matrix  for  these  four  factors  was 
constructed  by  the  Board,  producing  relative 
weights  of  0.68,  0.08,  0.29,  0.15,  as  indicated 
in  Figure  1.  Because  of  their  low  weight. 
Development  of  New  Materials  and  Cost  Savings 
were  dropped  and  only  the  two  remaining 
branches  developed  further.  Improvement  of 
Existing  Materials  branched  into: 

-Reliability  and  Maintainability 
-Survivability 
-Mission  Effectiveness 
-Produclbility 
-Operational  Feasibility 
A  comparison  matrix  of  the  relative  Impacts 
of  these  five  factors  upon  the  Improvement  of 
Existing  Materials  was  constructed,  yielding 


the  weights  shown  in  Figure  l.  Development  of 
New  and  Improved  Systems  branched  into: 

-Personal  Safety 

-Training 

-Operational  Efficiency 

-Fleet  Requirements 

Similarly,  a  comparison  matrix  for  these 
factors  was  constructed,  producing  the  weights 
shown  in  Figure  1.  The  lower  weighted  factors 
were  dropped  from  the  Initial  hierarchy  and 
the  weights  of  the  remaining  factors  were 
renormalized  to  produce  the  final  weighted 
hierarchy  shown  in  Figure  2.  For  example, 
since  the  relative  weights  of  Improvement  of 
Existing  Mace:  ials  and  Development  of  New 
and  Improved  i,-ste*c  were  0.48  and  0.29  within 
their  level  of  the  initial  hierarchy,  their 
relative  weights  in  the  final  "pruned"  hier¬ 
archy  shoulJ  be: 

0. 62*0. 48v (0.48+0. 29)  and  0. 38-0. 29HO. 48+0. 29) 
Each  relative  weight  of  a  final  criterion 
shown  at  the  bottom  of  Figure  2  is  the  product 
of  all  the  weights  of  the  segments  o.  the 
branch  containing  that  criterion. 

Because  of  time  constraints,  the  Review  Board 
was  unable  to  carry  out  the  next  steps 
described  below.  However,  they  actively  used 
the  criteria  in  their  deliberations  over 
program  priorities  and  in  their  justification 
of  the  priority  rankings  they  finally  recom¬ 
mended. 

The  next  steps  of  the  general  process  will  be 
exemplified  by  a  hypothetical  situation. 
Suppose  there  are  four  programs  A,  B,  C,  D 
under  consideration.  Using  each  criterion  in 
turn  as  a  dimension  of  comparison,  a  compari¬ 
son  matrix  for  the  four  programs  is  con¬ 
structed.  For  example,  suppose  the  compari¬ 
son  matrix  of  the  four  programs  relative  to 
the  criterion  of  Reliability  and  Maintainabil¬ 
ity  were 


RAM  A 

B 

C 

D 

A  1 

1 

3 

2 

B  1 

1 

6 

3 

C  1/3 

1/4 

1 

1 

D  1/2 

1/3 

1 

1 

An  eigenvector  of  this  matrix  is  used  as 
before  to  estimate  the  relative  values  of  the 
programs  vis  a  vis  the  criterion  under  con¬ 
sideration  (as  shown  in  Table  1).  The  final 
relative  value  of  a  particular  program  in 
obtained  by  taking  the  weighted  average  of 
its  values  with  respect  to  the  individual 
criteria,  e.g.,  the  overall  value  of  ,31  of 
program  A  Is: 

,25x.32+.  2ix.  23+-.  16x.21+.  23x.  44+.  15x,  35. 


Improve  Readiness  &  Capability 

/  ■ 

(.86) 

Program  Management 


Project  Management 


New  Programs . 

/  !  v 


Improve  Existing 
y  Materials 


y  Materials 
/  /  I  '  \ 

(.33)'  (.06)  l  'N  7  . 
/  /  (.28)  (.12)<^ 


Develop  New 
Materials 


/ 

Surviv¬ 

ability 


Mission 

F-ffec- 

tivnesss 


'x  Opera- 

N  tlonal 

Produci-  veasi- 

bility  bility 


Personal 

Safety 


\ 

Develop  New 

&  Improved  Systems 

/  1  w 

.11)  (.05)  (.34)( 

'  !  \ 

|  Opera- 

.  tional 

1  *  Effi¬ 

ciency 


Cost 

Savings 


(.34) (.50) 

\  \ 


Training 


Field 

Operation 

Require¬ 

ments 


a.  Th</  numbers  in  parentheses  indicate  the  branch  weight. 

b.  The  dashed  lines  indicate  branches  that  were  dropped  from  further 
consideration. 


FIGURE  2 


Final  Hierarchy 
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TAHI.E  1 


Program 

Criterlon-Spacif ic  Relative  Values 

Ova  rnll 
Program  Value 

R&h 

(.25) 

Mission 

Effectiveness 

(.21) 

Operational 

Feasibility 

(.16) 

Operational 

Efficiency 

(.23) 

Field  Opera¬ 
tion  Heeds 
(.15) 

A 

.32 

.23 

.21 

.44 

.35 

.31 

B 

.41 

.27 

.15 

.21 

.32 

.28 

C 

.12 

.31 

.29 

.26 

.12 

.22. 

D 

.15 

.19 

.35 

.09 

.21 

.19 

'W 


From  Che  table,  Che  rank  ordering  of  the 
programs  by  value  should  be:  A,  B,  C,  D.  If 
this  rank  ordering  were  all  that  was  known 
about  the  value  of  the  programs,  the  normal 
decision  rule  for  funding  would  be  to  fund 
all  of  A,  all  of  B,  and  so  forth  until  the 
budget  limit  was  reached.  Programs  lying 
below  this  cut-off  point  would  not  be  funded. 
However,  if  the  relative  values  of  the  pro¬ 
grams  are  known,  as  given  in  Table  1,  the 
above  rule  does  not  in  general  produce  the 
best  possible  allocation  declslun.  For 
example,  assume  the  estimated  costs  of  A,  B, 
C,  D  are  $3.25,  $2.75,  $2.50,  $.75  (in 
millions)  and  the  total  allowed  budget  is  $6 
million.  Then  the  stated  decision  rule  would 
fund  A  and  B,  and  drop  C  and  D,  producing  a 
package  whose  total  value  was  .59.  From  the 
table,  it  is  clear  that  one  could  obtain 
the  total  value  of  .69  by  funding  programs 
B,  C,  D.  The  funding  rule  to  be  used  in  the 
case  where  relative  values  are  known  is 
discussed  in  more  detail  in  a  later  section. 


THE  PROCESS 


It  is  assumed  that  the  organizations  for  which 
our  process  is  designed  have  the  general 
structure  of  Figure  3.  It  is  further  assumed 
that  the  management  style  is  consensus  seeking, 
top-down  decision  making  based  on  completed 
staff  work. 


Figure  3 


The  organizational  process  we  describe  here  is 
broken  into  two  stages.  The  first  stage  is 
the  development  of  an  organizational  "value 
structure":  a  set  of  weighted  decision  crlte- 
tia.  The  second  stage  is  the  estimation  of 
program  values  based  on  the  value  structure. 

Complex  decision  systems,  both  natural  and 
artificial,  have  value  structures  which  enable 
them  to  make  decisions.  The  value  structure 
of  a  natural  system  apparently  develops 
through  chance  and  natural  selection,  while 
that  of  an  artificial  system  is  built  in  by 
the  system  designer  who  extrapolt teB  the 
structure  from  the  fundamental  purpose(s)  for 
which  the  system  is  to  be  used  (2).  The 
latter  is  the  approach  taken  here.  Although 
subject  to  periodic  review  and  adjustment, 
the  value  structure  is  to  be  organizational 
policy  that  is  relatively  stable  over  time, 
and  the  extensive  effort  required  to  produce 
the  structure  need  not  be  repeated  annually. 

The  first  step  is  to  carefully  construct  the 
hierarchy  that  is  to  produce  the  criteria. 

Lists  of  potential  criteria  are  elicited  from 
the  sub-unit  managers,  the  decision  maker  and 
others.  The  staff  consolidates  this  informa¬ 
tion  and  formulates  one  or  more  hierarchical 
breakdowns  of  the  mission  statement  compatible 
with  the  level  of  detail  and  intent  of  the 
solicited  criteria.  It  is  important  that  these 
hierarchies  are  not  mere  reflections  of  the 
organization's  structure.  If  a  set  of  criteria 
is  developed  such  that  one  criterion  applies 
primarily  to  sub-unit  A's  programs,  another 
to  sub-unit  B's  programs,  etc.,  it  will  be 
difficult  to  attain  consensus  as  to  whether 
one  particular  criterion  is  more  important 
than  another.  Parochialism  cannot  be  avoided 
entirely  but  its  effects  should  be  minimized 
on  the  basic  value  structure.  A  draft  hier¬ 
archy  is  selected  by  the  decision  maker  and 
circulated  to  the  sub-unit  managers  for  their 
comment.  After  considering  these  remarks,  the 
decision  maker  approves  the  final  hierarchy  and 
its  criteria  (Figure  4) . 
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Figure  4 
Mission 
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Level  1 


Level  2 


Criteria 


The  second  step  is  the  actual  weighting  of 
the  criteria.  Progressing  level  by  level 
down  the  hierarchy,  blank  comparison  matrices 
are  circulated  to  the  sub-unit  managers  and 
others  Involved  in  the  process  who  are  then 
to  fill  in  their  estimates  of  the  ratios 
involved.  For  example,  referring  to  Figure 
4,  there  would  be  a  matrix  circulated  of  the 
form: 


X 

1 

_  _  _ 

A 

Y 

1 

1 

i_L_ 

1 

The  personnel  Involved  would  be  asked  to  place 
in  the  box  marked  with  the  asterisk  their 
estimate  of  the  ratio  of  the  importance  of 
factor  X  to  that  of  factor  Y  in  achieving 
factor  A.  These  matrices  would  be  analyzed 
by  the  staff.  If  there  are  major  differences 
of  opinions,  the  conflicting  parties  would 
be  n6kcd  to  prepare  justifications  supporting 
their  positions.  (We  have  found  that  dif¬ 
fering  perceptions  of  the  meanings  of  the 
factors  being  compared  ia  a  frequent  cause 
of  disagreement.)  The  average  branch  weights 
and  the  position  papers  are  used  by  the 
decision  maker  and  his  immediate  staff  when 
making  the  final  determination  of  weights. 

This  final  weighting  'toceas  should  take  place 
during  a  two  or  thr  day  planning  retreat. 

The  final  value  sere  ture  is  communicated  to 
the  organization  and  higher  authority  ns  a 
statement  of  policy. 

The  second  stage  is  that  of  estimating  the 
relative  values  of  the  programs  themselves 
(or  decision  packages  if  one  is  working  in  a 
zero-bane  budgeting  context),  and  is  to  be 
carried  out  annually  during  the  POM  cycle. 
Criterion  by  criterion,  the  programs  are 
compared  against  one  another  to  produce 
their  criterion-specific  relative  values.  The 
we’ghts  of  the  criteria  are  then  used  as 
previously  shown  to  "glue"  these  criterion- 
specific  values  of  the  programs  together  to 


produce  a  single  valued  estimate  of  relative 
worth. 

The  first  thing  to  be  settled  is  which  pro¬ 
grams  arc  at  the  appropriate  level  for  evalua¬ 
tion  by  the  decision  maker.  The  programs 
must  be  sufficiently  broad  so  as  to  allow 
adequate  decision  making  power  to  the  sub¬ 
unit  managers.  For  hardware  programs,  the 
work  breakdown  structure  should  provide  a 
guide,  but  the  problem  will  be  more  difficult 
for  such  "improve  the  system"  tasks  as  "modern¬ 
ize  the  approach  to  specs  and  standards"  or 
"rcvi&r*  .'•'sting  procedures."  The  next  step 
I  is  to  weight  the  programs  relative  to  the 
criteria  of  the  value  structure .  This  would 
’  be  carried  out  by  the  staff  oi  a  specially 
i  formed  committee  during  the  POM  process.  Hou- 
1  ever,  carrying  out  the  process  on  all  programs 
could  be  a  monumental  task.  Even  if  the  number 
of  criteria  were  few,  a  large  number  of  pro¬ 
grams  (or  decision  packages)  could  prove  over¬ 
whelming.  Two  comments  are  in  order  here. 
First,  on-going  programs  would  only  need  to  be 
updated;  comparison  matrices  from  the  previous 

•  year  could  be  re-examined  and  modifications 
!  made  to  only  a  few  entries.  However,  new 

■  programs  would  still  have  to  be  weighted 

•  relative  to  themselves  and  the  on-golng 
programs.  Second,  In  a  marginal  analysis 
budgeting  process,  such  as  ZBB,  only  those 
programs  in  the  neighborhood  of  the  cut-off 
point  need  to  be  carefully  valued.  The 
rankings  of  the  very  high  priority  and  low 
priority  programs  could  be  determined  by 
other,  less  time  consuming  means. 


THE  ALLOCATION  DECISION 


While  the  estimated  program  values  produced  by 
this  process  will  not  be  sufficiently  accurate 
to  allow  for  n  straightforward  application  of 
mathematical  optimization  techniques,  it  Is 
nevertheless  useful  to  discuS3  the  theoretical 
consequences  of  such  an  application.  If  there 
'•  arc  n  programs  (or  decision  packages)  Pi,  P2, 

.  ...,Pn  having  estimated  values  v^,  V2,...,vn 
and  estimated  costs  ci,  C2,...,cn.  one  should 
fund  that  portfolio  of  programs  having  maximal 
value  among  s'  1  those  whose  cost  does  not 
1  exceed  the  funding  constraints.  Assuming  that 
|  the  value  of  a  portfolio  is  the  sum  of  the 
I  values  of  Its  members,  one  is  led  to  using 
linear  programming  to  determine  the  optimal 
portfolio.  If  the  decision  on  each  program 
is  to'  either  fund  or  not  fund,  integer 
programming  would  apply.  If  some  of  the  pro¬ 
grams  could  be  partially  funded  (and  linearity 
of  value  received  with  i.jpect  to  funding 
level  held) ,  mixed  Integer  prog'-  -mlng  would 
be  u-ed.  There  are  two  important  Implica¬ 
tions  of  these  remarks. 

1.  The  values  vj  can  be, taken  to  be  the 
relative  values  (Evj"l)  rather  than  the 


/*> 


"actual"  values  of  the  programs. 

2.  The  general  rule  of  thumb  for  setting 
funding  priorities  on  programs  Is  to  rank  them 
by  their  efficiencies  Vj/c^  rather  than  their 
values.  That  is,  the  programs  should  be  funded 
in  the  order  P^,  P2,...Pn  where 
vj/cj  >_  V2/C2  >  ...  >  vn/cn.  Th*8  decision 
rule  will  produce  a  good  approximation  of 
the  optimal  portfolio.  This  is  important 
because  it  is  the  decision  maker  who  controls 
the  numerator  v^  while  the  sub-unit  manager 
controls  the  denominator  cj.  If  the  program 
manager  clearly  understands  this  funding  rule 
he  will  try  to  convince  his  superior  to  in¬ 
crease  the  program  value  (hopefully  by  better 
justifications)  and  will  tend  to  be  more 
efficient  by  minimizing  program  costs  (strict 
rules  concerning  cost  overruns  must  be  en¬ 
forced  here). 
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CONCLUSION 


Since  the  majority  of  this  paper  has  been 
devoted  to  describing  the  mechanics  of  the 
process,  some  space  should  be  devoted  to 
a  discussion  of  its  behavioral  and  motiva¬ 
tional  aspeccs.  Through  the  use  of  logically 
derived  hierarchies  and  systematic  pair-wise 
comparisons,  the  process  provides  a  truly 
holistic  approach  to  planning.  Consequently, 
it  produces  a  surprising  degree  of  consensus 
among  its  participants.  Nor  does  it  only 
drive  towards  consensus;  it  also  clarifies  the 
remaining  points  of  disagreement  to  such  an 
extent  that  the  participants  have  a  clear 
understanding  of  where  or'.ers  stand  and  why. 
There  is  a  high  potential  for  team  building 
inherent  in  the  process.  This  is  why  the 
final  planning  retreat  with  the  decision 
maker  and  his  immediate  staff  is  so  important. 

A  major  behavioral  objective  of  the  retreat 
is  the  development  of  a  top-management  team 
having  a  shared  understanding  of  values  and 
who  can  communicate  and  logically  justify  these 
values  with  one  voice  to  others  within  and 
without  the  organization. 
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INTRODUCTION 

Acquisition  managers  in  the  Department  of 
Defense  face  a  world  of  expanding  technical 
complexity,  shrinking  resources,  increasing 
mission  needs,  and  more  detailed  public 
Accouneablli ty. 

In  Pursuing  the  legitimate  objective  of 
managing  ihe  Defense  effort  in  this  environ¬ 
ment,  top  man.  > ament  institutes  such  disci¬ 
plines  as  are  defined  by  Office  of  Management 
and  Budget  Bulletin  A-109,  Zero  Based  Budg¬ 
eting  and  Management  By  Objectives. 

How  does  the  acquisition  manager  cope  with  the 
bewildering  environmental  complexities  and  the 
seemingly  disjointed  and  conflicting  array  of 
de.-nnds  and  acquire  new  weapon  systems  (as  the 
text  uooks  nay)  in  an  effective  and  efficient 
manner? 

This  puper  examines  the  acquisition  process 
from  the  viewpoint  of  theory  and  concepts. 
There  are  many  ways  of  looking  at.  this 
process;  some  are  better  than  others.  The 
viewpoint  outlined  herein  may  provide  a  more 
scientific  and  better  understanding  of  the 
acquisition  process  and  thereby  promote  better 
acquisition  management. 

OVERALL  APPROACH 

Peter  Orueker  points  out  that  the  only  product 
of  managers  (Government  and  otherwise) ,  and 
their  supporting  staffs,  is  information  which 
transmits  the  decisions  of  the  manager  to 
workers  who  use  that  Information  to  produce 
and  deliver  the  goods  and  services.  Thus,  an 
overall  concept  which  integrates  the  acquisi¬ 
tion  process,  OMB  Bulletin  A-109,  Zero  Based 
Budgeting  and  Management  By  Objectives,  is  the 
consideration  of  all  of  these  disciplines  as 
decision  processes  which  generate  information. 
This  paper  does  not  d'  uss  the  vital  "doors" 
who  produce  goods  an:  ervlces  used  by  the 
operating  commands,  bu .  is  limited  to 
examining  the  hierarchy  of  management  deci¬ 
sions  which  direct  the  "doers." 

It  Is  assumed  to  be  self-evident  that  it  is 
the  objective  of  each  manager,  at  all  levels 
of  an  organization,  to  make  those  decisions 
which  will  result  In  providing  the  operating 
command  with  the  "bast"  weapon  system  from 
the  myriad  of  alternatives  which  :xlst.  It  Is 
probnbly  the  understatement  of  '.he  day  to 
obse-ve  that  each  acquisition  manager  must 
perf  unis  In  a  complex,  dynamic  and  unstructured 
world.  In  order  for  the  rae  mger  to  make 
rational  decisions,  he  must  collect  and 


organize  unstructured  data  into  information 
.which  allows  the  comparison  of  the  available 
alternatives  upon  some  common  basis.  Based  on 
this  structured  information,  he  must  make  his 
decisions  (choices)  and  transmit  these  choices 
to  his  subordinates  as  information  to  guide 
their  subsequent  choices.  Thus,  not  only  does 
management  generate  information  to  transmit 
their  Ucc‘  ions  to  workers,  but  also,  higher 
level  management  must  provide  Information 
which  transmits  their  decisions  to  the  lower 
levels  of  management. 

This  paper  suggests  that  improving  the  acquis¬ 
ition  process  requires  a  definition  and  under¬ 
standing  of  the  nature  and  content  of  the 
decisions  which  must  be  made  as  the  prerequi¬ 
site  to  defining  who  (the  organization  or 
individuals)  should  be  assigned  the  responsi¬ 
bility  for  these  decisions  or  how  (the 
processes  or  procedures  used)  the  decisions 
should  be  made.  Thus,  this  paper  is  limited 
to  "what"  decisions  must  be  made  rather  than 
the  "who"  or  the  "how"  of  the  decision 


DISCUSSION 

In  order  to  illustrate  the  concepts  outlined 
in  this  paper,  an  example  is  considered  in  the 
discussion  which  follows.  This  example  is 
grossly  simplified  but  is  representative  of  one 
of  the  kinds  of  problems  which  face  the  acqui¬ 
sition  manager.  This  example  illustrates  the 
structuring  of  data  in  a  manner  which  will 
promote  the  rational  choice  of  the  "best" 
weapon  system.  This  example  structures  data 
utilizing  relationships  based  upon  engineering 
principles  and  statistical  evidence  where 
available.  Where  such  relationships  have  not 
been  established,  they  are  assumed.  The 
assumptions  and  numerical  values  used  in  this 
example  have  no  significance  other  thar.  to 
Illustrate  the  concepts  presented  in  the  paper. 

Assume  the  Navy  needs  expanded  capability  to 
provide  logistic  support  to  its  carriers. 
Further,  assux"  that,  of  the  alternate  means 
available,  an  analysis  has  established  that 
the  most  cost  effective  system  that  can  be 
provided  to  satisfy  this  needed  capability  will 
be  an  Inventory  of  100  aircraft  which  can  land 
aboard  the  largo  carriers.  Based  on  analysis, 
the  Mission  Element  Need  Statement  (MENS) 
defines  the  following  needs  and  constraints: 

Maximum  range  at  which  logistics  must  be 
delivered  -  3,000  n.  miles 

Annual  payload  delivery  capability  at  3,000  n. 
milos  -  1  100  X  10f>  lbs.’ 
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Maximum  system  life  cycle  cost  -  $7.5  billion 
Maximum  annual  RDT&E  cost  -  $150  million 
Initial  operating  capability  -  January  1986 


With  the  need  as  defined  by  the  MENS,  the 
acquisition  manager  may  then  determine  opera¬ 
tional  assumptions  and  design  constraints,  and 
obj ectives: 


Constraints: 


Maximum  take-off  gross  weight  (acceptable 
for  landing  on  a  carrier)  -  50,000  lbs. 


Aircraft  life  (assumed)  -  20  yrs. 


Average  peacetime  utilization  (assumed) 
-  30  fit.  hrs./mo. 


Objective: 


Maximum  logistic  delivery  capability  for  the 
minimum  life  cycle  cost. 


With  above  assumptions,  constraints,  and 
objective,  the  acquisition  manager  may  then 
request  proposals  from  Industry.  For  this 
example,  assume  the  propulsion  system  is 
Government  Furnished  Equipment  and  the  manager 
procures  the  propulsion  system  from  one  con¬ 
tractor  and  the  remainder  of  the  aircraft 
weapon  system  (defined  as  the  airframe  in  this 
example)  from  another. 


In  order  to  keep  the  example  extremely  simple, 
assume  the  manager  has  the  following  weapon 
system  alternatives: 


Continue  purchasing  an  existing  airframe 
configuration  -  Configuration  A 


Develop  and  purchase  a  new  airframe 
configuration  -  Configuration  B 


Continue  purchasing  an  existing  propulsion 
system  -  Configuration  1 


Develop  and  purchase  a  new  propulsion  system  - 
Configuration  2 


Combinations  of  the  above 


Table  I  shows  the  characteristics  of  the  air¬ 
frame  and  propulsion  systems  available.  Inas¬ 
much  as  each  alternate  considers  events  which 
will  occur  in  the  future  and  there  is  risk 
associated  with  achieving  each  characteristic 
listed,  This  risk  is  defined  as  (1-F),  where 
P  is  the  probability  that  the  quantitative 
value  listed  will  be  achieved.  In  order  to 
quantitatively  consider  riek  the  expected 
value  of  each  characteristic  is  calculated  in 
Table  I  as  the  estimated  value  either  multi¬ 
plied  by  P  or  divided  by  P  (it  is  always 
assumed  that  risk  makes  the  expected  value 
"worse"  than  the  estimated  value)  , 


In  this  extremely  simplified  example,  it  is 
also  assumed  that  experts  have  validated  that 
all  of  the  values  in  Table  I  are  the  best 
estimates  available  and  futhcr  that  all  key 
program  milestones  are  satisfactory  in 
relationship  to  the  required  operating  date. 


The  problem  presented  to  the  acquisition 
manager  at  this  point  is  how  to  choose  the 
"best"  airframe-propulsion  system  combination 
for  the  Navy.  However,  because  of  the  fact 
that  no  single  airframe  or  propulsion  system 
exhibits  all  of  either  the  good  characteris¬ 
tics  or  all  of  the  bad  ones,  the  manager  must 
put  weighting  factors  on  each  characteristic 
in  order  to  select  the  best  weapon  system. 


Table  II  shows  some  parameters  which  are 
considered  to  be  significant  to  the  user  (and 
the  acquisition  manager)  of  the  weapon  system 
and  the  variable  from  Table  I  which  deter¬ 
mines  the  values  of  each  of  the  parameters 
listed.  The  detailed  equations  which  relate 
the  indicated  variables  to  each  particular 
parameter  listed  are  shown  in  Appendix  A. 


table  111  shows  the  value  of  the  system 
parameters  listed  in  Table  II  using  the 
equations  of  Appendix  A. 


The  data  on  Table  III  allows  the  manager  to 
make  a  better  judgment  than  that  on  Table  I, 
however,  there  is  still  no  direct  basis  for 
comparing  the  alternatives. 


The  manager  may  further  reduce  the  variables 
which  he  must  consider  by  relating  all  of  the 
parameters  which  contribute  to  the  effective¬ 
ness  (military  worth)  of  the  system  into  one 
value  and  those  parameters  which  contribute 
to  the  cost,  or  disadvantages,  of  the  system 
into  another  value.  Appendix  A  assumes  the 
relationships  are  as  follows  and  computes  the 
values  indicated  on  Table  IV. 


E  (Effectiveness)  «  Payload  X  Cruise  Vel.  X 
Op.  Readiness  X  Prob,  of  Mission  Success  X 
No.  Aircraft 


C  (Life  Cycle  Cost)  -  P.5D  Costs  +  Investment 
Costs  +  Total  Operation  &  Support  Costs 


The  values  of  Table  IV,  when  plotted  on  a 
graph  of  effectivenesi 
on  Figure  1. 
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From  Figure  1,  it  is  obvious  Chat  Configura¬ 
tion  A-2  is  the  worst  choice  of  the  alterna¬ 
tives  available.  However,  the  best  choice 
from  Configurations  A-l,  B-l  or  B-2  is  not 
obvious. 


decision  maker  should  rank  the  alternatives 
available?  There  are  several  general  charac¬ 
teristics  of  the  required  preference 
criterion  which  are  believed  to  be  of 
primary  significance. 


In  the  real  world,  judgment  can  be  applied  in 
selecting  one  of  the  following: 

Lowest  cost  Configuration  A-l 

Greatest  effectiveness  Configuration  B-2 

Lowest  risk  Configuration  A-l 

A  more  "scientific"  ranking  of  the  alterna¬ 
tives  may  be  achieved  by  assigning  a  numerical 
value  to  the  relationships  between  the 
effectiveness  of  a  system  and  its  military 
worth  tc-  '.no  O)  jrntor  expressed  in  dollars 
(function  fn  in  Appendix  A). 

By  assigning  a  value  to  fm  of  $12/lb.-n.mi ./ 
hr,  the  net  military  gain  resulting 
from  the  acquisition  of  each  of  the 
alternatives  as  listed  below  may  ue  calcu¬ 
lated  using  the  equation: 

G  (Net  Military  Gain)  «  12  X  E  (Effectiveness) 
-  C  (Life  Cycle  Cost) 


.  The  criterion  should  measure  the  degree  to 
which  each  alternative  contributes  to  the 
higher  level  need  which  originates  from 
outside  the  organization.  In  this  case,  the 
operating  command  (an  "outside"  organization) 
has  a  need  for  an  expanded  logistic  support 
capability. 

.  The  preiticr.ee  criterion  should  be  a  single- 
valued  measure  of  the  contribution  of  each 
alternative  of  the  higher  level  need.  It  is 
suggested  that  every  decision  maker,  in  the 
final  analysis,  must  use  a  criterion  which 
provides  a  common  single-valued  basis  for 
directly  comparing  the  alternatives.  Other¬ 
wise,  he  cannot  rationally  rank  one  alterna¬ 
tive  relative  to  the  other.  In  this  example 
it  was  ..ssumed  that  the  single-valued 
criterion,  net  military  gain,  measured  the 
contribution  each  alternative  made  to 
satisfying  the  Navy's  need  for  additional 
logistic  support. 


Net  Military  Cain 
$2,830  B 
2.470  B 
2.371  B 
1.729  B 


Alternative 

B-l 

B-2 

A-l 

A-2 


Thus,  the  acquisition  managor,  by  the  above 
procedure,  may  rationally  select  Configura¬ 
tion  B-l  a3  the  beat  weapon  system  from  the 
available  combinations  of  airfrume  and  pro¬ 
pulsion  subsystems. 


From  the  above  example  and  the  supporting 
equations  of  Appendix  A  the  discussion  that 
follows  outlines  some  general  principles  that 
were  used  to  define  and  structure  data  in  a 
form  which  allows  the  decision  maker  to  make 
a  rational  decision.  It  is  suggested  that 
these  pt incipies  may  have  broad  application 
to  decision  maxing,  in  general. 


The  overall  principle  J  that  management 
should  strive  to  deal  ith  data  chat  are 
objective,  quantita1. ,v  and  measurable.  This 
is  the  essence  of  science  as  compared  to  art. 
Without  belaboring  the  merits  of  being 
"scientific,"  scientific  methods  are  more 
effectively  communicated,  taught  and  verified. 
Erroneous  postulates  can  be  independently 
measured  and  corrected  and  the  methods  thereby 
improved  with  time. 

First — what  id  tha  nature  and  content  of  the 
decision  to  be  made?  In  this  example,  the 
specific  decision  is  the  selection  of  the 
best  combination  of  subsystems  from  the 
opti'ns  available. 


.  Ideally,  the  preference  criterion  should 
relate  all  of  the  advantages  of  each  alter¬ 
native  to  all  of  the  disadvantages  of  the 
same  alternative.  In  this  example,  ail  of  the 
advantages  are  combined  in  the  term  "Effec¬ 
tiveness"  and  all  of  the  disadvantages  in  the 
term  "Life  Cycle  Cost.”  The  relation  between 
Net  Military  Gain  (G),  Effectiveness  (E) ,  and 
Life  Cycle  Cost  (C)  were  given  by  the 
equation: 


G  =  12E  -  C 

Third — what  data  must  be  collected  in  order  to 
rank  the  alternatives?  It  is  believed  to  be 
seif  evident  that  the  data  listed  in  Tabic  I 
had  to  be  derived  by  beginning  with  Che 
assumed  single  valued  criterion  (Net  Military 
Gain)  and  then  deriving  the  measurable  quan¬ 
titative  variables  which  were  necessary  to 
determine  the  value  of  the  Net  Military  Gain 
offered  by  each  alternative  available.  This 
was  the  procedure  by  which  the  variables 
listed  in  Table  I  were  derived  in  Appendix  A. 
The  general  conclusion  is  that  the  decision 
maker  should  develop  the  data  needed  from  his 
subordinates  rather  than  vice  versa.  Other¬ 
wise,  the  data  are  likely  to  be  redundant  and/ 
or  -incomplete. 

In  this  example,  after  the  acquisition  manager 
has  Selected  Alternative  B-l,  it  is  appropri¬ 
ate  that  Che  variables  listed  for  Airframe  B 
and  Propulsion  System  1  bo  cntabJ.siied  as 
objectives.-  (along  with  the  schedule  and 
other  constraints)  for  the  airframe  and  pro¬ 
pulsion  system  contractor,  respectively. 
Single-valued  objectives  for  the  best  sub¬ 
system  to  match  each  of  the  two  alternative 


Second — what  is  the  criterion  by  which  the 


subsystems  nay  be  developed  from  the  variables 
listed  on  Table  I,  This  development  Is  oeyond 
the  scope  of  this  paper. 

(In  this  paper  it  is  suggested  that  the  term 
"need"  used  by  the  strategic  operator,  "objec¬ 
tive"  or  "goal"  used  by  the  general  manager, 
"requirement"  used  by  the  engineering  manager, 
or  "purpose"  used  by  the  behavioralist  are 
different  terms  which  generally  have  the  same 
meaning.  Other  than  in  the  case  of  the 
Mission  Element  Need  Statement,  the  term 
"Objective"  is  used  in  this  paper.) 

It  would  appear  to  be  self-evident  that,  when 
the  weapon  system  manager  is  assigned  the 
responsibility  for  a  MENS,  he  should  also  be 
provided  with  the  resources  necessary  to 
implement  the  program  required  to  satisfy  the 
needs  defined  therein.  Also,  when  the  weapon 
system  manager  allocates  objectives  for  the 
airframe  contractor  and  propulsion  system 
contractor  (in  the  example),  it  would  also 
appear  self-evident  that  he  must  allocate  the 
resources  provided  to  each  contractor  in  order 
for  the  objectives  defi“ad  for  each  subsystem 
to  be  satisfied. 

Although  the  above  case  assumes  a  precise 
measurable  objective  for  the  system  and  the 
subsystems,  in  the  real  world  the  problems 
are  many  times  more  complicated.  All  knowl¬ 
edge  never  re9ide3  in  a  single  individual  or 
organization.  It  is  considered  Important  both 
from  the  viewpoint  of  getting  the  most 
appropriate,  precise  and  measurable  objec¬ 
tives  and  also  getting  the  cooperation  of  all 
participants  that  the  objectives  (and  con¬ 
straints)  should  be  negotiated  between 
superior  and  subordinates;  not  unilaterally 
directed  from  on  high. 


It  is  also  suggested  here  that  the  two 
alternative  airframes  and  the  two  alternative 
propulsion  systems,  each  with  the  associated 
resources  required  for  implementation  of 
the  alternative,  represent  logical  "decision 
packages"  for  management  to  consider  in 
effecting  Zero  Based  Budgeting. 

0MB  BULLETIN  A-109 

The  above  example  illustrates  the  nature  and 
content  of  the  decisions  which  must  be  made 
in  only  one  life  cycle  phase  (pre  DSARC  I)  and 
in  the  acquisition  process  of  a  major  system 
at  only  one  work  breakdown  structure  level. 

The  discussion  that  follows  expands  to 
consider  the  acquisition  process  over  the 
life  cycle  of  a  weapon  system  as  defined  by 
0MB  Bulletin  A-109  and  DOD  Directive  5000.1. 
Another  concept  is  the  proposition  that  all 
acquisitions  proceed  through  five  relatively 
distinct  life  ../cle  phases,  and  that  each 
phase  generates  information  in  the  form  of 
a  contract  between  the  relatively  distinct 
type  of  manager:  who  must  manage  each  success¬ 
ive  phase.  These  phases,  including  the 
relationship  to  the  DSARC  decisions  as 
defined  in  Department  of  Defense  Directive 
5000.1,  the  type  of  manager  Involved  and 
(in  the  caae  of  major  weapon  systems),  the 
primary  document  or  "contract"  generated 
as  the  result  of  each  phase,  are  listed 
below: 


LIFE  CYCLE  PHASE 

Identification  of  a 
need  (pre  DSARC.  0) 

Definition  (and  valida¬ 
tion)  of  program  plan 
(pre  DSARC  1) 

Design  (and  development) 
(Pre  DSARC  II) 


TYPB  MANAGER  INVOLVED 
Strategic  Operators 


Weapon  System  Preliminary 
Design  Mtmager 


Weapon  Systems  Design 
Manager 


Production  (pre  DSARC  III  Weapon  System  Production 

Manager 

Operation  (post  DSARC  III)  .  Operating  Command 


PRIMARY  DOCUMENT  PRODUCED 

Mission  Element  Element  Need 
Statement 

Weapon  System  Development  Contract 
(including  the  System  Performance 
Specifications) 

Weapon  System  Production  Contract 
(including  the  System  Design  Data 
Package) 

Actual  Systems  with  Operating  and 
Support  Instructions  (The  actual 
manufacture  cf  systems  is  outside  the 
definition  of  managers  as  discussed 
in  this  paper) 


As  the  acquisition  process  proceeds  through 
these  life  cycle  phases,  the  decisions  made 
during  each  phase  successively  narrow  the 
choices  aveiiable  at  each  successive  phase. 

Also,  as  the  process  proceeds,  the  decisions 


made  at  the  higher  levels  of  the  work  break¬ 
down  structure  of  a  weapon  system  successively 
narrow  the  choices  available  at  each  lover 
level  cf  the  work  breakdown  structure,  (in  the 
example,  after  airframe  B  and  propulsion 
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system  1  are  chosen,  effort  at  the  lower  work 
breakdown  structure  levels  is  limited  to  these 
subsystems.) 

A  description  of  an  acquisition  decision  model 
which  divides  the  process  by  life  cycle  phases 
and  work  breakdown  structure  level  is  outlined 
in  detail  in  a  forthcoming  paper  in  the 
"Defense  Systems  Management  Review"  and  will 
not  be  discussed  in  any  detail  here.  Briefly, 
however,  the  decision  model  describes  a 
complex  process  in  which  gross  requirements 
and  rotal  resources  are  successively  broken 
down  into  a  more  detailed  definition  of  the 
weeoon  system* s  elements,  with  each  element 
being  allocated  a  smaller  share  of  the  total 
available  resc -rces.  Throughout  the  process, 
needs  i«-d  available  resources  (which  flow 
from  the  managers  responsible  for  the 
higher  work  breakdown  structure  levels  and 
earlier  life  cycle  phases)  must  be  matched 
with  available  alternatives  and  required 
resources  (which  flow  from  the  managers 
responsible  for  the  lower  work  breakdown 
structure  levels  and  later  life  cycle  phases 
of  the  weapon  systems). 

During  this  complex  process,  the  Weapon  System 
Manager,  by  reviewing  the  results  of  analyses 
and  tests,  by  continuous  monitoring  of  the 
process  and  by  making  the  program  changes  as 
indicated,  strives  to  reduce  the  risk  (as 
numerically  listed  on  Table  I  in  the  example) 
associated  with  achieving  all  performance 
objectives  established  at  multiple  management 
levels. 

MANAGEMENT  BY  OBJECTIVES  (MBO) 

It  is  the  writer's  understanding  that  the 
following  are  the  key  elements  of  MBO: 

.  Use  of  quantified  measurable  objectives  at 
all  levels  of  the  organization. 

.  Negotiation  of  objectives  between  superior 
and  subordinate. 

.  Periodic  review  of  the  subordinate's 
progress  relative  to  objectives. 

.  Rewards  to  the  subo  linate  related  to  the 
degree  to  which  he  achieved  the  assigned 
objective. 

It  is  also  the  writer's  understanding  that  MBO 
has  met  with  mixed  success.  In  the  writer's 
experience  In  this  regard,  MBO  has  b*en  weak 
bocaiiuu  there  has  been  little  guidance  un  how 
to  select  and  structure  objectives  which  are 
must  significant  to  the  operational  success 
of  the  organization,  ft  Is  believed  that  MBO 
i  sit  be  Improved  by  developing  sn  Integrated 
Itlersicliloal  struct  me  of  objectives  from  the 
lop  .ovn  generally  tot  lowing  the  prueeduto 
oiled  In  Appendix  A.  furthermore,  avwiage.ru 
should  strlye  to  develop  single-valued 
obje  rives  whlilt  relate  all  of  the  advantages 
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jof  the  available  alternatives  to  all  of  the 
disadvantages. 

ZERO  BASED  BUDGETING  (ZBB) 

Fundamental  to  the  ZBB  process  is  the  develop¬ 
ment  of  decision  packages.  Each  budget 
package  which  describes  an  objective  which  is 
expected  to  be  achieved  for  the  exoenditure  or 
the  resources  is  indicated  in  the  package. 

These  packages  are  then  ranked  and  rile  "best" 
combination  aggregated  at  successively  higher 
levels. 

The  discussion  of  this  paper  suggests  that  the 
structuring  of  objectives  with  the  associates 
required  resources  meets  the  requirements  for 
decision  packages  required  by  ZP"..  For  the 
reasons  discussed  herein,  it  13  believed  to  be 
essential  that  the  ZBB  decision  packages  ana 
the  budget  structure  which  support  ZBB  must  be 
developed  by  management  from  the  cop  down  if 
the  decision  packages  are  to  be  compared  on  any 
common  basis  and  are  to  be  rationally  aggre¬ 
gated  flam  the  bottom  up. 

The  above  discussion  has  centered  essentially 
upon  Che  mechanics  of  the  acquisition  process. 
Early  in  the  paper  the  assumption  is  made  that 
"it  is  the  objective  of  each  mnnager,  at  all 
levels  of  the  organization,  to  make  those 
decisions  which  will  result  in  providing  the 
[operating  command  with  the  "best"  weapon 
system..."  One  of  the  primary  challenges 
facing  management  Is  the  motivation  of 
personnel  at  all  levels  to  purrue  individual 
work  objectives  consistent  with  the  overall 
.objectives  of  the  organization.  MBO  deals 
with  Che  issue  by  instituting  the  process  of 
requiring  superiors  to  negotiate  objectives 
with  subordinates.  The  superior  oust  track 
objectives  with  rigor  in  order  to  emphasize 
their  importance  to  subordinates.  The  reward 
structure  (financial  and  otherwise)  of  the 
organization  should  reward  subordinates  in 
relation  to  the  degree  to  which  assigned 
objectives  are  satisfied.  This  is  often 
difficult  under  the  Civil  Service  System. 

Lastly  the  development  of  objectives  by  a 
process  similar  to  that  illustrated  here, 
lends  itself  to  extensive  use  of  computers. 
Managers  should  provide  the  Judgmental 
inputs  and  computers  can  then  provide  the 
mathematical  calcnlvtions. 

SUMMARY 

The  following  paragraphs  list  each  of  the 
principles  or  concepts  emphasized  in  chin 
paper  and  briefly  discuss  the  relationship 
of  each  to  the  manngcmeti*  disciplines  of  OMB 
Bulletin  A-109,  Zero  Based  Budgeting  and/or 
Management  By  Objectives. 

.  The  iMiiliigrmciit  lit  ncqnlsl  tlon  is  u 
hlrrareliir.il  decision  process  which 
generates  Information.  This  broad 
principle  is  applicable  to  all  of  the  three 


management  disci |»1  incs. 
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.  The  prlmury  decisions  mule  i>y  managers  in 
the  acquisition  process  are  chose  required  to 
negotiate  the  objectives  for  the  subsystems 
with  subordinate  managers  which  will  sutlsfy 
the  higher  level  system  need  (objective) 
which  has  been  negotiated  with  his  superior 
from  outside  the  organization  (the  pro¬ 
cedure  by  which  these  objectives  are  achieved 
are  secondary).  Those  hierarchies  of 
objectives  and  subobjeet Ives  are  considered 
to  be  the  essential  i  inks  between  weapon 
system  design  objectives  and  subsystem  design 
objectives  at  each  phase  of  the  acquisition 
process  defined  by  OMB  liulLetln  A- 109. 

.  The  acquisition  process  proceeds  through 
relatively  distinct  Life  cycle  phases  witli 
formal  documents  (..r  contracts)  generated 
during  each  pliase.  This  concept  describes 
the  process  consistent  with  OHil  Bulletin 
A-109/DOD  Directive  5000.1. 

.  Ideally,  all  objectives  should  he  quantita¬ 
tive  and  measurable.  Also  Ideally,  these 
objectives  should  serve  as  a  single-valued 
criterion  by  which  the  decision  maker  ranks 
the  alternatives  available.  In  addition, 
the  criterion  should  relate  all  of  the 
advantages  of  each  available  alternative  to 
all  of  the  disadvantages.  These  principles 
are  equally  applicable  to  MB0  and  the 
objectives  of  decision  packages  developed 
under  7.BB. 

.  The  resources  obtained  from  outside  rhe 
organization  must  match  the  higher  level 
system  need  assignee  'tom  outs.lde  and  must 
be  allocated  cons,  -cut  with  the  objectives 
for  subsystem  objectives  which  are 
negotiated  with  subordinates.  This 
principle  Is  consistent  with  MBO  and  the 
decision  packareu  required  by  ZbU. 

.  An  integrated  and  quantitative  hierarchical 
structure  or  objectives  must  be  developed 
from  the  top  sown.  -  It  ls>  suggested  that 
this  principle  must  upoly  both  to  the 
hierarchical  structure  of  objectives  which  Is 
required  by  MHO  and  the  hierarchical  budget 
structure  required  by  Z!IR  If  theue  processes 
are  to  be  rational  and  effective. 

.  Objectives  should  be  negotiated  between 
superiors  and  subordinates  and  each 
manager's  reward  should  be  related  to  the 
degree  to  which  he  achieves  .the  assigned 
objective. 

C0NCI.USI0NS 

Managing  the  acquisition  of  weapon  systems  in 
the  future  will  be  an  extremely  challenging 
task  for  tha  individual  manager  and  for  our 
nation. 


There  ate  new  management  disciplines  avail¬ 
able  as  well  as  the  technology  of  greatly 
expanded  computers  and  automated  management 
information  systera3  which  can  promote 
improvements  In  the  acquisition  process. 

The  application  of  more  precise  ma.nagemenL 
disciplines  and  advanced  information  systems 
is  limited  by  the  culture  (in  particular',  1 
that  c.f  the  Government  sector)  of  our 
society.  Managers  at  all  levels  are 
challenged  to  build  a  reward  structure  which 
will  align  che  objectives  of  the  individuals 
wlLli  those  of  the  organizations  in  which 
they  work.  Changes  in  reward  systems  which 
will  motivate  all  Individuals  to  move  to 
emphasize  che  following  ure  believed, 
necessary : 

.  Top  management  concentration  on  "cop  down" 
developed  objectives  and  constraints  rather 
than  detailed  procedures. 

.  Management  concern  wit!)  no  more  detail  than 
is  necessary  to  manage  the  objectives  assigned 
at  eacli  appropriate  level  (much  less  micro- 
management). 

,  Resources  allocated  in  direct  support  of 
objectives  at  all  levels  with  the  appropriate 
supporting  accounting  structure. 

,  Rigorous  tracking  of  accomplishment  and  1 
expenditures  against  objectives. 
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TAUI.E  I  -  CHARACTERISTICS  OF  SUUSYSTB1S 


AIRFRAHE  A 


AIRFRAME  B 


Est. 

Est. 

Expected 

Est. 

list. 

Expected 

Value 

Risk 

Value 

Value 

Risk 

Value 

Ave.  Cruise  Velocity  (knots) 

500 

0 

500 

550 

.01 

544.5 

Effective  Lift-Drag  Ratio  (Dimension- 

less) 

15 

0 

15 

16 

.01 

15.84 

Airframe  Height  (lbs.) 

15,000 

0 

15,000 

14,000 

.03 

14,432 

Airframe  Failure  Rate  (Fallure/Flt 

Hr) 

1.0 

.03 

1.03 

0.7 

.10 

0.777  ' 

Airframe  Mean  Time  to  Repair  (Hrs) 

10.0 

.02 

10.2 

8.0 

.04 

8.33 

Airframe  Overhaul  Interval  (lira) 

500 

.02 

490 

600 

.08 

552 

Ave.  Mission  Time  (Hrs) 

6 

0 

6 

5.45 

.02 

5.56 

Airframe  RAD  Costs  ($  Millions) 

0 

0 

0 

300 

.10 

333 

Airframe  Investment  Costs  ($  Millions) 

500 

.05 

526 

700 

.08 

760 

Airframe  Oper  A  Sup  Costs  ($  Millions) 

2,350 

.08 

2,554 

2,500 

.12 

2,841 

Air frame  Initial  ILS  Costs  ($  Mill.) 

0 

0 

0 

350 

.08 

380 

PROPULSION  SYSTEM  1 

PROPULSION  SYSTEM  2 

Eat. 

Eat. 

Expected 

Est. 

Eat. 

Expected 

Value 

Risk 

Value 

Value 

Risk 

Value 

Engine  Efficiency  (Dimensionless) 

0.28 

0 

.28 

0.32 

.05 

0.306  ' 

Engine  Height  (lbs.) 

2,800 

0 

2,800 

2.200 

.02 

2,244 

Engine  Failure  Rate  (Failure/Fit  Hr) 

0.2 

.02 

0.204 

0.15 

.08 

0.163 

Engine  Mean  Time  to  Repair  (Hrs) 

5.0 

.01 

5.05 

8.0 

.03 

8.247 

Engine  Overhaul  Interval  (lira) 

500 

.03 

485 

1,000 

.10 

900 

Engine  RAD  Costs  (5  Millions) 

0 

0 

0 

250 

.10 

278 

Engine  Investment  Costs  ($  Millions) 

200 

.04 

208 

350 

.06 

372 

Engine  Oper  A  Sup  Costs  ($  Millions) 

800 

.06 

851 

SOO 

.10 

1,000 

Engine  Initial  ILS  Coses  ($  Millions) 

0 

0 

0 

280 

.06 

298 

TABU  II  -  VARIABLES  USED  TO  CALCULATE  SYSTEM  PARAMETERS 


SYSTEM  PARAMETERS 
Puyload 


Average  cruise  velocity 
Operational  Readiness' 


Probability  of  mission  success 

Research  and  Development  Costs 
Investment  costs 

Total  operation  and  support  costs 


VALUABLES  (FROM  TABLE  I) 

Engine  efficiency 
Effective  lift— drag  ratio 
Airframe  weight 
Engine  weight 

(Assumed) 

Airframe  failure  rate 
Engine  failure  rate 
Airframe  mean  time  to  repair 
Engine  mean  time  to  repair 
Airframe  overhaul ‘interval 
Engine  overhaul- interval 

Airframe  failure  rate 
Engine  failure  rate 
Average  mission  time 

Airframe  RID  costs 
EnRlne  RAD  costs 

Alrfrsse  Investment  costs 
Engine  Investment  costs 

Initial  airframe  ILS  coats 
Initial  engine  ILS  costs 
Airframe  operation  and  support  costs 
Engine  operation  and  support  coats 
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TABLE  III  -  CHARACTERISTICS  OF  SUBSYSTEM  COMBINATIONS 


EXPECTED  VALUES 


SUBSYSTEM 

COMBINATION 

PAYLOAD 

(LBS) 

AVE.  CRUISE 
VELOCITY 
(KNOTS) 

OPERATIONAL 

READINESS 

(PERCENT) 

A-l 

17,100 

500.0 

69.3 

A-2 

17,653 

500.0 

68.4 

B-l 

18,420 

544.5 

73.6 

B-2 

18,882 

544.5 

74.6 

TABLE  IV  -  EFFECTIVENESS  AND  COST 

SUBSYSTEM 

COMBINATIONS 

-  EFFECTIVENESS 
(lb-N. Miles /Hr) 

A-l 

542,430,500 

A-2 

563,098,700 

B-l 

683,560,200 

B-2 

727,674,300 

PROS.  OF  MISSION  R&D  INVEST.  TOTAL  OPER. 
SUCCESS  COSTS  COSTS  &  SUPT.  COSTS 

(PERCENT)  ($H)  ($M)  ($H) 


90.5 

0 

734 

3,404 

87.5 

278 

898 

3,852 

92.6 

333 

968 

4,072 

89.5 

611 

1,132 

4,519 

OF  SUBSYSTEM  COMBINATIONS 

LIFE  CYCLE  COST 

.  .JKHL _ 

4.138 

5,028 

5,373 

6,262 
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APPENDIX  A 


0  -  M  -  C 
Whore: 

C  -  Net  Military  Gain  ($) 

M  “  Military  Worth  ($) 

C  «  Life  Cycle  Cost  ($) 

K  -  f  E 
ia 

Where: 

f  *=  A  function  which  relates  ollltary 
effectiveness  to  military  worth 
($/lb.-n. mile/hr.) 

E  «  Military  effectiveness  (lb.-n.mlle/hr.) 
E  -  WpxVc0RxSoxNa 
Where: 

Wp  *■  Payload  (lbs.) 

Vc  •*  Average  cruise  velocity  (knots) 

OF.  ■  Operational  readiness  (dimensionless) 

S<,  »  Probability  of  mission  success 
(d Irene ionless) 

!Ja  »  Number  of  aircraft  (dimensionless) 


2( 7X8  he  L/D 


Where: 

W  »  Aircraft  takeoff  gross  weight  (50,000 
lbs.  used  for  thi3  example) 

K  •  Aircraft  tonge  (3,600  n.  miles  used  in 
this  example,  which  is  greater  than  the 
requirement  of  3  000  n. miles  to  allow 
for  war*  up  cl'  ,  reserve,  etc.) 

h  *>  Energy  content  of  the  fuel  (2,400  n. 
mile  -  103/ lb.  used  for  this  example) 

e  «  Engine  efficiency  (dimensionless) 

L/D  ■  Effective  aircraft  lift-drag  ratio 
(dimensionless) 

Vn  -  Airframe  weight  (lba.) 

We  -  Engine  weight  (lbs.) 

or  -  i  -  ?,  (efiJl  +  fwn  +  f3txKrrR,xFH) 

T 


-F*  (fse  +  fwe  +  £34*™*****) 

T 

-  f  /FH  ,  _  f  ,FH  , 
loa  (r — )  ‘oe  fc — ) 

oa  oe 

Where: 

Fa  -  Airframe  failure  rate  (fallures/Flight 
hour) 

fga  «  A  function  which  relates  the  not 

operationally  ready  rat''  due  to  supply 
(NORSa)  of  the  airframe  to  the  air¬ 
frame  failure  rate. 

(NORSa^  (0.20  used  for  this  example) 

Fa 

£  “  A  function  which  relates  the  airframe 

awaiting  maintenance  rate  (AWSa)  to  the 
airframe  failure  rate  (AWSa) 

Fa 

(0.005  used  for  this  example) 

f3a  -  *  function  which  relates  the  airframe 
downing  event  rate  to  the  airframe 
failure  rute  (DEa  ) 

FHxFa 

(0.10  used  for  this  example) 

MTTR3  ■  Meantime  to  repair  the  airframe 
(hours) 

T  Total  aircraft  lifetime  (hours) 

(175,200  used  In  this  example) 

foa  ■»  A  function  which  relates  the  not 
operationally  ready  rate  due  to 
scheduled  maintenance  of  Che  airframe 
to  the  number  of  scheduled  overhauls 
.NORMS (P)a  s 
'no  overhauls' 

(0.001  used  for  this  example) 

coa  "  Scheduled  overhaul  Interval  for  the 
airframe  (hours) 

! 

Ne  «  Number  of  engines  per  airframe  (two  for 
this  example) 

FH  «  Aircraft  lifetime  flight  hours 
:  (7,200  for  this  example) 

Fc  »  Engine  failure  race  (failurcs/flight 
hour) 

fse  A  function  which  relates  the  not 

operationally  ready  rate  uue  to  supply 
(NORSc)  of  the  engine  to  the  engine 
failure  rate  ?NORSe\ 

(0.18  used  for  this  example) 


M 


fwe  -  A  function  which  relates  the  engine 

awaiting  maintenance  rate  (AWSe)  to  the 
engine  failure  rate  (AW Sej 
^  *' 

(0.005  used  for  this  example) 

^3e  *  function  which  relates  the  engine 
downing  event  rate  to  the  engine 
failure  rate  ,DEe  . 

lFHxF,/ 

(0.15  used  for  this  example) 

f  »  A  function  which  relates  the  not 
oe 

operationally  ready  rate  due  to 
scheduled  maintenance  of  the  engine 
to  the  number  of  scheduled 

overhauls  .NOSMS (P)e , 

'No  overhauls'' 

(0.001  used  for  this  example) 

KTTKe  *  Mean  time  to  repair  the  engine 
(hours) 

^la  ^at 


^2e  Fet  *"  ^la  Fa^  ***  ^ 


1  -  f2a  P.t  -  he 

„  fle  V 

fle  Fec  Ne  +  1 


fla  ■  A  function  which  relates  the  airframe 
caused  deck  abort  rate  to  the  air¬ 


frame  failure  rate 


Fj  x  FH; 


(0.01  used  for  this  example) 

f2a  “  A  function  which  relates  the  engine 
caused  flight  abort  rate  to  the 
engine  failure  rate  .  PAp  ■, 
x  rll 

(0.002  used  for  this  example 

fle  *  A  function  which  relates  the  engine 
caused  deck  abort  rate  to  the  engine 
failure  rate  (  DAe  y 

(0.008  used  foretl\iB^ example) 

fja  "  A  function  which  relates  the  engine 
caused  flight  abort  rate  to  the 
engine  failure  rate  (  FAe  \ 

Fe  x  FH 

(0.002  used  for  this  example) 
t  *  Average  mission  time  (hours) 

“  He  +  CI.  +  C0.  +  CL«  +  He  +  <=Le  +  CQe 


Cj^  «  Total  airframe  peculiar  research  and 
development  coats  ($) 


Cja  •  Total  airframe  investment  costs  for 
all  production  unltR  ($) 

C.j  -  Trtlal  airframe  operni  ton  and  support 
cost,  m 

C^a  ■  Total  Initial  airframe  logistic 
procurement  and  support  costs  ($) 

Cge  ■  Total  engine  peculiar  research  and 
development  costs  ($) 

Cje  *»  Total  engine  investment  costs  for 
all  production  units  (Including 
complete  spare  engines)  ($) 

C0u  ■  Total  engine  operation  and  support 
costs  ($) 

CLe  «  Total  initial  engine  logistic 

procurement  and  support  costs  ($) 

The  above  example  assumes  that  each  aircraft 
system  can  use  either  propulsion  system  and 
still  achieve  the  performance  quoted  for  the 
airframe. 
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A  NEW  CONTROL  SYSTEM  FOR  ARMY  PROCUREMENT  APPROPRIATIONS: 
LOOKING  FORWARD  IN  FINANCIAL  MANAGEMENT 

Lt.  Col.  Steven  G.  West,  United  States  Army 
Program  Manager,  Army  Program  and  Fund  Control  System 
Office,  Comptroller  of  the  Airay 
Washington,  D.C. 


INTRODUCTION 


Changing  an  entrenched  accounting  and 
financial  management  system  that  handles  over 
$20  , illion  annually  called  for  some  hard 
questions  ro  be  asked.  Coming  up  with  the 
answers  w-<  an  even  greater  challenge. 


Over  Che  past  several  years,  financial 
management  requirements  for  the  Array  have 
undergone  major  changes,  especially  in  the 
area  of  procurement  appropriations.  Unfortu¬ 
nately,  these  changes  led  to  major  problems 
for  the  existing  accounting  systems,  fund 
control  procedures,  and  management  informa¬ 
tion  reports  and  procedures. 

The  accounting  systems  in  1970  were  designed 
to  manage  a  single  procurement  appropriation 
for  the  Array.  A  comparatively  small  amount  of 
reimbursable  accounting  wa3  required  for 
other  customers,  such  as  the  Air  Force, 

Marine  Corp3,  and  Foreign  Military  Sales.  Then 
In  mid-fiscal  year  1971,  Congress  changed  the 
accounting  structure  from  one  appropriation  to 
five  separate  procurement  appropriations.  This 
was  done  primarily  to  gain  better  control  and 
visibility  over  the  procurement  program. 

But  there  wore  major  ramifications.  The  new 
appropriations  could  only  be  used  for  obliga¬ 
tion  of  the  approved  funds  for  three  years 
and  for  expenditures  for  two  additional  years. 
Each  year  five  more  appropriations  were 
approved  by  Congress.  Attempts  to  adapt  the 
existing  Army  accounting  system  to  this 
drastically  changed  environment  proved  inade¬ 
quate.  In  1975,  at  the  end  of  the  obligation 
and  expenditure  life  of  “he  1971  appropria¬ 
tions,  a  series  of  vlo"  ions  of  law  (Revised 
Statute  3679  -  Anti-'V).  eiency  Act)  was  dis¬ 
covered.  Overallocation  of  funds,  lack  of 
adequate  accounting  control,  overobligations, 
and  unreconcilable  records  were  identified. 

The  expansion  of  Foreign  Military  Sales  during 
this  seme  period  (1971  through  1975)  further 
complicated  the  management  problem.  The  FMS 
program  grew  to  a  magnitude  almost  equal  to 
the  congres3lonally  approved  program  for  the 
Army's  needs.  The  procurement  appropriation 
accounting  system  could  neither  effectively 
manage  the  volume,  nor  provide  the  essential 
FMS  management  data  such  as  contract  account¬ 
ing  and  case  control.  An  attempt  was  made  to 
rely  on  the  logistics  system  to  control  FMS 


financial  resources,  but  It  lacked  adequate 
control:,  ind  accounting  discipline. 

As  a  result  of  the  accounting  system's  weak¬ 
nesses,  meaningful  management  information  de¬ 
picting  the  growth  of  the  problem  could  not 
be  produced.  This  void  was  directly  compounded 
by  the  basic  inadequacies  in  the  financial 
systems  and  the  fact  that  the  Army-level 
management  information  system  had  not  been 
fully  implemented. 

Manually  updated  ledgers,  used  to  record  and 
control  program  and  fund  authorization,  were 
until  recently  the  prime  management  tool. 
Although  fund  authorization  data  were  often 
fed  into  partially  automated  accounting 
ledger  systems,  there  were  inadequate  controls, 
lack  of  effective  reconciliations,  and  inade¬ 
quate  and  outdated  management  reports.  Balances 
for  the  same  appropriation  status  differed 
between  Department  of  Army,  major  Array  com¬ 
mands,  and  the  Army  Finance  and  Accounting 
Center.  This  resulted  in  a  continual  dispute 
over  the  accuracy  and  reliability  of  fund 
data. 

When  the  full  magnitude  of  the  violations  was 
recognized  in  1975,  investigations  and  special 
studies  identified  many  specific  problems. 

The  Army  undertook  an  extensive  corrective 
action  program  to  prevent  recurrence,  but  the 
basic  financial  management  system  was  not 
changed.  Additional  violations  merely  high¬ 
lighted  the  necessity  for  a  basic  reevaluation 
of  system  needs.  The  decision  in  October  1976 
to  design  and  implement  a  new  system  that 
could  help  solve  the  basic  problems  and  gain 
formal  General  Accounting  Office  approval 
within  one  year  obviously  represented  a  major 
challenge. 

Twenty-five  separate  procurement  appropriations 
comprising  thousands  of  procurement  items  for 
support  of  the  Army  must  be  managed  on  a 
detailed  basis.  In  addition,  the  Foreign 
Military  Sales  program  must  be  managed  as  a 
part  of  each  appropriation.  In  many  cases, 
the  FMS  program  was  actuall,  greater  than  the 
Army's  program  in  total  value  and  qv  ntity  of 
material.  The  result  was  the  requirement  to 
manage  50  separate  programs  with  a  total  value 
exceeding  $20  billion. 

The  existing  financial  systems  provided 
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neither  adequate  control  of  FMS  cases  nor 
adequate  management  Information  to  establish 
financial  control  over  the  appropriations. 
Despite  an  extensive  effort  to  Improve  the 
existing  automated  and  manual  procedure*  and 
records,  basic  weaknesses  remained  that  were 
beyond  the  capability  of  the  old  systems  to 
correct;  for  example,  positive  controls  did 
not  exist  to  prevent  release  or  utilization  of 
more  authority  than  was  authorized.  The  fact 
that  major  program  and  fund  managers  had 
different  figures  after  this  significant 
effort  to  improve  management  and  control  fur¬ 
ther  Indicated  a  need  for  reassessment.  It  was 
concluded  that  the  needs  of  the  Army  were  to: 

-  Establish  essential  financial  control  over 
appropriations  to  prevent  violations  of  law. 

-  Maintain  the  current  appropriation  status. 

-  Establish  one  set  of  official  records  use- 
able  by  all. 

-  Improve  the  timeliness  and  accuracy  of 
financial  information. 

-  Expedite  the  provision  of  resources  to  the 
levels  executing  the  program. 

-  Simplify  the  overall  management  process. 

•  Implement  a  responsive  system. 

These  specific  objectives  were  crystallized 
via  a  90-day,  Execut ive- love 1  management 
study  directed  by  the  Secretary  of  the  Army 
and  conducted  a  Blue  Ribbon  civilian 
advisory  group  known  as  the  Financial  Manage¬ 
ment  Advisory  Conmlttee.  Their  report  was 
accepted  by  the  Secretary  of  the  Army  in  June 
1976,  and  a  high-level  implementation  steering 
group  was  formed  immediately.  Chaired  by  the 
Under  Secretary  of  the  Army,  this  group  was 
chartered  to  ensure  that  strong,  positive 
actions  were  taken.  The  Implementation  of  a 
new  program  and  fund  control  system  for  Depart¬ 
ment  of  the  Army  headquarters  was  a  specific 
objective  established  by  tha  steering  group. 

Rapid  implementation  of  the  new  system 
necessitated  a  critical-path  management 
process.  Planning,  design,  coordination,  and 
implementation  were  conducted  simultaneously, 
with  the  basic  objectives  as  the  guide.  How¬ 
ever,  detailed  planning  and  documentation 
could  not  be  slighted  since  the  U.S.  Army 
Audit  Agency  was  to  be  requested  to  conduct  a 
real-time  audit  of  the  effort,  and  the  designs 
were  to  be  formally  submitted  to  the  General 
Accounting  Office  for  system  approval  during 
the  design  and  implementation  process. 

A  WORKABLE  CONCEPT 

Brainstorming  by  staff  and  systems  personnel 
led  to  the  realisation  that  a  real-time  data 


base  management  system  was  required.  This 
would  involve  tying  the  major  Army  Staff  ele¬ 
ments  Involved  in  the  management  process 
together  with  major  Army  coinaandB,  subordinate 
contaands,  and  the  central  accounting  centers. 

A  preliminary  design  concept,  stated  in  a 
management  requirements  paper,  ••'«»  Chon  devel¬ 
oped.  It  specifically  defined  whut  program 
and  fund  actions  would  be  managed;  the  controls 
to  be  imposed  by  the  system;  and  that  all  in¬ 
puts  and  moat  outputs  would  be  managed  through 
the  communication  terminals  operated  by  each 
system  user.  From  its  inception,  the  system 
was  to  become  a  management  control  process 
more  so  than  a  management  information  system. 

The  fact  that  the  Army  did  not  have  the 
computer  capability  to  support  such  a  state- 
of-the-art  systemization  led  to  the  decision 
to  implement  the  system  using  contractor 
support  until  in-house  capabilities  were 
available.  Contractor  support  was  used  to 
refine  the  detailed  design  of  the  system,  to 
perform  the  necessary  programming,  and  to 
support  the  operational  system  when  implement¬ 
ed,  The  contractor  was  not  to  determine  what 
was  needed,  but  was  to  accomplish  technical 
support  and  programing  and  act  as  the  com¬ 
puter  expert  upon  system  implementation. 

The  overall  system  initiative  for  the  procure¬ 
ment  appropriations  involves  the  three  major 
phases  in  Figure  1. 


Fipirt  1.  Tht  Tkm  Ph  tut  of  flu  Syittm  Imtutw* 


Pluw  I:  Proptm  and  fund  control  ,t  Psm«i  of  tl» 

Amy  hudquirurt  and  to  major  Army  command). 


Phau  II:  Extant ic.i  of  tha  propam  and  fund 

minajnmtn:  ryttam  at  a  managamant  tool 
within  major  Army  commandi  and  to  tha 
executing  I tvtll. 


Phata  111:  Financial  control  of  tha  Amy  Cuttomar  Ordar  Program. 


Because  the  system  would  function  as  s  manage¬ 
ment  control  tool  at  various  levels,  each 
organization's  requirements  were  separately  ad¬ 
dressed  and  integrated  to  meet  the  basic  objec¬ 
tives.  Ensuring  significant  managerial  benefits 
at  each  syatem  level  added  to  the  complexity, 
since  the  syatem  was  rot  to  become  solely  a 
management  information  source  for  Department 
of  the  Army.  The  organization*  involved  and 
their  locations  are  reflected  in  Figure  2, 
while  the  operating  concept  is  reflected  in 


Figure  3.  The  number  of  involved  organiza¬ 
tions  and  their  geographic  diversity  indicate 
the  magnitude  of  the  coordination  and  planning 
taskn. 
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The  system  integrates  the  entire  program  and 
fund  release  process,  from  the  congressional 
authorization  of  procurement  appropriation 
items,  through  Department  of  Defense  program 
release  actions,  through  Department  of  Army 
releases,  through  the  major  command  actions, 
and  to  the  executing  levels.  All  involved  have 
total  real-time  visibility  of  actions  affect¬ 
ing  them.  In  terms  of  processing  times,  high- 
priority  items  can  be  totally  released  to  an 
executing  agency  in  less  than  an  hour}  under 
the  previous  system,  It  took  more  than  a  week. 
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The  Phase  I  system  was  fully  Implemented  on 
May  20,  1977.  It  was  designated  the  official 
Arm-  record,  and  all  fund  and  program  changes 
aro  being  processed  through  the  system.  This 
virtually  eliminated  the  need  for  reconcilia¬ 
tions  among  manual  records  and  reduced  the 


necessity  for  generating  numerous  and  differing 
status  reports  at  each  level.  In  addition,  it 
eliminated  the  need  for  extensive  telephonic 
coordination  to  determine  the  status  of  actions 
taken  at  different  organizational  levels, 
since  each  user  can  obtain  this  information  at 
his  terminal.  An  immediate  answer  is  provided. 

Since  the  system  functions  as  a  part  of  the 
total  Army  financial  system,  a  system  transac¬ 
tion  automatically  generates  taped  interfaces 
to  other  financial  systems  (at  the  Logistics 
System  Support  Agency  and  the  Array  Finance 
~'d  Accounting  Renter)  through  AUTODIN.  Thi3 
effects  iw„or  savings  in  terms  of  document 
processing  time  and  review,  elimination  of 
reference  ledger  systems,  ’.c-vpur.ching,  and 
verification  of  data  Inputs. 

Although  savings  and  significant  improvements 
have  been  and  will  be  realized  when  full 
implementation  of  all  phases  is  complete,  the 
basic  justification  for  the  system  was  always 
to  provide  improved  financial  control  and 
accurate  information  for  analysts  and  decision 
makers.  Many  analysts  previously  involved  in 
routine  bookkeeping  functions  are  now  able  to 
devote  their  time  to  analysis  Instead.  Phases 
II  and  HI  are  presently  scheduled  to  be  test¬ 
ed  and  implemented  in  March  1978.  Due  to 
their  scope,  their  implementation  will  be 
phased  to  allow  earlier  use  of  high-priority 
modules  as  they  are  tested  and  integrated  into 
the  system. 

"On-line"  refers  to  the  fact  that  system  users 
(budget  and  financial  analysts)  have  direct 
access  to  the  central  processing  unit  at  all 
times,  either  for  data  input  or  file  inquiry. 
To  ensure  security  and  control,  the  system 
limits  access  by  controlling  which  users  are 
allowed  to  perform  certain  functions,  and  by 
requiring  a  combination  of  password  and  user 
access  identifiers.  This  is  in  contrast  to  a 
"batch"  system  method  of  periodic  bulk  pro¬ 
cessing  in  which  similar  financial  transac¬ 
tions  are  stock-piled  in  punch  card  form  to 
be  run  through  a  computer  as  a  group  either 
daily,  weekly,  or  monthly,  as  is  done  in  all 
other  Army-level  financial  systems. 

The  main  advantages  of  direct  and  continued 
access  to  the  co- "uter  is  that  it  permits 
Immediate  updatl  g  of  files.  Thus,  the  system 
can  compare  desired  input  to  the  current 
status  of  a  financial  item.  If  the  transac¬ 
tion  is  acceptable,  it  is  approved.  If  an 
action  could  violate  internal  system  control, 
the  transaction  is  disapproved  and  the 
requester  is  notified  Immediately.  In  other 
words,  the  Army is  procurement  spprdpristions 
program,  fund  authorization,  and  allocation 
files  should  always  be  current,  „..abling 
management  personnel  to  obtain  up-to-date 
Information  by  8imply  pushing  a  few  keys  on 
the  system  communication  terminal. 
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A  REPRESENTATIVE  ACTION 

When  the  program  manager  decides  to  release  an 
item  to  a  major  command  so  that  it  can,  for 
instance,  initiate  the  procurement  of  tanks, 
the  authorized  analyst  enters  the  system  and 
requests  release  of  the  tanks.  The  system  veri¬ 
fies  that  the  congressional  authorization  has 
been  entered  for  the  tanks.  It  verifies  that 
the  Defense  Department  has  released  the  program 
and  that  unallocated  funds  are  available.  It 
verifies  that  no  congressional  limitations 
exist,  and  it  performs  many  other  checks.  These 
automatic  controls  are  the  heart  of  the  system 
and  differentiate  it  from  batch-related  manage¬ 
ment  information  systems. 

If  all  controls  are  met,  the  program  release 
request  is  passed  through  the  system  to  the 
Comptroller  of  the  Army's  office,  where  checks 
are  performed  and  funds  are  released  by  enter¬ 
ing  the  approval  into  the  system.  After  approv¬ 
al,  files  are  automatically  updated,  the 
release  is  immediately  provided  to  the  major 
commands,  and  the  action  is  posted  to  a  tape 
file.  The  file  is  passed  through  AUTODIN  to  the 
Army  Finance  and  Accounting  Center  and  the 
Logistics  System  Support  Agency,  which  maintain 
the  overall  accounting  systems  and  presently 
accumulate  the  financial  data  with  regard  to 
executing  the  approved  items  (such  as  obliga¬ 
tions  and  disbursements).  These  Interfaces 
feed  the  systems  that  produce  the  Army's 
official  financial  reports. 

Upon  receipt  of  the  release  (after  Phase  II  has 
been  Implemented),  the  major  command  will 
effect  a  similar  release  process  through  the 
communication  terminal  at  their  headquarters. 
The  approved  action  is  transmitted  to  the 
executing  agency's  communication  terminal;  they 
then  have  the  authority  to  initiate  obligation 
and  procurement  of  the  item.  Financial  files 
will  be  updated  through  AUTODIN  tape,  and  any 
system  user  can  check  the  exact  status  of  the 
action  while  it  is  being  processed. 

IMPIEMENTATION  UNIQUE 

Many  organizations  were  involved  in  implement¬ 
ing  the  system;  consequently,  a  unique  manage¬ 
ment  process  was  required.  The  project  officer 
worked  simultaneously  for  the  program  director 
in  developing  the  program  management  process; 
the  Comptroller  of  the  Army  in  establishing  the 
financial  management  policy  and  procedures;  and 
major  commanders  in  executing  agency  policy  and 
procedures.  Also,  such  factors  as  management  of 
the  contract  process,  training,  implementation 
planning,  system  documentation,  system  mainte¬ 
nance,  acceptance  testing,  parallel  testing, 
and  preparation  of  GAD  submission  required 
coordination  at  every  level. 

Initial  development  was  accomplished  under  the 
Director  of  Army  Budget.  When  the  Army  head¬ 
quarters  system  was  implemented  in  May  1977, 


the  basic  system  direction  was  (isusud  to  Lh» 
Director  of  Finance  and  Accounting,  since  the 
system  became  an  operating  accounting  system. 

The  Phase  I  system  has  proven  to  be  highly 
reliable  and  easy  to  use.  This  useability  di¬ 
rectly  resulted  from  a  careful  evaluation  of 
user  requirements  and  from  ensuring  that  the 
system  would  simplify  the  management  process 
at  each  user  level.  This  required  thut  atten-  ■ 
tion  be  directed  not  only  to  solving  the  major 
long-range  problems,  but  also  to  the  highly 
specific  needs  of  each  using  organization. 

Changing  policy  as  well  as  the  method  of  opera¬ 
tion  required  a  special  management  effort.  Many 
managers  have  been  victimized  by  their  own 
well-intended  modernization  efforts,  only  to 
be  overwhelmed  by  expensive  electronic  gadgetry 
and  complex  computer  outputs.  This  danger  was 
an  ever-present  concern.  The  first  phase, 
although  rushed  to  successful  completion, 
pointed  out  the  necessity  for  a  carefully 
staged  expansion  of  the  system  to  make  certain 
that  the  highly  sophisticated  automatic  data 
processing  system  would  fully  accomplish  all 
of  its  objectives  when  completely  Implemented. 
The  need  was  to  concentrate  on  people  rather 
than  computers  or  systems,  Introducing  them  to 
various  degrees  of  modernization  one  step  at  a 
time. 

RESULTS  AND  THEIR  EFFECT 

Simultaneous  design,  coordination,  develop¬ 
ment,  and  implementation  was  and  remains  a 
formidable  task.  The  need  for  continuous 
planning  was  required  just  to  keep  up  with 
changes  and  new  requirements.  The  faster  the 
implementation,  the  greater  the  potential  for 
a  critical  oversight;  but  the  analysts, 
accountants,  and  systems  people  are  adapting 
well  to  the  rapid  rate  of  change,  and  have 
made  a  success  of  the  first  phase  of  the 
implementation  effort. 

Ernst  and  Ernst,  certified  public  accountants 
and  management  consultants,  evaluated  the 
Phase  I  system.  They  recommended  expansion  of 
the  approach  to  other  Army  appropriations,  as 
well  as  rapid  Implementation  of  defined  follow- 
on  phases.  This  appraisal  was  corroborated  by 
the  U.S.  Army  Audit  Agency  evaluation  of  the 
basic  system,  which  concluded  that  the  system 
possesses  the  integrity  needed  to  preclude  the 
Department  of  the  Army-level  problems  previ¬ 
ously  experienced  in  the  Army's  procurement 
appropriations . 

The  lessons  which  have  been  learned  and  are 
being  evaluated  for  wider  impact  are  as 
follows: 

-  The  Army  ahould  pattern  its  new  financial 
system  to  match  its  needs,  xat'.er  than  be  a 
slave  to  contlnusl  modiflcatl >n  of  existing, 
outdated  card-based  systems. 


-  Cord-based  systems  are  not  capable  of  effect¬ 
ing  Internal  system  control. 

-  Any  major  changes  to  existing  systems  should 
be  carefully  evaluated  prior  to  expending 
resources  for  modifications  that  might  result 
in  limited  benefits. 

•  Computer  functions  must  be  distributed  away 
from  central  sites  and  out  from  under  the 
direct  control  of  ADP  centers. 

-  Executive-level  support  throughout  the 
development  of  a  new  system  is  essential  to 
maintaining  the  initiative  and  reinforcing  the 
organizational  commitment  to  change. 

-  Cor tin, 'el  ommunicatlon  of  progress,  problems, 
and  actions  unoer  way  is  essential  to  ensure 
user  understanding  and  involvement  in  the  sys¬ 
tem  development,  implementation,  and  use.  Sys¬ 
tems  are  developed  with  people,  not  for  them. 

-  System  tuning  after  initial  implementation 
can  be  as  critical  to  long-range  success  as 
any  step  in  the  process. 

-  Contractor  support  to  Implement  a  sy.'  tom  can 
be  an  excellent  tool  if  strong  performance 
objectives  are  established  and  pursued. 

This  system  approach  i3  the  trend  the  Army  is 
taking  for  its  financial  systems  development 
in  view  of  new  technology  and  system  capabili¬ 
ties.  Financial  managers  must  look  Co  the 
future,  learn  to  manage  the  development  of  new 
systems,  and  accept  the  challenge*  that  will 
result. 
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HOW  FAR  IS  THE  GOVERNMENT  WILLING  TO  GO  TOWARD  REDUCING  LIFE  CVCLE  COST  OF  MILITARY  WEAPON  SYSTEMS? 
J.  F.  Drake,  Corporate  Director,  Advanced  Program  Plans,  Hughes  Aircraft  Company 


I.  INTRODUCTION 


II.  DEVELOPMENT 


The  Department  of  Defense  has  new  opportunities 
related  to  the  acquisition  of  avionics  equip¬ 
ment  and  systems.  Solid  state  devices,  digital 
micro-electronic  circuitry,  cryogenic  devices, 
fiber  optics  and  other  technological  achieve¬ 
ments  available  to  industry  have  dramatically 
improved  the  reliability  of  avionics  systems 
and  promise  even  more  significant  advances  in 
their  near  term  application. 

As  a  result,  mission  reliability  is  signifi¬ 
cantly  improved.  Current  weapons  and  systems 
can  withstand  the  packaging,  shipping,  handling, 
loading,  storage  and  captive  flight  environ¬ 
ment  and  still  deliver  on  target  using  conven¬ 
tional  operating  crews.  Further  technological 
advances  can  only  improve  the  existing  high 
mission  reliability. 

These  same  improvements  reduce  weight,  volume 
and  power  requirements  and  permit  operation 
with  reduced  and/or  no  requirement  for  liquid 
coolants  or  hydraulic  fluids.  These  factors 
combine  with  reliability  to  reduce  the  mal¬ 
function  rates.  Therefore,  maintenance  is 
reduced,  and  it  is  the  driving  function  which 
establishes  the  peoples  and  materials  neces¬ 
sary  to  sustain  mission  success. 

The  combination  of  improved  reliability  and 
decreased  maintenance  permits  concepts  of 
operation  that  offer  maximum  readiness  at  mini¬ 
mum  operating  and  support  (OAS)  costs.  Thus, 
beneficial  changes  in  all  phases  of  the  acqui¬ 
sition  process  for  avionics  equipment  should  be 
achievable,  but  not  without  change  to  existing 
government  policy  and  procedures.  The  changes 
will  require  doing  a  better  job  of  planning; 
breaking  with  tradition;  and  halting  the  growth 
of  and/or  reducing  the  ever  Increasing  govern¬ 
ment  payroll. 

The  question  really  is  "how  far  is  the  govern¬ 
ment  willing  to  go  In  reducing  the  life  cycle 
coats  oF  military  weapon  systems?'1  This  is  a 
critical  question  If  we  are  to  maintain  a 
strong  defense  posture  within  the  financial 
limitations  Imposed  by  the  President  and  Con¬ 
gress.  If  the  answer  Is  to  maximize  our 
defense  capability  within  the  dollars  avail¬ 
able,  then  the  theme  of  this  conference,  "Work¬ 
ing  Tomorrow' 8  Procurement  and  Acquisition 
System  Today,"  la  appropriate.  Tine  will  be 
required  for  the  changes  that  I  propose.  Some 
are  within  the  authority  of  various  levels  of 
DOD  but  lack  a  consensus.  Others  need  Congres¬ 
sional  approval.  Some  may  have  substantial 
political  implications.  All  will  add  credibil¬ 
ity  to  the  advertised  DOD  policy. 


1.  0MB  Circular  A-109  —  the  Key 
Is  Flexibility 


0MB  Circular  A-109  establishes  the  policy  to  be 
followed  by  executive  agencies  in  the  acquisi¬ 
tion  of  major  systems.  It  is  the  current  end 
point  in  the  evolution  of  weapons  system  acqui¬ 
sition.  It  is  a  process  based  on  mission  need 
that  brings  cost  and  risk  into  focus  through  a 
series  of  high  visibility  reviews  conducted  at 
the  completion  of  scheduled  periods  of  activ¬ 
ity.  On  the  positive  side,  the  process  pro¬ 
vides  a  method  to  achieve  performance  goals, 
reduce  costs  and  avoid  risk.  On  the  negative 
side,  it  may  Increase  cost  by  increasing  the 
length  of  the  acquisition  cycle,  adding  more 
people  to  the  decision  making  process,  and 
increasing  the  tendency  to  over  control. 

With  flexibility  properly  utilized,  the  acqui¬ 
sition  process  can  improve  our  defense  posture 
and  provide  a  basis  for  getting  more  for  our 
dollar.  To  do  so  requires  that  we  again  evalu¬ 
ate  the  overall  process  to  highlight  recommen¬ 
dations  that  could  result  in  cost  savings  and 
increased  readiness  —  or  at  least  no  readiness 
degradation.  Many  of  these  have  been  empha¬ 
sized  before  and  while  some  have  already  been 
implemented,  their  Importance  to  the  overall 
process  justifies  further  discussion. 


2.  A  Good  Contract  Require*  Extensive 
Forthright  Communications 


The  key  to  a  successful  development  program  is 
a  specification,  work  statement,  and  set  of 
contractual  terms  and  conditions  established 
through  extensive  face-to-face  dialogue  between 
the  contractor  and  the  Service  Program  Office. 
Only  through  such  dialogue  can  obsolete  MIL 
specifications  and  unnecessary  requirements  be 
avoided,  the  most  cost  effective  technology 
appropriate  to  each  subsystem  be  selected,  a 
full  and  mutual  understanding  of  the  critical 
requirements  be  established,  and  the  risks  to 
be  evaluated. 

During  the  late  '60s  and  early  '70s,  the  Con¬ 
tract  Definition  Phase  (CDP)  was  intended  to 
serve  this  purpose.  In  many  cases  It  was  not 
successful,  since  the  dialogue  was  limited  or 
restricted  to  questions  and  answers  versus 
forthright  debate. 

An  example  of  a  successful  CDP  was  the  one  con¬ 
ducted  on  the  Maverick  program  at  the  AF 
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Aeronautical  Systems  Division.  It  was  success¬ 
ful  primarily  because  the  specification  negoti¬ 
ations  were  carried  out  in  detail  over  a  period 
of  about  11  months,  and  contract  negotiations, 
over  18  months.  I  participated  as  the  Hughes 
program  manager  and  I  can  assure  you  it  was  an 
enervating  experience.  Nevertheless,  both 
parties  fully  understood  the  contract  at  the 
conclusion  of  the  CDP,  and  it  was  a  tough  but 
fair  coni. -act.  It  also  resulted  in  the  only 
successful  major  total  package  procurement  pro¬ 
gram  to  our  knowledge. 

In  contrast,  RFPs  now  reflect  a  30  day  response 
time.  The  contractors  generally  respond  with 
onlv  minor  suggestions,  for  they  find  it  advan¬ 
tageous  to  do  so  from  a  competitive  point  of 
view  (i.e.,  oou't  rock  the  boat).  The  need  to 
be  responsive  to  customer  stated  requirements 
is  always  present  and  becomes  critical  when 
customer  communication  is  lacking  or  prohibited. 

Improved  communications  suggest  that  extensive 
face-to-face  dialogue  between  the  Service  Pro- 
gramOf  flee  and  the  contractor  should  be  encour¬ 
aged  during  competitive  Concept  Formulation/ 
Demonstration  and  Validation  phases.  Forth¬ 
right  debate  of  the  issues  and  trade-off a  are 
necessary  to  make  readiness  requirements  fit 
the  reality  of  development  and  meet  the  pro¬ 
duction  and  equipment  fielding  schedules. 


Cost/Schedule/Performance  Achievable 
with  Known  Technology 


The  level  of  technology  should  be  clearly 
established,  and  advanced  technology  with  its 
attendant  risks  should  only  be  used  when  the 
payoff  warrants.  Increased  performance  dic¬ 
tates  a  higher  price. 


that  the  realism  of  the  schedule  and  costs  can 
be  evaluated. 


Avoid  System  Level  Prototy 


During  Concept  Formulation/Denonstration  and 
Validation  phases,  the  contractor  should  be 
required  to  establish  a  production  prototype 
design  and  do  such  breadboarding  and  simula¬ 
tions  as  required  to  permit  the  Service  to 
truly  evaluate  his  offering.  Demonstration  and 
Validation  should  be  accomplished  at  the  lowest 
poafa.olc  level-breadboard,  brassboard,  subsys¬ 
tem,  simulation  or  system  level  —  that  is 
required  to  validate  a  new  Concept  or  reduce 
the  risk  of  a  new  technology  beir-,  introduced 
into  full  scale  development  (FSD)  to  .‘■n  accept¬ 
able  level.  Flexibility  in  choice  should  be 
maintained.  In  the  unusual  event  that  a  sys¬ 
tem  prototype  is  required,  it  should  be  to  the 
production  prototype  design.  The  adequate 
validat  ton  of  technology  at  the  proper  level 
can  help  shorten  full  3cale  development  and 
reduce  costs. 

7.  Produclblllty.  BIT,  and  O&S 
Established  Prior  to  FSD 

Producibility,  built-in-test  (BIT),  mainte¬ 
nance  and  support  concepts  and  tradeoffs 
should  be  thoroughly  studied  as  an  integral 
part  of  the  design  process.  BIT  should  also  be 
compatible  with  a  reasonable  maintenance  con¬ 
cept  and  not  specified  at  such  high  system  or 
thoroughness  levels  that  it  dominates  the 
design,  is  technically  unachievable,  or  Mit 
cost  effective.  Life  cycle  cost  (LCC)  analysis 
should  be  used  as  an  effective  tool  for  shaping 
program  plcns  and  making  product  design 
decisions. 


Don't  Overspecify 


"How-to-design"  technical  specifications  should 
be  excluded.  The  end  goal  is  to  satisfy  mis¬ 
sion  needs  by  meeting  established  operational 
thresholds.  Esrly  int'  rated  operational  tost 
and  evaluation  should  ;  established  to  mutu¬ 
ally  sr.tiofy  custoc  'r,  ■  ontractor  test  require¬ 
ments  and  demonstrate  that  the  equipment  under 
development  can  be  operated,  maintained  and 
supported  within  the  sphere  of  military  opera¬ 
tions.  Joint  contractor.  Service-  and  0T6E 
teams  can  frequently  satisfy  this  objective 
during  development  without  costl y  delays. 

The  use  of  commercial  practices  vot.lc.  help 
reduce  development  costs. 


Fit  the  Design  Environment 
to  the  Equipment 


The  electronic  design  environment  (temperature, 
vibration,  shock,  access,  volume,  etc.)  should 
be  more  completely  defined  to  permit  sound 
engineering  for  reliability,  maintainability 
and  support.  Critical  environments  such  as 
temperature,  vibration,  cooling,  etc.,  should 
be  measurable  when  BIT  indicates  an  inflight 
failure  so  that  the  failure  environment  esn  be 
simulated  on  the  ground  In  the  event  that  the 
failure  la  not  repeated  on  an  ambient  test 
bench  (20- >0  percent  of  failures  are  not). 


9.  CERTS  or  TAAF  versus  MIL  781 


5.  A  Good  Plan  Before  FSD 


A  tailored  cost/schedule  planning  and  control 
spec1 flcation  (C/SPCS)  should  be  generated  so 


HIL-STD-781  on  rellabi-.ity  testing  by  and  large 
haa  been  a  failure  for  rvo-  reasons: 

a)  the  environments  are  not  realistic,  and 
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b)  the  contractor  and  the  Service  Program 
Office  have  a  mutual  Interest  to  pass, 
thereby  defeating  the  punitive  nature  of 
the  test. 

Work  at  AFFDL  on  Combined  Environments  Relia¬ 
bility  Testing  (CERT) ,  recent  emphasis  upon 
designing  for  reliability,  and  the  Navy  non- 
punitlve  Test,  Analyze  and  Fix  test  (TAAF) 
concept  with  realistic  test  environments  are 
far  more  likely  to  result  in  reliable  hardware 
in  the  field. 


contingency  funds  to  cover  unforeseen 
problems,  changes  in  performance,  require¬ 
ments,  and  threat  as  currently  practiced 
by  the  Army  with  "TRACE"  funding.  The 
Service  should  work  with  tha  contractor  to 
figure  out  what  the  desired  system  will 
actually  coat  and  provide  realistic  budget 
information  to  Congreas. 

This  will  permit  maintenance  of  program  conti¬ 
nuity  thereby  minimizing  cost  and  schedule 
overruns. 


The  Parts  Revolution  versus 
Obaolcaence 


The  number  of  electronic  part  types  should,  of 
course,  be  minimized,  but  current  government 
inventory  parts  lists  of  active  components 
should  not  be  specified  since  they  will  be 
overtaken  by  technology  by  the  time  the  system 
is  in  production  and  operation  (l.e.,  FSD 
4-6  years;  plus  production  4-10  years;  plus 
support  10-20  years).  However,  when  appro¬ 
priate,  the  use  of  standard  (MIL  Spec  and 
commercial)  non  active  and  perhaps  some  active 
parts  with  proven  performance  records  can 
avoid  development  risks  and  benefit  downstream 
logistic  considerations.  Again,  flexibility 
in  choice  should  be  provided  the  designer 
through  the  tradeoff  process. 


A  Mature  Deals 


Service  Program  Office  Stability 


The  Air  Force  policy  ar  ASD  of  integrated, 
co-located  vertical  SPOs  including  all  busi¬ 
ness,  engineering,  logistic  and  support,  and 
operational  functions  has  been  highly  success¬ 
ful  and  should  be  continued.  There  should  oe 
documented  guidelines  (contracts)  between  the 
Service  Program  Manager  and  his  management 
with  sufficient  flexibility  that  would  permit 
him  to  make  the  day-to-day  decisions  and  value 
Judgments  required  to  maintain  the  momentum 
and  efficient  prosecution  of  the  program.  The 
Service  Program  Manager  should  be  professional 
in  this  difficult  specialty  and  retained,  as  a 
minimum,  for  the  duration  of  the  development 
and  Initial  production  phases. 


Delegation  of  Authority 


The  Initial  Operational  Capability  (IOC)  date 
and  program  plan  should  be  established  on  the 
basis  that  permits  a  mature  design  to  be  avail¬ 
able  at  the  completion  of  full  scale  develop-  ~ 
ment.  It  should  be  noted  that  the  overeil 
effect  of  a  properly  conducted  Concept  Formu- 
latlon/Demonstration  and  Validation,  aa  pre¬ 
viously  described,  will  not  delay  IOC,  but  in 
fact  result  in  aasurlng  that  IOC  will  be  met. 

The  continued  use  of  competition  and  extensive 
candid  face-to-face  contractor/customer  dia¬ 
logue  on  coat,  achedule  and  performance  trade¬ 
offs  can  provide  agreement  on  performance  that 
can  be  accomplished  within  achedule  at  an 
affordable  Llfa  Cycle  Coat.  With  them  the 
length  of  the  acquisition  cycle  is  shortened 
and  acquisition  coats  are  reduced.  Hera  again, 
the  Maverick  procurement  demonstrated  a  rapid 
transition  from  initiation  to  operational  use 
when  compared  to  today's  lengthy  acquisitions. 


12.  Minimum  Cost  Through  Realistic 
Budgeting 

The  government  can  further  assure  shorter  pro¬ 
curement  cycles  and  reduced  coats  by  estab¬ 
lishing  reasonable  budgets  that  provide 


Responsibility  for  program  execution  should  be 
delegated  via  the  contract  to  the  contractor. 
Reporting  should  be  minimal,  consistent  with 
the  Service  Program  Manager  being  on  top  of 
the  program  and  able  to  recognize  danger  sig¬ 
nals  and  take  timely  corrective  action. 

Monthly  program  reviews  that  require  25  to  30 
percent  of  the  contractors'  key  personnel  time 
should  lie  forbidden.  Major  preliminary,  crit¬ 
ical,  and  other  specified  design  reviews  and 
major  milestones  are,  of  course,  mandatory. 
Timely  decisions  on  all  issues  are  key  to  any 
successful  program.  Response  time  should  be 
spelled  out  in  the  contract. 


Benefits  of  20/20  Hindsight 


Since  neither  the  contractor  nor  the  govern¬ 
ment  has  total  insight  in  establishing  the 
perfect  contract,  a  meaningful  Value  Engineer¬ 
ing  clause  should  also  be  mandstory.  The 
world  environment  today  introduces  many  uncer¬ 
tainties  relative  to  energy,  critical  mate¬ 
rials  and  economic  escalation.  Reasonable 
terms  and  conditions  for -any  long  duration 
contract  should  provide  for  these 
contingencies. 
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Ill .  PRODUCTION 


1.  Design  Maturity  In  FSD  —  a  Key 
Factor  In  ICC 


Prior  discussion  focused  on  the  importance  of 
properly  using  the  design  and  development 
process  to  set  the  stage  for  production  and 
deployment.  Considerable  emphasis  was  placed 
on  the  "selective"  use  of  both  state-of-the- 
art  and  advanced  technology;  upon  designing 
for  reliability,  producibllity,  and  the  opti¬ 
mum  support  concept  prior  to  full  scale  devel¬ 
ops;  nt  to  permit  achieving  a  mature  system 
design  during  full  scale  development. 

With  a  few  exceptions,  such  maturity  lias  not 
been  achieved.  The  result  has  been  immature 
hardware  entering  production,  high  change 
rates,  and  the  delivery  of  multiple  configura¬ 
tions  of  tactical  equipment.  As  a  consequence, 
fielded  hardware  is  difficult  to  maintain  and 
support.  Spares  are  Inadequate,  field  and 
depot  test  equip aent  requires  modification  to 
retain  effectiveness,  and  field  modification 
must  be  used  to  case  the  configuration  burden. 

As  a  result,  costs  are  higher  than  predicted, 
operational  readiness  is  put  in  Jeopardy,  pro¬ 
curement  is  stretched,  and  further  cost 
increases  are  frequently  encountered. 

In  seeking  a  solution  to  the  achievement  of 
design  maturity,  DOD  evolved  the  concept  of 
full-scale  system  prototyping  and  eliminated 
concurrency  to  reduce  risk.  However,  the  proc¬ 
ess  of  incremental  decision  making  snd  multi¬ 
layered  review  has  also  significantly  extended 
the  acquisition  cycle.  The  longer  cycle 
results  in  too  little,  obsolescent  and  costly 
equipment  in  the  field.  The  effect  has  been  a 
decrease  in  readiness  due  to  the  doubling  and 
tripling  the  "requirement-to-fielding"  times 
for  new  systems  and  equipment. 

Based  on  achieving  a  well  thought  out  program 
prior  to  Initiation  of  FSD  and  the  attainment 
of  a  mature  design  in  FSD,  a  number  of  changes 
can  be  made  in  the  production  phase  to  reduce 
cost  and  improve  read'  aa. 


2,  Concurrency  It  Good 


With  a  stable  design  of  predictable  coat,  the 
acquisition  can  proceed  smoothly.  Concurrency 
for  initial  procurement  phases  during  the  lat¬ 
ter  phases  of  FSD  can  move  forward  in  a  cost 
effective  manner,  avoiding  the  multiple  start 
up  coats  of  the  noncurrent  program.  Design 
of  pi  eduction  tooling,  special  test  equipment 


and  long  lead  time  material  are  all  appropri¬ 
ate  in  the  latter  phase  of  FSD.  One  can  and 
should  expect  lower  production  support  costs 
and  lower  production  hardware  costs. 

i  1 

3.  Multiyear  Options 

i 

Multiyear  options  should  and  can  equitably  be 
negotiated,  so  that  stability  in  production  can 
be  achieved.  Such  stability  should  save  from 
10  to  30  percent,  depending  on  how  close  the 
chosen  production  rate  is  to  optimum. 

i  ,  4 .  Continuity  Faya  Off 

The  point  is  that  the  Service  and  contractor 
managements  will  be  devoting  their  time  to  man¬ 
aging  a  stable  program  rather  than  estimating 
in  a  "what  if"  environment.  OPTIMUM  AND  PRE¬ 
DICTABLE  RATES  PAY  OFF. 

Examples : 

a)  17,000  Maverick  missiles  in  a  total  package 
program  were  procured  in  three  options 
(doubling  the  procurement  span  was  esti- 

1  mated  to  Increase  the  cost  30  percent  with¬ 
out  considering  escalation) . 

b)  A  program  to  produce  700  F-18  radars  in  A 
to  5  years  is  25  to  30  percent  cheaper  than 
in  8  to  10  years. 


5.  Procurement  —  Multi-Year  Buys  for  Cost 
and  Reliability 


Procurement  provides  another  area  to  achieve 
cost  savings  with  reliability  enhancement  as  an 
added  benefit.  Currently  the  purchase  of  mili¬ 
tary  grade  electronic  components  is  complicated 
by  several  factors: 

a)  Government  quality  surveillance  of  compo¬ 
nent  suppliers  is  poor. 

b)  MIL-Spec  requirements  in  conjunction  with 
the  relatively  low  volumes  involved  in  most 
government  contracts  are  not  attractive  to 
most  conronent  suppliers. 

c)  Large  commercial  buys  for  computers,  the 
automotive  industry,  television,  etc.,  are 
far  less  stringent  in  requirements  and  much 
more  lucrative. 

What  can  be  done  to  improve  this  situation? 

Let  us  examine  some  possibilities  based  on  a 
mature  design: 

a)  Multiyear  buys  (our  studies  indicate  thnt 
30  percent  can  be  saved  by  buying  three 
years  in  lieu  of  one). 
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b)  TiRhten  up  on  the  quality  control  of  the 
suppliers  —  many  contractors  are  going  to 
100  percent  incoming  inspection  with  sub¬ 
stantial  capital  and  receiving  costs. 

c)  Eliminate  the  requirement  for  multiple 
sources  except  where  the  technology  or 
process  is  marginal  (savings  in  qualifica¬ 
tion  costs  and  savings  due  co  higher  volume 
will  result). 

d)  Combine  spare  and  production  component 
buys. 

e)  Where  feasible,  buy  from  a  single  lot  and 
verify  quality  through  sample  teat  (see  b 
above) . 

f)  Where  quantity  of  a  component  used  per  sys¬ 
tem  is  low,  buy  out  for  all  production  plus 
spares. 

g)  The  critical  part  of  an  active  component, 
such  as  an  IC,  is  the  chip  or  dice  which 
represents  only  a  few  percent  of  the  com¬ 
ponent  cost.  Look  at  the  potential  of  buy¬ 
ing  entire  production  and  spare  require¬ 
ments  via  wafers  thus  avoiding  obsolesence 
and  providing  protection  against  loss  of 
the  production  process. 

The  effect  of  such  procurement  techniques  is  to 
save  cost,  minimize  Infant  mortality,  and  accel¬ 
erate  reliability  growth  in  the  field,  espe¬ 
cially  when  combined  with  modern  automated  pro¬ 
duction,  and  carefully  designed  and  controlled 
screening  teats  with  appropriate  environments 
at  the  module,  black  box  and  system  level. 


XV.  OPERATION  AND  SUPPORT 

DOD  policy  says  OSS  cost  is  an  equal  partner 
with  performance  and  schedule.  This  is  good 
policy  for  several  reasons.  First,  there  are 
today,  less  dollars  available  to  buy  the  new 
hardware  necessary  to  satisfy  mission  needs. 
Second,  the  continued  growth  in  the  cost  of 
resources  to  operate  and  support  the  existing 
inventory  is  consuming  the  budget.  Third,  it 
forces  the  search  for  possible  -cost  savings 
during  new  developments.  The  major  goals  of 
this  concept  are  to  reduce  04S  costs  below  the 
acquisition  portion  of  the  budget  without  com¬ 
promising  mission  reliability  and  military 
needs. 

The  DOD  approach  to  achieving  these  goals  at 
the  policy  level  la  to  manage  the  Life  Cycle 
Cost  (ICC)  of  the  system.  With  a  few  excep¬ 
tions,  however,  this  approach  is  not  achiev¬ 
ing  the  goal  of  cost/performance/schedule 
equality.  The  reault  has  bean  continued  empha¬ 
sis  on  performance  and  schedule  by  the  devel¬ 
opers  during  the  acquisition  phase  and  contln- 
ued  requirements  tor  traditional  operations  and 
support  by  the  users.  The  gap  betveen  policy 


and  practice 


ashing,  and  the  concept  will 


continue  to  lose  credibility  if  steps  are  not 
taken  to  leverse  the  trend. 

Several  concerns  may  be  causing  the  developers 
and  the  users  to  realat  implementation. 

A  major  issue  to  the  developer  is  the  budget. 
With  less  dollars  available,  the  program  is 
shaped  for  accomplishment  of  hardware  design, 
development  and  test.  Early  life  cycle  cost 
and  logistic  activities  are  either  not  Included, 
deferred  at  the  first  budget  crunch,  reduced  to 
meaningless  slgnTflcance,  retained  lnhouae  by  ~ 
logistic  elements  of  the  military  technology 
centers,  or  all  of  the  above. 

Another  issue  may  be  a  lack  of  confidence  in 
the  results  of  0&S  analysis  due  to  concern  for 
either  the  tools  available  or  the  soft  engi¬ 
neering  data  used  for  early  analysis.  However, 
the  models  used  have  been  verified  through 
proven  performance;  and  analysis  is  performed 
incrementally  as  the  data  base  hardens.  Each 
iteration  permits  a  degree  of  depth  and  con¬ 
sideration  consistent  with  the  decisions 
required  for  that  phase  of  the  program. 

A  further  concern  may  be  doubt  that  reliability 
goals  can  be  achieved.  There  are  three  major 
approaches  to  addressing  this  problem.  First, 
new  avionics  technology  is  truly  reliable  and 
promises  even  greater  improvements  in  the  near 
term.  Second,  current  techniques  and  test  con¬ 
cepts  are  yielding  higher  reliability  compo¬ 
nents  and  systems  with  earlier  design  maturity. 
Third,  design  failure  predictions  are  derated 
to  derive  operational  failure  predictions 
reflecting  both  equipment  maturity  and  support 
system  maturity. 

Still  another  problem  is  the  military  and 
economic  concern  of  the  user  related  to  Phased 
Logistic  Support,  Warranties,  Contractor  Sup¬ 
port,  and  other  departures  from  traditional 
concepts.  It  Is  important  to  recognize  that 
without  raj or  changes  in  maintenance  philosophy 
and  tables  of  organization  no  substantial  sav¬ 
ings  can  be  realized  in  O&S  costs  and  the  long 
term  goal  of  having  the  operations  portion  of 
the  POP  budget  less  than  the  acquisition  por¬ 
tion  ot  the  budget  can  not  be  meFi  The  risk, 
however,  is  not  as  great  as  advertised  or 
feared.  Ktny  support  alternatives  have  been 
used  by  the  military  on  a  selective  basis  with¬ 
out  loss  of  capability  and  at  reduced  costs. 
Others  are  used  by  commercial  organizations 
with  Increased  effectiveness  and  less  expense. 

Since  the  tools  and  knowledge  to  bridge  the  gap 
between  policy  and  practice  exist,  they  should 
be  implemented.  A  simple,  three-step  concep¬ 
tual  approach  would  be  to  establish  the 
requirement;  provide  the  budget;  and  Implement 
thoae  alternatives  that  offer  cost  savings  at 
no  decrease  in  operational  effectiveness. 

The  only  practical  way  to  establish  tha 
requirement  is  to  have  each  Request  for 
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Proposal,  Statement  of  Work,  and  Contract 
Include  positive  Integrated  Logistic  Support 
(ILS),  Life  Cycle  Cost,  and  Reliability/ 
Maintainability  programs  consistent  with  the 
needs  of  each  program  phase.  It  should  start 
with  the  concept  Formulation  Phase  and  be  rea¬ 
sonably  deflnltized  by  DSARC  II  prior  to  start 
of  FSD.  These  should  be  contractor  conducted 
programs  accomplished  in  conjunction  with 
hardware  design  activities.  The  resulting 
analyses  should  help  shape  the  hardware 
designs  for  cost  avoidance  and  ease  of  mainte¬ 
nance.  ILS/LCC  requirements,  based  on  the 
design  configuration,  should  be  reviewed  in 
face-to-face  encounters  with  the  customer,  and 
agreements  reflected  in  program  specifications, 
plans  and  contractual  documents.  There  is  a 
revolutionary  potential  for  reduction  in  O&S 
costa  due  to: 

a)  the  ability  to  achieve  design  maturity  in 
development  per  earlier  discussion; 

b)  substantial  reduction  in  Infant  mortality 
by  new  production  screens  from  the  compo¬ 
nent  through  the  system  level; 

c)  improved  BIT. 

In  fact  the  potential  exists  for  eliminating 
Intermediate  and  organic  Depot  Level  Mainte¬ 
nance  (l.o. ,  use  factory  support). 

The  key  is  adequate  front  end  funding  for  the 
Concept  Formulation  through  Production  plus  a 
firm  determination  to  apply  the  principles 
previously  presented.  Equivocation  will  lead 
to  the  sad  results  of  the  past. 

The  concept  of  support  alternatives  requires 
different  treatment  due  to  the  varying  claims 
made  for  and  against  their  use.  One  approach 
ia  to  graphically  put  some  dimensions  on  the 
discussion.  Figure  1  provides  a  standard 
definition  for  life  cycle  costs  and  describes 
a  relationship  between  cost  categories  and 
program  phases.  The  areas  of  interest  to  this 
discussion  are  acquisition  costs  and  ownership 
costs.  Mote  that  phased  logistic  support 
would  occur  during  thP  span  called  Contractor 
Support  Cost  and  req:  es  overlap  to  transi¬ 
tion  to  organic  su’  uc  t.  A  full  contractor 
support  program  or  warranty  program  would 
replace  organic  support  for  the  span  shown  If 
cither  were  to  be  selected  os  a  cost  effective 
alternate. 

Figure  2  verifies  the  earlier  discussions  on 
development.  Subsystem  configurations  are 
frozen  prior  to  Demonstration  and  Validation; 
system  and  production  feasibility  is  proven 
odor  to  Full  Scale  Devnlopmont;  a  mature 
design  la  available  prior  to  Production.  Mote 
a'.*<  that  analyst*  after  Concept  Formulation 
ran  ally  affect  10  percent  of  the  l.CC  commit¬ 
ment.  After  Development,  ft  is  possible  to 
nffe:l  only  S  percent  of  the  cost.  Consequently 


requirements  for  ILS/LCC  programs  must  be 
clearly  defined  in  early  RFPs.  The  government 
deeds  to  work  closely  with  the  contractor  dur¬ 
ing  early  phases  if  the  desired  cost  savings 
are  to  be  realized. 

DOD  is  encouraging  the  use  of  technology  to 
lower  Life  Cycle  Costa.  The  biggest  cost 
drivers  in  the  process  are  reliability, 
expressed  in  mean  time  between  failures,  unit 
price,  and  people.  While  all  three  are  design 
relatable,  only  the  first  two  can  be  controlled 
by  the  contractor.  The  third  is  a  function  of 
tue  fcCverument ,  consequently  there  is  a  finite 
iimit  to  the  cost  savings  available  through 
technology.  Cultural  chances  are  required  to 
realize  full  benefit. 

A  typical,  modern  aiiuoiue  rauar  using  the 
latest  technology  exhibits  an  LCC  distribution 
of  67  percent  for  acquisition  and  33  percent 
ownership  as  illustrated  in  Figure  3  using 
conventional  three-level  support.  Traditional 
support  concepts  yield  non-recurring  costs  of 
S3  percent  and  recurring  support  costs  of 
47  percent.  Further  percentage  breakdowns  for 
each  category  show  the  biggest  cost  drivers 
to  be  people  and  spares,  with  support  equip¬ 
ment  also  contributing  heavily  to  initial  costs. 

Combining  various  ACE  and  maintenance  concepts 
permits  studies  to  be  conducted  that  compare 
life  cycle  logistic  support  coots  for  candidate 
support  concepts.  Figure  4  defines  a  family  of 
support  alternatives  that  offers  cost  savings 
when  compared  to  the  conventional  three-level 
maintenance  concept. 

Principal  design  decisions  Include  the  consid¬ 
eration  of  a  suitcase  tester  in  lieu  of 
expanded  BIT  capability  to  isolate  faults 
within  a  replaceable  unit  (and  in  many  cases  to 
a  single  replaceable  assembly)  and  considera¬ 
tion  of  functional  partitioning  approaches  per¬ 
mitting  the  removal  of  replaceable  assemblies 
at  the  organizational  level. 

As  ‘illustrated,  a  two-level  maintenance  concept 
with  contractor  support  at  depot  level  offers 
$0  percent  cost  savings  over  the  conventional 
baseline  concept"  With  savings  of  this  magnl- 
tude  available,  the  government  must  urge  the 
services  to  implement  rhe  cultural  changes 
necessary,  and  it  should  be  done  rapidly. 


V.  SUMMARY 


If  generally  applied  across  DOD  procurements 
of  systems  and  equipment,  the  principles  that 
have  been  presented  should  lead  to  significant 
Rains  in  Life  Cycle  Ccct.  The  puper  empha¬ 
sizes  that  to  seriously  impact  LCC  you  must: 

•  Establish  an  integrated  Service  Program 
Office  with  responsibility  and  authority  to 
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make  timely  decisions  and  the  longevity  to 
maintain  continuity  throughout  the  acqulai- 
tlon  proceae. 

•  Have  extensive  forthright  communications  and 
negotiations  between  the  competing  contractors 
and  the  Customer  through  the  Concept  Formula- 
tion/Deaonstration  and  Validation  Phases  to 
establish  *  viable  contract  for  FSD. 

•  Establish  the  realise  and  risk  of  the  pro¬ 
posed  concept  at  the  lowest  level  of  testing, 
analysis,  and  simulation  of  critical  subsys¬ 
tems;  a  production  prototype  design;  and  a 
detailed  program  plan  prior  to  FSD. 

•  Maximize  the  use  of  known  technology  appro¬ 
priate  to  the  application  with  a  dedicated 
plan  to  achieve  a  Mature  Design  In  FSD. 

•  Adequately  fund  all  phases  with  reasonable 
contingencies  for  changes  in  requirements, 
unforeseen  problems,  etc.,  via  a  realistic 
Independent  estimate  of  the  expected  coat  by 
the  Service  baaed  on  past  weapon  system 
procurement  history. 


a  "Utilize  East  Economic  Buy"  in  establishing 
production  rates  and  multiyear  procurement 
of  components. 

•  Maintain  reliability  in  production  and  mini¬ 
mize  Infant  mortality  by  optimum  procure¬ 
ment  policies,  and  environmental  test 
screens  appropriate  from  the  components 
through  the  system  level. 

e  For  modem  avionic  systems  designed  and 
built  to  the  above  concepts,  establish  a 
two  level  O&S  concept  (i.e.,  "0"  level 
remove  and  replace  subsystems;  piece  part 
repair  by  the  contractor). 

•  Maintain  program  continuity  with  concurrency 
determined  by  reasonable  risk. 

These  principles  support  the  concepts  and 
requirements  of  0KB  Circular  A-109  and  associ¬ 
ated  DOD  directives.  Achievement  denands  sub¬ 
stantial  changes  in  Acquisition  and  Support 
Policy  by  the  DOD  and  Congress,  plus  dedication 
by  the  industry  to  back  up  their  convictions 
with  performance. 
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LIFE  CYCLE  COST  (LCC)  TECHNIQUES  FOR  MAJOR  ACQUISITIONS 


Jackson  0.  Dennis  and  Thomas  A.  Mottlnger 
Martin  Marietta  Aerospace 


ABSTRACT 


This  paper  presents  our  experience  and  results 
of  applying  LCC  cost  analysis  techniques  on 
major  system  acquisitions.  We  emphasize  prac¬ 
tical  application  of  costing  techniques  for 
decision  making  early  in  the  life  cycle  of  a 
program.  Key  topics  of  the  paper  include: 

I.  Life  Cycle  Cost  Data  Base. 

a.  Data  base  development  methods. 

b.  Cost  estimating  relationships; 
development  and  use. 

c.  Historical  cost  data  sheets;  tools 
for  estimates  by  analogy. 

II.  Life  Cycle  Costing  Techniques. 

a.  Parametric  methods  of  LCC  estimates 


b.  Multiple  independent  estimate 
approach  to  LCC  estimates. 


c.  LCC  cost  trade  study  techniques 
that  identify  lowest  program  LCC. 


III.  Results  of  Application  of  our  Life  Cycle 
Costing  techniques. 


a.  This  part  of  the  paper  presents 
examples  of  costing  techniques  we  have  found 
useful  in  cost  analysis  of  recent  major  system 
acquisitions. 

b.  LCC  profiles  that  provide  the  rela¬ 
tive  cost  significance  of  major  system  elements. 

c.  LCC  cost  driver  lists  identify  those 
few  items  that  capture  the  majority  of  the  pro¬ 
gram  LCC. 


d.  LCC  trade  matrix  we  developed  as  a 
technique  to  standardize  cost  results  for  the 
decision  making  process. 

e.  Cost  sensitivity  analysis  techniques 
we  have  used  for  trade  studies  and  decision 
making. 


f.  Lessons  we  have  learned  performing 
LCC  analyses  on  acquisitions. 
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CONTRACTUAL  INNOVATIONS  IN  LIFE  CYCLE  COST  APPLICATION 
Captain  John  M.  Barry,  USAF  Acquisition  Logistics  Division 


INTRODUCTION 


Procurement /acquis it ion  concepts,  such  as  life 
cycle  costing  and  design  to  cost  (LCC/DTC)  pro¬ 
gress  through  various  stages  in  the  implementa¬ 
tion  process.  This  process  starts  with  the 
bosic  procurement  regulation  and  develops  into 
specific  guidance  tailored  to  the  contracting 
environment.  Then  the  concept  undergoes  large 
promotional  campaigns  tlirough  professional  sym¬ 
posiums  a-J  c  tractor  advertisements.  In  life 
cycle  c.tfL_,.g  and  design  to  cost,  these  promo¬ 
tional  campaigns  are  evidenced  by  the  large 
number  of  seminars  and  symposiums  devoted  to 
the  subject.  These  seminars  do  fulfill  the 
urgent  need  of  dispersing  information  to  top 
level  management  in  DOD  and  industry  on  LCC/DTC 
but  they  fall  short  on  meeting  the  need  for 
specific  practical  implementation  at.  the  con¬ 
tractual  level.  This  level  involves  the  middle 
manager,  cost  analyst,  and  the  design  enrineer. 
These  individuals  actualty implement  and  deter¬ 
mine  life  cycle  costs  through  their  decisions 
urd  design  of  equipment.  They  desperately  need 
the  proper  and  simplified  tools  to  apply  LCC / 
I'TC.  Unfortunately,  the  information  given  'in 
most  seminars  on  LCC/DTC  is  either  too  broad  in 
scope,  more  promotional  than  practical,  or  Just 
too  tailored  to  specific  companies  to  be  of  any 
benefit  to  the  design  engineer.  Furthermore, 
the  LCC/DTC  methods  being  developed  or  present¬ 
ly  used  are  becoming  rigid,  paper  consuming  and 
cumbersome  « /stems  which  are  creating  their  own 
bureujei a~iv.  self-defeating  empire.  This 
empire  is  contrary  to  the  LCC/DTC  basic  purpose 
which  is  to  motivate  these  working  level  indi¬ 
viduals  to  consider  life  cycle  costs  in  the 
development  of  the  system.  The  problem  of 
motivating  these  individuals  to  actually  consi¬ 
der  life  cycle  costs  in  their  decisions  is  not 
being  solved. 

Experience  in  LCC/DTC  auditing  has  indicated 
that  we  are  not  properly  educating  the  design 
engineers  or  cost  anal’  s  on  the  essence  of 
LCC/DTC  -  that  is  to  r  ate  design/perforoance 
parameters  to  life  cy-lc  costs.  Instead,  we 
are  burdening  them  with  cumbersome  LCC/DTC 
paperwork,  and  reporting  requirements  which 
detract  from  their  engineering  and  cost  tasks. 
This  additional  workload  is  not  only  detrimen¬ 
tal  to  the  development  of  new  systems,  but  also 
may  cause  LCC/DTC  to  die  under  its  own  bureau¬ 
cratic  paperwork  much  like  the  "ilities"  suf¬ 
fered  from  over-promotion  and  overemphasis  in 
the  early  '70s.  Therefore,  some  tool  or  proce¬ 
dure  must  be  applied  to  LCC/DTC  in  the  contrac¬ 
tual  'rocess  which  is  meaningful  to  the  middle 
mar, eg  r,  design  engineer,  and  cost  analyst 
which  fulfills  the  need  of  LCC/DTC.  This  tool 


is  the  programmable  calculator,  a  portable, 
relatively  inexpensive  and  easy  to  use  device 
that  can  be  used  in  the  LCC/DTC  process. 

This  paper  will  focus  on  the  concept  of  using 
r  ••'"•ommaMe  calculators  in  LCC/DTC  as  well  as 
actual  cock,. -rtual  experience  and  benefits 
derived  from  its  application.  Programmable 
calculators  have  achieved  a  j.».vel  of  sophisti¬ 
cation  which  allows  comprehensive  a-alysis  to 
be  performed  on  them.  LCC/DTC  contractual 
modeling  requirements  formerly  restricted  to 
large  scale  computers  can  now  be  effectively 
accomplished  with  these  calculators.  The  ad¬ 
vantage  of  applying  programmable  calculators  is 
that  the  contractor  can  be  given  pre-developed 
or  he  can  develop ,  with  government  approval , 
LCC/DTC  models  which  require  no  knowledge  of 
computer /calculator  programing.  Given  these 
models  anyone  -  the  middle  manager,  engineers, 
and  cost  analysts,  can  apply  LCC/DTC  with  the 
same  facility  required  to  operate  a  four- 
function  calculator.  This  paper  will  expand 
the  discussion  on  programmable  calculators  to 
include  a  simplified  description  and  provide  an 
educational  overview  of  standard  Air  Force 
LCC/DTC  modelB  which  are  successfully  UBed  on 
present  contracts  and  demonstrate  the  value  of 
programmable  calculators  in  the  acquisition 
process. 

THE  PROGRAMMABLE  CALCULATOR 
AND  ITS  APPLICATIONS 


Inherent  to  the  concept  of  a  programmable  cal¬ 
culator  I3  a  precise  definition  and  a  certain 
level  of  computation  sophistication.  Such  a 
calculator  can  be  defined  as  portable  instru¬ 
ment  which  is  capable  of  performing  and  storing 
complex  repetitive  operations  involving  logic 
aud  branching  instructions.  These  operations 
include  addressing,  branching,  variable/opera- 
tion  storage,  looping  and  modularity.  All  of 
these  features  are  essential  to  the  concept  of 
programmable  calculators.  Calculators  which 
exhibit  only  some  of  these  features  are  not 
sufficient  to  accomplish  the  demanding  require¬ 
ments  in  Life  Cycle  Cost/Design  to  Coot  (~CC/ 
DTC).  Even  with  this  description  there  arc 
varying  levels  of  sophistication  among  program¬ 
mable  s  .  The  moot  useful  features  are  those 
calculators  with  "non-volauile"  memory .  This 
memory  refers  to  an  electronic  or  r  „netic 
device  which  retains  the  program  and  data  con¬ 
tents  even  when  the  calculator  is  turned  off. 
The  limitations  of  the  electronic  non-volatile 
device  is  that  the  memory  capacity  in  reetrict- 


46 


B&g&essagaia 


W 


ed  to  the  maximum  number  of  programming  steps/ 
storage  locations  the  calculator  can  accommo¬ 
date.  The  magnetic  device  card  which  1#  i tunn¬ 
ed  and  read  into  the  calculator,  is  much  more 
versatile.  Separate  programs/data  can  be 
stored  and  retrieved  on  individual  magnetic 
cards.  This  allows  the  user  to  build  and  re¬ 
tain  a  large  library  of  LCC/DTC  programs  for 
different  applications.  These  applications 
will  be  explored  in  further  detail  in  the  fol¬ 
lowing  paragraphs. 

Prior  to  describing  the  programmable  calculator 
LCC/DTC  applications,  a  depiction  of  the  range 
of  functional  possibilities  is  necessary  since 
life  cycle  costing  is  an  interdisciplinary  sub¬ 
ject.  The  manufacturers  of  programmable  calcu¬ 
lators  offer  predeveloped  software  programming 
packages  in  the  various  functional  areas  of 
statistics,  engineering,  business,  systems 
analysis/operations  research ,  physical/life 
sciences,  and  many  others.  The  complex  pro¬ 
grams  in  these  various  areas  formerly  restrict¬ 
ed  their  solutions  to  large  scale  computers. 

The  advent  of  programoables  allows  the  computa¬ 
tion  of  such  problems  such  as  learning  curves, 
reliability  predictions,  trend  forecasts,  and 
multiple  regression  analyses  in  the  matter  of 
seconds.  While  it  is  true  that  these  problems 
can  be  solved  with  a  scientific  handheld  calcu¬ 
lator,  the  time  and  error  possibility  required 
of  any  task  using  a  programmable  is  greatly 
reduced.  Therefore,  the  programmable  remains 
as  a  desirable  and  in  many  cases  cheaper  alter¬ 
native  to  the  time-consuming  handheld  calcula¬ 
tor  or  expensive  large  scale  computer  for  solv¬ 
ing  a  variety  of  problems  in  various  functional 
specialties.  This  alternative  suggests  the 
relevance  of  effectively  using  these  calcula¬ 
tors  in  the  system  acquisition  process. 

Opportunities  for  constructive  application  of 
the  programmable  calculator  exist  through  the 
entire  system  acquisition  process.  During  the 
conceptual  phase  when  detailed  data  is  not 
available,  parametric  model  development  is  es¬ 
sential.  Parametric  equations  relate  variable 
or  constant  performance  or  design  data  to  cost 
in  the  LCC  process.  A  simple  example  of  a 
parametric  equation  could  be  the  relation  of 
weight  to  transportation  cost,  i.e.,  transport¬ 
ation  cost  *  $.13  per  pound  x  total  weight. 

More  complex  examples  such  as  those  relating 
some  performance  parameter  like  reliability  to 
cost  may  involve  literally  pages  of  equations 
which  can  be  effectively  accomplished  on  this 
calculator.  Aa  system  development  progresses 
into  the  validation  phase,  design  to  coBt 
models  can  be  employed  on  these  calculators 
thereby  greatly  simplifying  the  amount  of 
effort  required  at  the  design  engineer’s  level. 
Further  applications  are  possible  when  a  system 
transitions  into  the  full  scale  development  and 
production  phase  of  system  development.  Models 
involving  learning  curves,  probability  distri¬ 
butions,  and  economic  order  quantities  are  used 
to  solve  production  should  cost  problems, 
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spare  requirements,  and  design  to  cost  goals. 
Therefore,  the  programmable  calculator  can  be 
applied  over  i  he  entire  at  antrum  of  the  syatetv 
development  oyole.  Next,  speoifte  {vindication* 
in  the  LCC/DTC  process  will  be  explored. 

The  essence  of  a  good  LCC/DTC  model  Bhould 
relate  some  design  performance  parameter  to 
cost.  Performance  parameters  are  usually  sel¬ 
ected  because  operational  coots  which  often 
consume  from  60JL-85S  of  a  systems  total  LCC, 
are  dependent  on  these  parameters.  Such  a 
parameter  is  reliability.  We  know  that  the 
more  reliable  a  system  is,  the  less  maintenance 
and  spares  it  will  require,  thus  reflecting 
lower  operational  costs.  However,  this  in¬ 
creased  reliability  is  not  free  -  it  costs 
extra  and  must  be  factored  into  a  life  cycle 
cost  model.  The  extra  reliability  cost  is 
usually  determined  by  front-end  or  development 
models  which  relate  reliability  to  development 
and  production  costs.  These  development  models 
are  usually  program  unique.  However,  the  oper¬ 
ational  models  that  determine  reliability  cost 
differences  normally  trace  their  origins  to  the 
Air  Force  Logistics  Command  (AFLC)  Logistics 
Support  Cost  (LSC)  model  or  the  counterpart 
model 8  in  the  Navy  and  Army.  Since  the  LSC 
model  has  been  successfully  employed  on  pro¬ 
grammable  calculators  in  numerous  Air  Force  and 
some  commercial  contracts,  this  model  will  be 
described  in  more  depth  and  demonstrated  on  the 
calculator. 

The  objective  of  the  AFLC  Logistics  Support 
Cost  (LSC)  model  is  to  estimate  the  support 
costs  that  may  be  incurred  by  adopting  a  parti¬ 
cular  design  for  a  given  weapon  system  or  a 
piece  of  equipment.  The  model  is  intended  for 
application  in  source  selection  and  in  contrac¬ 
tual  design  of  hardware.  In  source  selection 
the  LSC  model  is  used  to  obtain  an  estimate  of 
the  differential  logistics  support  costs  be¬ 
tween  the  proposed  design  configurations  of  two 
or  core  contractors.  During  hardware  design, 
the  model  serves  an  a  decision  aid  when  discri¬ 
minating  among  design  alternatives. 

The  LSC  model  consists  of  ten  equations,  each 
of  which  represents  a  component  of  the  total 
cost  required  to  operate  the  logistics  system. 
These  ten  components  are: 

1.  Initial  and  replacement  line  replaceable 
unit  (LRU)  costs.  An  LRU  refers  to  a  component 
like  a  radio,  initial  guidance  system,  etc., 
which  can  be  rewved,  replaced,  spared,  and 
maintained  as  an  integral  unit. 

2.  On  equipment  maintenance  cost  is  that  cost 
attributed  to  working  on  an  LRU  while  it  is 
still  attached  to  its  system.  For  example, 
the  calibration  cost  of  a  radio  while  it  is 
still  installed  in  the  aircraft  falls  into  this 
category. 

3.  Off  equipment  maintenance  cost  refers  to 
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the  maintenance  performed  when  the  LRU  is  re¬ 
moved  from  the  system.  For  example,  alignment 
of  an  inertial  navigation  system  at  an  interme¬ 
diate  or  depot  repair  facility  is  considered 
such  a  cost. 


TABLE  I 

COMPARISON  OF  LSC  PERFORMANCE  OH  VARIOUS 
COMPUTATIONAL  DEVICES 


■i.  Inventor}'  and  supply  management  coat. 

5.  Support  equipment  cost  refers  to  the  equip¬ 
ment  costs  required  to  maintain  an  LRU.  For 
example,  calibration  sets,  voltmeters,  would  be 
included  in  this  category. 

6.  Cost  of  personnel  training  and  training 
equipment. 

T.  Co.-:  of  management  and  technical,  data. 

8 .  Facilities  cost6 . 

9.  Fuel  consumption  cost. 

10.  Cost  of  spare  engines. 

The  firut  seven  equatiore  are  evaluated  for 
each  appropriate  LRU  and  the  results  are  col¬ 
lected  over  all  subcyst ema.  To  arrive  at  a 
logistics  support  cost  for  the  total  system, 
the  last  three  equations  are  added.  Although 
this  model  was  originally  developed  for  air¬ 
craft  systems,  it  has  been  adapted  to  space  and 
missile  systems  by  eliminating  equations  9  and 
10. 

The  running  of  the  LSC  model  requires  some  60 
variable  inputs  and  the  computation  of  approx¬ 
imately  ten  pages  of  sophisticated  equations. 
The  model  could  be  performed  on  a  handheld 
scientific  calculator,  a  large  scale  computer 
or  a  pr-.gromable  calculator.  The  performance 
of  tbe  model  on  a  scientific  calculator  would 
take  about  three  hours  for  one  problem.  The 
model  turnaround  time  on  a  large  scale  computer 
sometimes  is  10 t  any  better  because  there  are 
computer  delays  related  to  computer  downtime, 
keypunching,  and  facility  location.  Therefore, 
both  the  scientific  Calculator  and  computer 
tend  to  drive  up  the  commodity  we  are  most 
interested  in  making  more  efficient  -  engineer¬ 
ing  labor  on  development  contracts.  However, 
the  programmable  cr’  ulator  avoids  all  these 
pitfol.lr.  by  provii  g  the  design  engineer  wxt.i 
e  personal  tool  .-hi'li  he  can  perform  and  record 
LCC/DTC  requirements.  A  demonstration  of  the 
speed  and  accuracy  using  the  LSC  model  on  a 
programmable  compared  against  the  other  two 
computational  methods  will  indicate  the  value 
of  this  calculator  in  the  LCC/DTC  process.  The 
comparison  Jata  presented  in  Table  1  is  based 
or.  actual  uuditu  performed. 


Computational 

Device 

Average 

Steps 

Involved 

Average  Est  Input 
Time  Error 

Involved  Rate 

Scientific 

Calculator 

1.  3,150  key¬ 
strokes 

2.  Documenta¬ 
tion  of 
Intermediate 
&  final 
reviews 

3  hours 
computa¬ 
tion 

65J1 

Large  Scale 
Computer^ 

1.  Input  data 
on  key¬ 
punch  forms 

3  day 
turn¬ 
around 

20*2 

2.  Send  to 
keypunch 

Programmable 

Calculator 

1.  20  key¬ 
strokes 

15* 

2.  Paste  out¬ 
put  on  pre¬ 
printed 
form 

1.  Error  rate  due  to  incorrect  keystroke  input. 

2.  Error  rate  due  to  a  combination  of  incorrect 
entry  on  keypunch  form  and  keypunch  operator 
error. 

3.  Refers  to  off-line  computer  operation. 


The  analysis  of  the  error  rates  in  Tabic  1 
illuminate  some  of  the  complexities  in  using 
these  computational  devices.  If  an  error  is 
introduced  in  performing  LSC  on  the  scientific 
calculator,  the  entire  procedure  has  to  be  re¬ 
peated  with  a  time  loss  of  3  hours  in  one  case 
and  a  delay  of  3  days  in  another.  The  three- 
day  turnaround  can  then  be  related  into  a  sche¬ 
dule  loos  an1*  increase  contractual  costs.  Even 
through  the  error  rate  on  the  programmable  cal¬ 
culator  is  not  much  lower  than  on  the  computer, 
the  mistake  is  rectified  in  2  minutes  versus  3 
days.  Therefore,  reduced  time  and  increased 
convenience  and  availability  can  be  an  impor¬ 
tant  factor  in  the  programmable  calculator's 
contribution  to  productivity  and  cost  reduc¬ 
tion.  These  decreased  costs  have  been  realized 
on  some  present  contra^  ..  For  example,  one 
contractor  demonstrated  a  net  p  *t  avoidance  of 
$158,000  through  the  use  of  programnablco  on 
LCC/DTC  tasks.  In  addition,  there  are  some 
attractive  qualitative  improvements  to  the  LCC/ 
DTC  proceoo  that  this  calculator  has  introduced. 
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The  qualitative  improvement 6  realized  from  pro¬ 
grammable  calculator  application  have  enhanced 
the  LCC/DTC  performance.  These  improvements 
include  increased  integrity,  acceptance, 
analyst  motivation,  streamlined  documentation, 
and  LCC  being  worked  at  the  design  engineer 
level.  LCC  audits  indicate  that  prior  to  the 
use  of  progranaables ,  some  design  engineers 
actually  developed  their  own  simplified  formu¬ 
las  that  could  be  computed  on  a  handheld  scien¬ 
tific  calculator  rather  than  use  the  more  time- 
consuming  large  scale  computer.  These  engi¬ 
neers  reverted  to  using  the  scientific  calcula¬ 
tor  because  it  was  more  convenient  and  produced 
faster  results.  This  situation  not  only  com¬ 
promised  the  integrity  of  LCC/DTC  performance, 
but  frequently  produced  incorrect  results.  The 
progranmable  provided  these  design  engineers 
with  a  greater  and  more  acceptable  capability 
because  it  provided  the  same  availability  and 
portability  as  their  own  scientific  calculator. 
This  improvement  not  only  increased  the  engi¬ 
neer's  motivation  to  perform  LCC/DTC  but  also 
reduced  the  documentation  from  several  inches 
of  computer  paper  to  two  simplified  input/out- 
put  sheets.  The  most  spectacular  benefit 
achieved  has  been  that  design  trades  are  now 
being  accomplished  at  the  design  engineer  work¬ 
ing  level.  Formerly  these  trades  were  rele¬ 
gated  to  either  some  computational  or  the 
finance  department.  These  two  departments  are 
so  far  removed  from  the  design  engineering  pro¬ 
cess  in  both  function  and  motives  that  they  are 
irrelevant  to  LCC/DTC.  These  qualitative  im¬ 
provements  are  yet  another  indication  of  the 
value  of  the  programmable  in  LCC/DTC. 


The  concept,  applications,  experience  and  bene¬ 
fits  of  programmable  calculators  to  the  LCC/DTC 
processhavc  been  explored.  This  paper  examined 
some  of  the  possible  uses  that  this  versatile 
tool  has  in  LCC/DTC.  The  list  of  contributions 
to  the  contracting  arena  was  equally  impres¬ 
sive,  especially  in  the  area  of  cost  avoidance, 
increased  productivity  and  motivation.  The 
current  applications  of  the  programmables  are 
not  intended  to  make  the  design  engineer  or 
cost  analyst  a  programmer,  but  to  provide  this 
person  with  a  preprogrammed  tool  that  can  be 
used  in  making  designs  which  will  reflect  a 
decrease  in  life  cycle  costs.  As  long  as  this 
objective  is  pursued,  the  programmable  calcu¬ 
lator  will  continue  making  significant  contri¬ 
butions  in  life  cycle  cost  and  design  to  cost. 
Finally,  this  calculator  is  not  presented  as 
a  panacea  to  all  engineering  analyses  required, 
but  as  a  tool  that  has  the  potential  to 
increase  LCC/DTC  productivity  and  reduce  costs 
on  development  and  production  contracts. 
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Several  other  models  other  than  the  AFLC  LSC 
model  have  been  applied  to  programmables  on 
contracts  with  similar  success.  They  include 
the  optimum  level  repair  analysis,  economic 
analysis  models,  the  National  Aeronautics  and 
Astronautics  Cost  per  Flight  for  commercial 
users  model,  and  scores  of  others.  A  descrip¬ 
tion  of  the  AFLC  Logistics  Support  Cost  Model 
was  introduced  to  indicate  the  complexity  and 
advantages  of  programmables.  These  additional 
models  noted  are  equally  complex  and  lend  them¬ 
selves  to  adaptation  with  this  calculator.  The 
power  of  this  calculator  is  only  constrained  by 
the  ability  of  the  programmer.  Large  programs 
which  exceed  the  memory  of  the  calculator  can 
be  executed  by  dividing  the  problem  into  man¬ 
ageable  pieces  or  subroutines  and  placed  on 
magnetic  cards.  However,  the  programmer  must 
keep  in  mind  the  user  and  simplify  both  operat¬ 
ing  procedures  and  execution  time.  The  pro¬ 
grammable  is  not  applicable  to  massive  data 
base  problems.  It  is  intended  to  be  a  valuable 
supplement,  but  not  a  replacement  to  the  com¬ 
puter.  The  applications  presented  are  only  an 
indication  of  the  power  and  advantages  of  the 
progranmable. 


49 


STRATEGIC  IMPLICATIONS  OF  THE  EXPERIENCE  CURVE  EFFECT 
FOR  AVIONICS  ACQUISITIONS  BY  THE  DEPARTMENT  OF  DEFENSE 

Lt  Col  William  F.  Cheney,  IV,  Aeronautical  Systems  Division, 
Air  Force  Systems  Command,  United  States  Air  Force 


INTRODUCTION 


Tills  paper  summarizes  the  anchor's  doctoral 
research  into  the  applicability  and  strategic 
implications  o£  the  experience  curve  effect 
for  avionics  acquisitions  by  the  Department  of 
Defense  [3).  Experience  curve  theory  seeks  *-o 
explain  product  cost-quantity  (or  price- 
quantity)  relationships  in  terms  similar  to 
those  of  learning  curve  theory,  but  recogniz¬ 
ing  rhe  influences  of  such  managerially  con¬ 
trollable  factors  as  investment,  specialization 
and  scale.  Tills  theory  has  far-reaching  stra¬ 
tegic  implications  for  many  aspects  of  business 
with  the  most  significant  centering  on  the 
dependence  of  profitability  on  market  share. 
Department  of  Defense  procurement  agencies  can 
improve  their  own  strategic  decisions  by  rec¬ 
ognizing  and  considering  the  implications  of 
the  experience  curve  effect  for  aerospace 
industry  firms. 

The  Defense  Department  has  supported  numerous 
studies  of  learning  curve  theory,  mainly  in 
the  context  of  the  airframe  and  aircraft  indus¬ 
tries.  However,  no  research  has  yet  been  docu¬ 
mented  with  respect  to  the  applicability  or 
significance  of  experience  curve  theory  (as 
distinguished  from  learning  theory)  for  either 
buyers  or  sellers  in  the  relatively  unique 
environment  of  the  military  market  place. 

Department  of  Defense  procurements  impose  very 
extensive  Government  regulations  on  contract¬ 
ors,  and  the  few-sellers,  very-few-buyers 
(oligopolistic,  ollgopsonistlc)  defense  market 
place  differs  markedly  from  the  strongly  com¬ 
petitive  consumer  and  industrial  markets 
examined  in  the  light  of  experience  curve 
theory  by  The  Boston  Consulting  Group  [2]  and 
by  Woolley  (6],  For  instance,  defense  procure¬ 
ments  are  usually  made  only  in  annual  incre¬ 
ments,  authorized  and  funded  at  the  discretion 
of  Congress.  The  uncertainty  thus  surrounding 
future  orders  is  a  severe  disincentive  to  capi¬ 
tal  Investment,  resulting  in  less  than  optimal 
efficiency  and  productivity.  Productivity 
enhancement  is  further  handicapped  by  the  par¬ 
ticularly  rapid  onset  of  obsolescence,  unfor¬ 
tunately  characteristic  of  the  high  technology 
products  required  by  the  defense  community. 

Long  lead-times  between  major  project  start-up 
and  completion  are  the  rule,  not  the  exception. 
Non-standard  designs  are  common,  and  the  con¬ 
tractor's  technical  risks  are  multiplied  by 
Government  intervention  in  both  product  and 
process  design  changes.  Urgency  often  dictates 
unusually  demanding  delivery  schedules. 


RESEARCH  METHODOLOGY 


Based  on  a  review  of  the  literature  relevant 
to  experience  curve  theory,  and  on  the  author's 
avionics  acquisition  experience,  a  set  of  seven 
related  issues  whicli  warranted  further  research 
was  Identified.  These  issues  are: 

1.  How  do  experience  curves  differ  from  tradi¬ 
tional  learning  curves  in  the  Government  pro¬ 
curement  environment? 

2.  How  are  the  fonts  of  experience  curves 
affected  by  alternative  techniques  for  compen¬ 
sating  for  the  effects  of  inflation? 

3.  How  are  the  forms  of  experience  curves 
affected  by  implicit  prior  experience  on 
closely  related  products? 

A.  How  are  the  forms  of  experience  curves 
related  to  production  lot  sizes,  product  de¬ 
livery  rates,  delivery  lead  times,  and  the  dur¬ 
ation  of  breaks  between  production  runs? 

5.  How  stable  are  experience  curve  slopes 
over  successive  procurements? 

6.  How  consistent  arc  experience  curve  slopes 
within  and  across  firms? 

7.  How  accurately  can  future  procurement 
pricing  be  predicted  using  experience  curve 
theory? 

These  Issues  were  investigated  In  the  context 
of  361  selected  Department  of  Defense  avionics 
equipment  procurements  made  from  1960  through 
1976,  representing  20  equipment  items  and  13 
contractors. 

The  non-random  selection  of  the  data  base  con¬ 
tent  limited  the  utility  of  statistical  tests, 
and  transformation  to  logarithmic  formulation 
distorted  the  usual  interpretation  of  such 
established  Indicators  as  the  Coefficient  of 
Determination  (R2)  and  F-tests.  In  spite  of 
these  limitations,  selective  use  was  made  of 
F-tests  of.explanatory  significance,  R2  and 
Adjusted  Rz  values,  and  Standard  Error  of  Esti¬ 
mate  (SEE)  values  in  comparing  alternative 
models.  Examination  of  regression  residuals 
played  an  important  role  in  determining  the 
applicability  of  models,  particularly  with 
respect  to  Issue  5.  Other  statistical  tests  of 
relationships,  such  as  t-tests  and  chi-square 
tests,  were  also  used  extensively.  Bivariate 
and  multivariate  regrejsion  were  the  main 
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analytleal  techniques  used. 

The  models  and  variables  used  are  summarized 
here.  The  classical  (or  traditional)  power 
form  model  of  learning  or  experience  attribu¬ 
ted  to  Wright  [7] 


and  its  logarithmic  transformation 

In  V  »  In  B  +  B,  In  X. 

A  oil 

were  used  most  extensively  (Issues  1,  2,  5,  6, 
and  7).  The  modified  power  form  model  of 
lea-'iing  attributed  to  Crawford  [l] 


and  its  logarithmic  transformation 


through  Bg  -  Modulation  Effect  Expo¬ 
nents 

C.  “  Implicit  Prior  Experience  Quantity 

X^  -  Cumulative  Quantity 

X2  “  Quantity  Bought 

Xj  «  Maximum  Delivery  Rate 

X,  "  Production  Break  Duration 

Xg  »  Delivery  Lead  Time 

Xfi  •  average  Delivery  Rate 

CONCLUSIONS 


In  Y  »  In  B  +  B.  In  X. 

U  oil 

were  used  only  in  conjunction  with  rhc  analysis 
of  Issue  1.  A  variant  of  the  classical  pouer 
form  model  and  of  tie  Stanford-B  equation  [5] 


Ya  -  Bo  (X,  +  C)B1 

and  its  logarithmic  transformation 

In  Y  »  la  8  +  B,  In  (X,  +  C) 

A  ol  1 

were  similarly  used  only  in  one  analysis,  that 
of  Issue  3. 

A  multiplicative  variant  of  the  classical  power 
fern  model  (similar  in  fonn  to  Levenson's  model 
[«]) 


VA  -  3o  X11  X22  X33  X4*  X55  X66 
and  its  logarithmic  transformation 

In  Y  -  In  B  +  B,  In  X,  +  B-  In  X,  + 

A  o  1  1  2  i 

B3  In  X3  +  Ba  In  X/(  +  Bj  In  Xj  +  Bfi  In  X& 


Issue  1.  Analysis  of  the  performance  of 
defense  avionics  contractors  indicates  that 
price  u-— .ally  follows  costs  in  the  Government 
market  place  as  it  does  in  consumer  and  indus¬ 
trial  markets,  although  with  experience  curve 
slopes  typically  of  852  to  952,  rather  than  the 
70%  to  80%  observed  in  those  latter  markets. 
This  relatively  gradual  rate  of  experience 
realization  appears  to  be  due  both  to  the  ex¬ 
tent  of  Government  Interventions  and  controls, 
and  to  the  concern  of  Government  decision¬ 
makers  for  maintaining  flexibility  at  the  ex¬ 
pense  of  productivity.  For  individual  con¬ 
tractors,  moderately  significant  predictive 
relationships  were  found  to  rei  ite  price  expe¬ 
rience  slope  to  learning  sloper  for  direct 
labor  costs,  purchased  material  costs,  and 
total  manufacturing  costs.  However,  no  sig¬ 
nificant  relationships  were  identified  at  the 
sub-industry  composite  level,  suggesting  that 
price  predictions  based  solely  on  industry 
average  cost  slopes  are  predestined  to  be 
inaccurate.  In  most  Instances,  the  best  sta¬ 
tistical  fits  of  data  to  theory  resulted  when 
cumulative  average  experience  curves  were 
fitted  to  price  data. 


were  introduced  mid  used  for  the  investigation 
of  Issues  4  and  7.  (This  model  is  considered 
to  have  particular  mer'  for  future  extensions 
to  other  data  bancs.' 

The  variables  in  the  preceding  equations  are 
defined  as  follows: 

Y  »  Cumulative  Average  Unit  Price  (or 
Coat) 

Yy  »  Unit  Price  (or  Coat) 

Bq  -  Imputed  First  Unit  Price  (or  Cost) 

3.  "  Learning  or  Experience  Slope  Expo¬ 
nent 


Issue  2.  The  performance  of  the  three  alter¬ 
native  deflators  analyzed  was  generally  quite 
similar,  in  terms  of  visible  effects  on  the 
shape  of  graphically  displayed  data.  Ignoring 
inflation  was  fmind  to  result  in  relatively 
flat  slopes  with  pronounced  perturbations: 

Cross  National  Product  (GNP),  Federal  Purchases 
of  Goods  and  Services  (FPCS) ,  and  Avionics 
Procurement  (AVPR)  deflators  yielded  increas¬ 
ingly  steeper  slopes  for  the  sane  underlying 
data,  with  fewer  perturbations.  Tills  ordering 
of  the  deflators  in  terms  of  slope  steepness 
was  found  to  be  statistically  significant, 
with  the  least  distinction  between  the  two 
closely  tailored  deflators  (FPGS  •  -  AVPR). 
Based  on  the  relative  importance  attached  to 
various  performance  measures  (c.g. ,  slope 
steepness,  explanation  of  variance),  any  one  of 
the  three  deflators  may  be  slightly  preferred 
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relative  to  Che  others  for  a  particular  analy¬ 
sis;  only  the  alternative  of  ignoring  inflation 
is  consistently  dominated. 

Issue  3.  Introduction  into  the  traditional 
learning  model  of  a  positive  shift  factor, 
commonly  thought  to  represent  an  implicit 
prior  experience  quantity,  resulted  in  improved 
statistical  fits  in  half  of  the  procurement  se¬ 
quences  investigated.  In  ten  instances,  the 
prior  experience  interpretation  seemed  reason¬ 
able.  However,  in  six  instances  shift  factors 
of  10,000  or  more  suggested  the  need  for  an 
alternative  interpretation.  In  each  of  these 
six  instances,  continuing  or  threatened  compe¬ 
tition  was  a  relevant  factor  which  could  have 
served  as  the  impetus  for  the  observed  sudden 
and  sharp  break  in  the  established  pricing 
trend.  Establishment  of  a  causal  relationship 
was  beyond  the  scope  of  Che  present  research. 
Since  the  coordinate  transformation  approach 
does  not  consider  such  experience  factors  as 
investment,  specialization,  or  scale,  it  does 
not  add  to  the  explanatory  or  predictive  power 
of  experience  theory  (even  though  statistically 
better  fits  can  result  from  shift  factor  intro¬ 
duction).  Further  pursuit  of  this  coordinate 
transformation  technique  does  not  seem  worth¬ 
while;  other  models  and  additional  variables 
need  to  be  considered  if  prior  experiance  is  to 
be  explicitly  recognized. 

Issue  4.  Five  production  parameters  were  pro¬ 
posed  as  implicitly  recognizing  the  experience 
factors  of  investment,  specialization,  and 
scale.  In  multivariate  regressions,  the  effects 
of  each  of  these  five  postulated  production 
parameters  were  found  to  be  beneficial  in  in¬ 
creasing  explained  variance  and  reducing  the 
standard  error  of  estimate  in  from  five  to 
eight  different  procurement  sequences  (of  the 
twelve  analyzed).  In  no  case  did  a  variable 
drop  out  of  the  regressions  once  introduced, 
and  in  no  case  did  the  sign  of  a  coefficient 
change  as  additional  variables  were  Introduced. 
Cumulative  Quantity  (the  traditional  indepen¬ 
dent  variable  in  learning  or  experience  theory) 
was  invariably  the  most  significant  contributor 
to  the  explanation  of  price  shlfcs.  Production 
Break  Duration,  Delivery  lead  Time,  and  Maximum 
Delivery  Rate  were  found  to  be  the  most  signi¬ 
ficant  modulating  parameters,  with  no  clearcut 
order  of  preference  amongst  them.  Average 
Delivery  Rate  and  Quantity  Bought  were  also 
important,  A  surprising  finding  was  that  the 
apparent  effect  of  extended  Production  Break 
Durations  was  usually  to  reduce,  rather  than 
Increase,  price.  Competitive  pressures  cannot 
be  credited,  since  continuing  or  threatened 
competition  was  not  a  factor  in  any  of  these 
Instances.  Two  possible  explanations  would  be 
that  continuing  production  of  similar  products 
during  these  production  breaks  could  have 
sustained  beneficial  experience  trends,  or  that 
contractors  nay  have  used  the  breaks  construc¬ 
tively  to  implement  other  coat  reductions. 


Issue  5.  Slope  change  patterns  were  identi¬ 
fied  and  evaluated  in  15  of  the  32  procurement 
sequences  investigated.  The  consaonest  pattern 
(6  instances)  involved  only  one  break  point, 
with  an  initial  nearly  level  or  gradually  de¬ 
clining  slope  followed  by  a  relatively  steeper 
decline;  this  pattern  Is  consistent  with  the 
experience  curve  effect  implication  that  price 
should  initially  be  set  near  cost6,  then  de¬ 
creased  with  costs  (once  a  satisfactory  profit 
margin  is  realized)  to  inhibit  market  entry  by 
competitors.  The  second  commonest  pattern  (5 
Instances)  involved  two  break  points,  with  an 
initially  declining  slope  followed  by  a  rising 
slope,  followed  finally  by  another  decline. 

This  pattern  suggests  that  contractors  encoun¬ 
tered  problems  leading  to  higher  than  planned 
costs,  overcame  them,  and  continued  to  realize 
experience  gains.  An  alternative  view  would 
explain  this  as  a  pattern  of  huy-ln  (price 
below  cost)  until  the  market  Is  assured,  in¬ 
crease  price  to  a  profitable  level,  then  reduce 
price  with  costs  to  reduce  the  risk  of  compet¬ 
itive  entries.  Breaking  each  of  these  15  pro¬ 
curement  sequences  into  two  or  three  log-linear 
segments  resulted  in  statistically  significant 
improvements  in  the  fit  of  the  models  to  the 
data;  the  most  notable  improvement  was  in  the 
reduction  of  standard  error  of  estimate  magni¬ 
tudes.  The  mean  last  log-linear  segment  re¬ 
gression  slope  for  the  nine  procurement  sequen¬ 
ces  demonstrating  experience  gains  for  that 
segment  was  87. 5X;  this  was  substantially 
steeper  than  the  93. 8Z  mean  value  of  the  over¬ 
all  regression  slopes  for  these  same  nine 
sequences.  This  pronounced  differential  sug¬ 
gests  that  overall  regression  slopes  may  often 
be  unduly  conservative  (l.e.,  too  flat,  thus 
overestimating  prices),  but  also  provides  warn¬ 
ing  that  projections  based  on  piecewise  log- 
linear  regressions  may  be  seriously  understated 
if  some  unrecognized  factors  disrupt  the  seg¬ 
ment  trend. 

Issue  6.  Regression  slopes  were  found  to  be 
highly  variable  both  within  and  across  firms. 
These  findings  strongly  suggest  the  desira¬ 
bility  of  making  multiple  projections,  using  a 
range  of  potential  slope  values,  when  planning 
for  new  product  Introduction  or  for  resumption 
of  production  following  a  major  disruption 
(e.g.,  extended  break,  facility  relocation, 
product  or  process  redesign).  Since  slopes 
wore  not  found  to  be  connlstent  even  within 
firms,  let  alone  across  firms,  arbitrary  reli¬ 
ance  on  any  one  slope  value  for  forecasting 
purposes,  whether  believed  representative  of 
the  product  line,  the  firm,  or  the  industry, 
should  be  avoided.  Development  of  forecasting 
models  which  expressly  recognize  relative 
product  complexity  and  a  contractor's  overall 
experience  level  should  offer  opportunities 
for  improvements  relative  to  the  current  tradi¬ 
tional  models,  reducing  dependence  on  learning 
slope  identification  and  prediction. 

Issue  7.  For  the  twelve  avionics  data  subfiles 
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analyzed,  the  predictive  abilities  of  all  four 
methods  tested  were  surprisingly  good  (i.e., 
deviation  values  were  less  than  5Z) .  The  re¬ 
sults  achieved  with  the  last  log-linear  segment 
methods  were  found  to  be  more  statistically 
signlf leant  than  those  achieved  with  overall 
regression  methods,  testing  on  percentage-based 
performance  comparisons.  The  production  para¬ 
meter  overall  regression  method  was  signifi¬ 
cantly  better  than  the  traditional  overall  re¬ 
gression  method  only  in  projecting  prices  for 
the  second  buy  beyond  the  range  of  the  model 
data;  the  last  log-linear  segment  production 
parameter  regression  model  was  never  demon- 
strrted  to  be  significantly  better  than  the 
last  log-linear  segment  traditional  regression 
model,  »•  ■'  ugh  dolinr-based  measures  (not 

amenable  tv  statistical  tests)  appeared  to 
favor  it  as  the  best  of  the  four  methods.  Sig¬ 
nificance  tests  not  withstanding,  in  view  of 
the  seemingly  good  performance  of  the  produc¬ 
tion  parameter  models  in  reducing  standard 
error  of  estimate  values,  and  as  indicated  by 
dollar  measures,  these  models  warrant  further 
Investigation  and  refinement. 


PROCUREMENT  RECOMMENDATIONS 


This  concluding  section  provides  recommenda¬ 
tions  for  both  buyers  and  sellers  in  the  de¬ 
fense  market  place.  These  recommendations  are 
based  mainly  on  the  two  major  findings  in  the 
present  research:  1)  Experience  curve  theory 
is  applicable  to  Government  procurements,  but 
?)  The  rate  of  realization  of  experience  is 
less  than  In  consumer  and  industrial  product 
markets.  Recommendations  deriving  from  the 
first  major  finding  are  presented  from  the 
perspective  of  Interpretation  of  general  busi¬ 
ness  strategy  Implications.  Recommendations 
deriving  from  the  second  major  finding  are 
presented  from  the  perspective  of  implications 
for  buyer -sel ler  interactions.  Each  of  these 
perspectives  will  he  further  Introduced  before 
proceeding  with  the  actual  recommendations. 

The  present  research  bns  confirmed  that  price 
usually  follows  co3t  (i.e.,  total  manufacturing 
cost)  even  in  the  uni'-  environment  of  the 
defense  market  place  Consequently,  it  Is 
appropriate  to  int<  mi  t  the  general  business 
strategy  implications  of  the  experience  curve 
effect  in  the  context  of  military  procurement. 
ReronnendatJons  relating  to  business  strategy 
will  be  presented  grouped  around  five  core 
ideas:  Price  and  Competitive  Interaction, 
Technology  and  Harket  Share,  Product  Growth 
Rate,  New  Product  Introduction,  and  Procure¬ 
ment  Flnnning  and  Negotiations. 

Consideration  of  buyer-seller  Interactions 
offe's  a  more  useful  perspective  for  the  re- 
culr-ng  recommendations,  baaed  on  the  finding 
rhat  experience  realization  Is  morn  gradual  In 
the  efenoe  market  place  than  In  eonsinaer  and 


Industrial  markets.  This  fact  may  be  attrib¬ 
uted  in  part  to  the  extent  of  intervention  by 
the  Government  customer  in  decisions  which,  in 
other  markets,  would  be  within  the  purview  of 
the  producer.  Additionally,  it  is  due  in  part 
to  unique  aspects  of  the  defense  market  place 
which  affect  producer  risks,  reduce  incentives, 
and  inhibit  productivity  gains.  These  explana¬ 
tions  provide  the  framework  for  further  recom¬ 
mendations.  Emphasizing  buyer-seller  interac¬ 
tions,  these  complementary  recommendations  will 
be  structured  around  four  core  ideas:  Govern¬ 
ment  Intervention,  Producer  Risks,  Producer 
Tne.entive3,  and  Productivity  Inhibitors. 

Kith  a  focus  on  business  strategy,  consider 
first  the  idea  of  price  and  eompt-t  itive  inter¬ 
action.  Experience  theory  holds  that  market 
instability  develops  when  price  does  „ot  follow 
cost.  In  openly  competitive  markets,  insta¬ 
bility  leads  to  a  price  break,  followed  by  a 
shakeout  of  marginal  producers  until  price 
again  stabilizes  near  cost,  resulting  in  lower 
prices  for  customers  and  reduced  profit  margins 
for  the  surviving  firm.  In  the  military  market 
place,  similar  patterns  occur  when  there  is 
open  competition,  but  open  competition  is  rarely 
maintained.  Usually,  once  a  firm  wins  an  ini¬ 
tial  competition  for  a  new  military  avionics 
product,  it  can  expect  to  receive  follow-on 
orders  for  added  quantities  in  future  years, 
provided  technical  performance  is  adequate  and 
price  docs  not  Increase  more  than  is  Justifi¬ 
able  as  being  due  to  inflation.  Given  the 
nature  of  Government  contracts  and  the  limita¬ 
tions  Imposed  on  profits,  coropc- ition  provides 
contractors  with  the  only  real  incentive  to 
reduce  costs  and  thus  prices.  In  the  absence 
of  product  standardization  (i.e. ,  form,  fit, 
and  function  standards),  there  can  be  little 
meaningful  continuing  competition,  and  premium 
prices  are  paid  to  a  sole  source.  While  this 
pattern  of  action  can  sometimes  result  in  mini¬ 
mum  life  cycle  costs  to  the  Government,  it 
should  not  be  accepted  automatically  as  the 
normal  way  of  doing  business.  Future  designs 
for  common  avionics  equipment  should  be  re¬ 
quired  to  meet  form,  fit,  and  function  stand¬ 
ards.  This  would  permit  effective  production 
competition,  when  warranted,  and  would  alsc 
simplify  future  equipment  retrofits.  Further, 
•‘von  without  competition,  increased  standardi¬ 
zation  is  conducive  to  greater  productivity. 
Sellers  (particularly  those  seeking  sole  source 
contracts)  should  concentrate  on  demonstrating 
their  ability  to  reduce  costs  and  willingness 
to  reduce  prices  even  in  the  absence  of  com¬ 
petition. 

With  respect  to  technology,  investment  in 
research  and  development  provides  o  competitive 
edge  to  firms  competing  in  , -jnsumer  and  indus¬ 
trial  markets.  Although  the  Cover  ent  funds 
nuch  military  research  and  development,  firms 
competing  for  military  business  should  like¬ 
wise  seek  a  competitive  edge  by  Investing  their 
own  resources,  both  In  anticipatory  pre-proposn’. 


work  and  In  more  formalized  independent  research 
and  development.  Greater  emphasis  should  be 
placed  by  both  Government  and  industry  on  up¬ 
grading  and  improving  process  technology,  since 
productivity  enhancement  is  largely  dependent 
on  Increasingly  efficient  production  processes. 
With  respect  to  market  share,  defense  industry 
firms  should  capitalize  on  sole  source  oppor¬ 
tunities,  but  recognize  that  a  demonstrated 
willingness  to  reduce  costs  even  in  Che  absence 
of  competition  will  carry  political  weight  in¬ 
fluencing  future  sole  source  awards. 

Experience  curve  theory  for  consumer  and  indus¬ 
trial  products  advocates  capturing  the  growth 
in  markets,  rather  than  attempting  to  displace 
the  market  share  of  established  producers.  For 
defense  Industry  firms,  this  is  most  easily 
done  by  becoming  established  as  the  initial  (if 
possible,  sole  source)  producer.  However, 
there  are  also  profit  opportunities  for  capable 
producers  who  are  not  initial  producers.  The 
Government  sometimes  seeks  to  develop  alterna¬ 
tive  sources  for  critical  products  to  maintain 
flexibility,  rather  than  to  obtain  immediate 
prife  competition.  Production  oriented  firms 
in  particular  should  seek  out  such  second 
source  opportunities,  concentrating  on  adding 
ro  their  assortment  those  products  which  are 
compatible  with  already  developed  and  estab¬ 
lished  process  technology.  The  combination  of 
process  compatibility  and  Initial  lack  of  em¬ 
phasis  on  price  should  allow  them  to  overcome 
the  experience  advantage  of  the  original  source 
and  prepare  for  future  price-based  competi¬ 
tions. 

New  products  are  introduced  in  the  military 
market  place  for  a  variety  of  reasons:  pri¬ 
marily  to  meet  operational  needs,  but  also  to 
Increase  flexibility  and  to  maintain  innovative 
capabilities.  For  the  Government  to  realize 
greater  productivity  gains,  standardization 
should  be  increased,  and  design  changes  and  new 
product  introductions  should  be  reduced.  De¬ 
fense  Industry  firms  should  become  thoroughly 
familiar  with  life  cycle  cost  methodology  (to 
include  the  use  of  price  experience  curves  in 
projecting  future  prices),  and  should  place 
increased  emphasis  on  the  expected  life  cycle 
coat  advantages  of  proposed  new  products  which 
they  are  marketing. 

Perhaps  the  greatest  opportunity  for  the  Gov¬ 
ernment  to  capitalize  on  experience  curve 
theory  lies  in  the  area  of  procurement  planning 
and  negotiations.  Prior  to  the  initial  pro¬ 
duction  of  new  products,  life  cycle  cost  esti¬ 
mates  should  be  developed  (using  experience 
curve  theory  to  forecast  future  acquisition 
prices)  for  such  alternative  procurement  ap¬ 
proaches  as  no  competition,  competition  for 
initial  production  only,  and  continuing  com¬ 
petition  (l.e.,  maintaining  at  least  two 
sources).  The  approach  which  minimizes  the 
expected  life  cycle  cost  to  the  Government 
should  then  be  Implemented,  provided  it  does 


not  unduly  restrict  industrial  flexibility  and 
innovative  capability.  Experience  curve  based 
price  projections  can  also  be  of  particular 
value  in  preparing  for  negotiations  for  follow- 
on  procurements  of  established  products.  While 
being  generally  guided  by  such  projections, 
both  Government  and  industry  negotiators  will 
also  need  to  be  completely  familiar  with  fac¬ 
tors  influencing  experience  realization,  pro¬ 
viding  a  basis  for  negotiation  of  variances 
from  price  projections.  (This.  Is  not  advocat¬ 
ing  conducting  negotiations  based  solely  on 
price  projections,  but  rather  introducing  such 
considerations  as  an  added  dimension  to  nego¬ 
tiations.) 

Shifting  now  to  a  focus  on  buyer-seller  inter¬ 
actions,  consider  first  Government  interven- 
tijns  in  production  contracts.  The  extent  of 
Government  intervention  In  contractor  dei isions 
appears  to  be  partly  responsible  for  the  rela¬ 
tively  gradual  rate  of  experience  realization 
in  military  procurements.  Productivity  should 
Increase  if  Interventions  are  reduced;  over¬ 
control  is  counterproductive.  For  instance, 
designs  should  be  required  to  meet  form,  fit, 
and  function  standards,  with  the  contractor 
being  free  to  make  changes  to  improve  produci- 
billty  (provided  the  standards  are.  still  met). 
Fora,  fit,  and  functional  capabilities  should 
not  be  changed  once  production  specifications 
have  been  agreed  upon,  except  for  cjses  of 
overriding  military  urgency  (e.g.,  "nice-to- 
have"  but  non-essential  features  should  not  be 
added) .  Producers  can  help  themselves  as  well 
as  the  Government  by  Identifying  area*  in 
which  reduced  Government  intervention  could 
Increase  productivity. 

Producer  risks  are  also  unique  in  the  defense 
market  place.  Through  funding  most  research 
and  development,  providing  or  paying  for  spe¬ 
cialized  tools  and  test  equipment,  and  in  some 
cases  providing  plant  facilities  for  contractor 
use,  the  Government  seeks  to  minimize  some  of 
the  risks  to  which  contractors  are  subjected. 
However,  other  risks  remain,  most  notably  due 
to  market  uncertainties.  Orders  ore  placed  at 
irregular  intervals,  and  for  varying  and  often 
unpredictable  quantities.  Due  to  changing 
military  priorities  and  close  Congressional 
control  of  funds,  there  is  often  uncertainty 
even  as  to  whether  or  not  there  will  be  a  next 
order.  Uncertainties  such  as  these  confound  a 
contractor's  efforts  to  build,  train,  and 
maintain  a  stable,  experienced  work  force. 

They  also  serve  as  a  disincentive  to  invest¬ 
ments  in  process  improvements,  resulting  in 
lost  opportunities  for  gains  in  experience. 
Extended  multiple-year  production  plans,  bear¬ 
ing  tentative  Congressional  approval  when 
appropriate,  should  be  shared  with  proopectlvc 
contractors.  Delivery  schedules  should  be  de¬ 
veloped  in  cooperation  with  producers  to  mini¬ 
mize  workforce  turbulence.  Producers  can 
again  help  themselves  by  identifying  the  risks 
and  uncertainties  which  arc  of  greatest 
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concern  to  then. 


Incentives  should  be  provided  to  encourage  con¬ 
tractors  to  nanage  efficiently,  with  emphasis 
on  achievable  rewards,  not  just  on  penalties. 
Reduced  Government  Intervention  will  mean 
greeter  responsibilities  for  producers,  which 
should  be  recognized  in  Che  incentive  struc¬ 
ture.  Both  the  Government  and  producers 
should  ensure  that  nil  personnel  who  could 
reasonably  be  expected  to  influence  the  dis¬ 
tribution  of  incentives  are  at  least  aware  of 
the  Incentive  structure.  In  particular,  they 
should  understand  the  ways  in  which  they,  as 
(ndiv  duals,  can  affect  the  distribution  of 
Incent'-s.  (The  experience  effect  does  not 
guarantee  rv  ..  -oductivlty  gains  will  be 
realized.  Productivity  enhancements  will  only 
result  when  Individuals  have  the  incentive,  as 
well  as  the  ability  and  opportunity,  to  make 
them  happen.) 

Finally,  the  catch-all  category  of  productiv¬ 
ity  inhibitors  deserves  further  attention. 
Several  have  already  been  identified,  including 
excessive  Government  interventions,  market 
uncertainties,  and  lack  of  real  incentive:.  As 
observed  in  the  present  research,  various  pro¬ 
duction  parameters  also  affect  costs  and  thus 
price  Productivity  will  benefit  from  improved 
(two-way)  corauni cations  between  producers  and 
the  Government,  especially  during  the  develop¬ 
ment  >f  production  plans.  Opportunities  for 
productivity  increases  abound,  hut  aggressive 
co  nag  (-rent  lo  needed  to  convert  the  opportuni¬ 
ties  'nto  realized  productivity  gains. 

The  experience  curve  effect  provides  a  power¬ 
ful  too?  for  use  by  both  Government  and  Indus¬ 
try  In  a  variety  of  applications.  It  can  help 
contractors  Increase  proflcs,  and  at  the  sumc 
tine  help  Government  procurement  decision 
makers  in  maximizing  the  return  on  their  expen¬ 
ditures  of  taxpayers'  dollars.  While  it  is  no 
panacea,  it  is  will  worth  understanding  and 
applying. 
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A  NEW  COST  PREDICTION  METHODOLOGY  - 
THE  MATURE  INDUSTRY  APPROACH 

Dr.  Joleroy  Gauger,  Boeing  Aeroapace  Company 


INTRODl,'”,ION 


Deslgn-to-Cost  and  Life-Cycle-Coat  require¬ 
ments  on  new  DoD  programs  have  forced  both  the 
customer  and  the  contractor  to  develop  a 
better  understanding  of  when  and  where  coats 
are  incurred. 

Cost  commitment  and  spending,  however,  do  not 
occur  simultaneously.  Figure  1  compares  the 
commitment  and  expenditure  of  funds  for  any 
program.  Note  that  while  the  majority  of  life¬ 
cycle-costs  have  been  committed  by  the  end  of 
the  conceptual  phase  of  a  program,  only  a  small 
portion  of  the  expenditures  have  occurred. 


Figure  1  -  Cost  Commitment  by 
Program  These 


The  fact  chat  the  greatest  cost  leverage  in  a 
program  exists  at  precisely  that  time  when  the 
least  is  known  about  potential  costs  forces 
the  development  of  parametric  cost  models. 


COST  MODELING  TECHNIQUES 


Cost  modelc  are  of  two  distinct  types: 

1)  Parametric  modelc  which  utilize  variobles 
(parameters)  which  have  bean  determined 
as  analytically  related  to  coats 

2)  Accounting  models  which  utilize  a  multi¬ 
tude  of  impact  parameters  which  are  the 
cost  incurring  elements  of  Che  program 
and  ere  ralatlble  in  twnheura,  material 
dollars,  tooling  dollar*,  etc. 


Figure  2  it  an  example  of  the  verlety  of  cost 
models  developed  within  Boeing  and  illustrates 
types  of  models  within  program  cost  categories. 
Simulation  is  the  imitative  representation  of 
the  functioning  of  a  system  or  process  by 
means  of  another  system;  e.g.,  the  computer 
simulation  of  a  design  or  manufacturing  pro¬ 
cess;  or,  at  other  levels  within  the  cost 
modal  halrarchy,  the  simulation  of  a  company, 
customer,  program  or  economic  system. 
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Figure  2  -  A  Hierarchy  of  Cost  Models 


Within  Boslng,  we  have  constructed  coat  pre¬ 
diction  models  for; 

1)  Software  deelgn/developmi nt 

2)  Structural  fabrication 

3)  Structural  aaiembly 

4)  Aircraft  acquisition  program 

5)  USAF  aircraft  OJ.S 

and  others. 

Specifically,  the  others  Include  a  new  cost 
prediction  approach  which  arose  out  of  the 
necessity  to  predict  the  production  coats  of 
the  Solar  Fowar  Satellite. 


THE  SOLAR  POWER  SATELLITE  CONCEPT 


The  Solar  Power  Satellite  concept  is  an 
approach  toward  solution  of  the  nation's 
snergy  problems  which  would  utilize  that  non- 
deplstebls  energy  source  one  eetronomlcal  unit 
away. 


Allow  me  to  describe  brief'"  the  concept 
illustrated  in  Figure  3. 


Solar  Power  Satellite 
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Earth  Receiver 
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OH  ’HOOSAHDSOt  SMALL  INIIUSTKIAL  PLANTS 


Figure  3  -  Solar  Power  Satellite  Concept 


A  ur.lt  of  the  Solar  Power  Satellite  power  sys¬ 
tem  would  consist  of  the  satellite  in  geo¬ 
synchronous  orblr  intercepting  the  solar  radi¬ 
ation,  converting  that  to  electrical  energy 
and  then  converting  the  low  level  electrical 
energy  to  microwaves  which  would  then  be  trans 
■pitted  to  receiving  stations  on  earth. 

Two  receiving  stations  per  satellite  would 
receive  the  microwaves  and  convert  the  micro¬ 
wave  energy  to  elect  .il  power  compatible 
with  existing  tran-  iion  and  distribution 
grids. 

The  overall  efficiency  from  solar  power  inter¬ 
cepted  to  electrical  power  delivered  to  the 
grid  wlli  be  r\>  6  percent. 

A  few  details  now  to  illustrate  the  size  of 
the  system: 

1)  The  size  of  the  satellite  -  about  100 
square  kilometers. 


3)  The  microwave  transmitting  array  -  2 
sets  of  about  100,000  klystrons  esch. 

A)  1  ic  solar  cell  array  -  about  15  billion 
s  lnr  cells. 

5)  The  power  delivered  -  10  gigawatts  - 
about  8  tines  the  size  of  ?  typical 
nuclear  power  station. 

6)  The  receiving  arrays  -  about  10  kilo¬ 
meters  in  diameter. 

The  top  work  breakdown  structure  for  the  SPS 
program  Is  as  indicated  in  Figure  U.  The 
total  program  sums  from  the  three  blocks  at 
level  2: 

1)  The  solar  power  system  which  consists 
of  the  satellite  and  ground  receivers 

2)  Tile  transportation  systems  consisting 
of  several  blocks  at  the  nc..t  level 


The  mao'*  -  about  100,000  metric  tons. 


3)  The  space  support  and  space  construction 
nyst ems . 
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Figure  4  -  Solar  Power  Program 
Top  Level  WBS 


COST  PREDICTION  PROBLEMS 


Ue  ere  describing  a  system  which  will  deliver 
10  gigawatts  of  power  at  c  unit  coat  approach¬ 
ing  20  billion  dollars  for: 

1)  The  satellite 

2)  Its  assembly  In  space 

3)  The  transportation  costs  to  orbit 

4)  The  ground  receiver  station  costs. 

What  are  the  types  af  cost  prediction  prob¬ 
lems? 

1)  Solar  Cell  Production  Cost.  The 
present  production  rate  Is  under  2000 
square  meters  per  year.  At  the  peak 
of  the  SPS  planned  scenario,  the  solar 
cell  requirements  would  exceed  100 
square  kilometers  of  cells/satellite. 
Normally  used  extrapolation  technlquss 
(learning  curves)  are  just  not  appli¬ 
cable. 

2)  High  Production  Rate  Requirements.  The 
development  of  a  technique  to  carry  one 
from  existing  production  rates  of  1-10/ 
year  for  some  Items  to  the  probable 
SPS  requirements  of  100,000  or  so  per 
year. 


SOLAR  CELL  COST  PREDICTION 


Let's  attack  the  problem  of  cost  prediction  for 
a  solar  cell  market  a  hundred  thousand  times 
greater  chan  the  present  market.  The  basic 
Ingredient  of  a  solar  cell  is  monocrystsl 
silicon  -  an  element,  essentially  a  basic  metal. 

The  costs  for  colls  at  present  are  driven  by 
the  types  of  manufacturing  processes  used, 
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the  loss  of  finished  monocrystsl  silicon 
during  slicing,  the  power  consumed  In  an  In¬ 
efficient  process  and  the  loss  and  waste  of 
material  and  manpower. 

Can  problems  like  this  be  cured? 

The  answer  is  yes  -  however,  It  takes  time 
and  resources  to  do  that  Job.  The  "mature" 
primary  metals  industries  have  solved  similar 
problems  In  the  past. 

The  market  line  for  the  primary  metals  indus¬ 
tries  relates  the  volume  of  metal  produced 
to  the  total  revenue  for  the  Industry.  Fig¬ 
ure  S  Is  a  representation  of  the  market  for 
primary  metals.  The  ordinate  is  expressed  in 
terms  of  pounds/year  moved  through  the  indus¬ 
try.  The  abscissa  Is  dollar  volume  for  the 
industry  (dollars/year) . 


«» 


Figure  5  -  Mature  Industry  (Metsl,  Ores) 


Each  point  summarizes  available  data  on  the 
production  end  total  revenue  associated  with, 
for  instance,  steel,  beryllium,  copper,  etc. 
Twenty  eight  separate  primary  metals  Indus¬ 
tries  ere  represented  here. 

The  equation  for  metals  Is  V  »  AX+B 

Where  V  Is  volume  In  pounds/yaar 
and  X  Is  revenue  in  dollsrs/year 

The  correlation  coeff lcient,  R^  *  0.89,  indi¬ 
cates  that  the  data  are  an  excellent  fit  and 
suggests  that  "mature"  industries  involved  in 
producing  primary  metals  evolve  along  s 
market  line  which  can  be  represented  analy¬ 
tically. 

Are  solar  cells  any  different? 

No,  they  are  not.  Therefore,  100  square  kilo¬ 
meters  of  solar  cells  will  require  ~  40,000 
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con9  of  finished  monocry a tal  silicon  which 
will  be  produced  for  100  million  dollars 
by  a  mature  industry.  If  a  value-added  factor 
of  20  takes  the  metal  to  the  finished  product 
(a  high  value-added  factor)  then,  the  coat  of 
solar  cells  produced  by  a  mature  industry  in 
the  1990-200C  time  period  should  be  in  the 
vicinity  of  10-20  cents  per  watt. 

Delphi  predictions  by  the  semiconductor 
industries  lie  in  the  range  of  13  to  26  cents 
per  watt. 

The  second  line  on  this  graph  is  a  represen¬ 
tation  of  the  market  line  for  ores  and  min¬ 
erals  -  all  the  way  from  imported  beryl 
(berylliut  oral  it  a  few  thousand  pounds  a 
year  to  sand  and  gravel  at  billions  of  tons 
per  year.  The  correlation  here  in  0.80  - 
still  a  good  fit  -  and  another  verification 
that  volume  and  market  value  are  related  ana¬ 
lytically. 

HIGH  PRODUCTION  RATE  EFFECTS 

The  next  type  of  cost  prediction  problem 
faced  on  SPS,  waa  the  determination  of  the 
Influence  of  production  rate  on  production 
unit  coats. 

In  the  aerospace  industry  we  typically  have, 
for  example,  production  rates  from  1  or  2  per 
year  to  at  most  a  few  hundred  units  per  year. 
Economic  principals  dictate  the  ratio  of  re¬ 
curring  to  non-recurring  funds. 

For  example,  the  lower  the  rate,  the  lower 
the  early  Investment  in  tooling  and  facili¬ 
ties.  Figure  6  illustrates  the  typical  unit 
production  improvement  curve  for  an  aircraft 
program. 


Vigors  6  -  Production  Cost  Baseline 


By  the  thousandth  unit,  most  of  the  non¬ 
productive  elements  under  that  improvement 
curve  have  been  eliminated  and  the  industry 
is  producing  efficiently,  economically  and 
profitably. 

The  bottom,  hatch  marked  area  is  the  "stan¬ 
dard  hour."  Those  hours  which  will  be  spent 
productively  in  producing  an  aircraft  - 
those  hours  required  to  do  the  Job  for  the 
designs  produced. 

The  magnitude  of  the  "standard  hour"  cost  is 
dictated  nor  only  by  design  complexity,  and 
customer  requirements  (specifications)  but 
also  by  the  amount  of  resources  dedicated  to 
the  production  process  -  tooling,  facilities, 
etc. 

Figure  7  illustrates  that  the  resource  dedi¬ 
cation  is  related  to  the  annual  production 
rate.  That  ia,  the  standard  hour  value  is 
directly  related  to  the  annual  production 
rate,  and  declines  along  approximately  a  702 
curve  as  one  goes  from  typical  aircraft  rates 
to  automobile  production  rates  in  vicinity  of 
106  -  107  units  per  year.  Note:  This  is  not 
a  "learning  curve." 


Figure  7  -  Economic  System  Simulation  - 

Mature  Industries  -  Production 
Rate  Effects 


This  is  a  production  rate  improvement  curve 
and  arises  because  of  the  willingness,  as 
rates  increase,  to  remove  design  and  produci- 
bllity  problems  by  the  early  dedication  of 
resources.  This  improvement  arises  purely 
because  of  the  economics  of  the  situation. 

How  can  we  use  this  information?  A  stepwise 
process: 

1)  Ws  predict  the  "standard  hour"  for  the 
system  at  typical  operating  rates. 
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2)  Then  we  apply  a  7CX  product  improvem,nt 
curve  to  detarnine  the  atandarda  houra 
at  the  higher  rate. 

POTENTIAL  IMPACT  ON  THE  U.S.  ECONOMIC  SYSTEM 


A  major  problem  to  be  addressed  Is  the  deter¬ 
mination  of  the  Impact  on  the  economy  that 
a  project  of  this  size  will  have. 

He  seek,  therefore,  answers  to  the  following 
questions: 

1)  How  big  will  the  investment  of  Industry 
and  government  have  to  be  In  order  to 
handle  a  transportation  job  this  large? 

2)  How  big  will  the  Investment  of  Industry 
and  government  have  to  be  to  develop 
the  production  capability  required? 

We  have  analyzed  the  relationship  of  "aasets" 
to  "revenue"  for  25  or  so  classes  of  Industry 
from  aerospace  to  electrical  utilities  to 
grocery  stores. 


1)  Industry  category 

2)  Number  of  Industries  considered/category 

3)  Range  of  assets  within  the  category 

4)  Total  asaeta  of  the  Industries  in  the 
category 

5)  Range  of  revenues  within  the  category 

6)  Total  revenues  of  the  Industries  in  the 
category 

7)  The  relationship  between  assets  and 
revenuea 

8)  The  correlation  coefficient  which  indi¬ 
cates  the  validity  of  the  original 
assumption. 

These  data  were  taken  from  Financial  World, 
July  15,  1976,  and  represent  companies  in  the 
top  500  profit  making  industries  (mature)  in 
the  U.S. 

The  cumulative  assets  and  revenues  of  the 
319  companies  represented  here  exceed  900 
billion  dollars,  more  then  a  third  of  the 
GNP . 


Table  1  la  a  list  of  those  industry  cate¬ 
gories.  The  columns  are: 


TABLE  1 


•HU  IWUSTHf  CHMWTtMSTICS  -  TOTAL  ASSETS  TO  T0T«t  KVBWE  ICUTIWCWS 


category 

MJHIER 

RANGE  ASSETS 

TOTAL  ASSETS 

UJIGC  WtMUfS 

total  riv. 

mwe. 

R l 

UTILITIES  (CENTRAL) 

27 

524.3  - 

6.534.2 

52.893.1 

196.5  - 

1,908.2 

17.229.7 

R 

0.30A  ♦.  50.3 

0.93 

UTILISES  (EASTERN) 

27 

633.1  - 

8,072.3 

78.158.7 

212.0  - 

2,880.3 

24,522.5 

R 

0.31A  ♦  15.1 

0.88 

UTILITIES  (EASTERN)*11 

2S 

633.1  - 

8,072.3 

66,821.2 

212.0  • 

2,206.3 

19,772.7 

R 

0.26A  ♦  100 

0.965 

UTILITIES  (WESTERN) 

IT 

715.4  - 

7,419.8 

23.270.6 

143.8  • 

2,646.7 

7.212.0 

R 

0.38A  -  143 

0.977 

AEROSPACE  (DIVERSIFIED) 

12 

340.7  - 

2,194.6 

16,768.8 

493.1  - 

5,166.3 

33.021.0 

R 

1.92A  -  245.1 

0.932 

AGR1C.  EQUIPMENT 

4 

1.114.3  - 

3.574.8 

9.887.5 

1,519.3  - 

5,488.1 

12,9)2.9 

R 

1 .494  -  443 

0.87 

AIR  TRANSPORT 

5 

1,151.6  - 

1.894.6 

7,529.6 

963.8  - 

2,037.1 

8,633.2 

R 

1 .20A  -  136 

0.67 

AIR  TRANSPORT  *21 

4 

1,151.6  . 

1,894.6 

6.226.9 

961.8  - 

2,037.1- 

6.807.7 

R 

1.53A  -  748 

0.956 

ALUMINUM 

4 

2,180.9  - 

3,569.5 

11,182.5 

1.851.9  ■ 

2,924.4 

9,516.0 

R 

0.76A  ♦  261 

0.986 

AUTO  l  TRUCK 

5 

1,048.3  - 

24,342.8 

50,013.9 

1,473.3  - 

47,181.1 

95,483.4 

R 

1.9a  -  306 

0.995 

POOD  PROCESSING 

26 

151.7  - 

2,128.9 

25,582 

212.5  - 

5,286.6 

53,050 

R 

2.4a  •  36$ 

0  85 

GROCERY  STORES 

6 

509.6  - 

1,709.0 

5,560 

2,115.8  - 

10,442.$ 

28,379 

R 

6.4M  -  1277 

0.92 

OFFICE/COMPUTERS 

10 

442.8  - 

17,723.3 

34.023 

539.2  - 

16,304.3 

32.405 

R 

0.9IA  ♦  146.5 

0.995 

OILFIELD  SERVICE  EQUIP. 

9 

295.1  - 

2,553.1 

9.041 

215.0  - 

*4,866.3 

11,134 

R 

1.70A  -  467.6 

0.869 

PACKAGING/ CONTAINERS 

6 

274.9  - 

2,195.2 

7.757.1 

394.0  - 

3,458.2 

10,363.4 

R 

1.24A  ♦  120.4 

0.909 

PAPER/FOREST  PA00. 

19 

152.7  - 

3,681.7 

26,062 

146.7  - 

3,540.6 

27,831 

R 

0.95A  ♦  164.8 

0.913 

ELEC.  EQUIPMENT 

20 

148.4  - 

12.049.7 

33.348 

275.2  - 

15.697,3 

44.834 

R 

1.27a  ♦  110.6 

0.994 

ELECTRONICS 

6 

475.0  - 

1,156.8 

4,963 

522.0  - 

1,723.6 

7.499 

R 

1.37a  ♦  113.4 

0.823 

MACHINERY  (HEAVY) 

18 

191.5  - 

3,893.9 

18,149.6 

169.9  - 

5,042.3 

24.625.2 

R 

1.2a  ♦  82 

0.958 

natural  GAS 

2$ 

298.1  - 

7,179.0 

41.061 

379.2  - 

6,423.4 

29.442 

R 

0.7a  «  97.2 

o.es 

OIL  (PETROLEUM) 

as 

368.0  - 

36,331.3 

190,924 

99.1  * 

48,631 

232,021 

R 

1.35a  -  779 

0.982 

STEELS  (INTEGRATED) 

9 

526.2  - 

9,184.5 

27,399 

690.0  - 

6,604,2 

27.535 

R 

0.94a  ♦  180.2 

0.984 

TELECON 

12 

589.7  - 

87,036.9 

129,125 

161,9  - 

32,815.6 

50,820 

R 

0.3M  ♦  173.4 

0.997 

1)1 
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We  have  plotted  the  correlation  coefficient, 
R2,  for  a  category  against  the  number  of 
industries  in  the  category  analysis  (Figure  8). 
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Figure  8  -  Correlation  Coefficient  va. 
Number  of  Industries  in 
Category 


With  the  exception  of  Point  A,  all  correla- 
tiono  were  in  the  range  from  0.80  to  0.995. 

Point  A,  with  R2  «  0.67,  represents  5  air- 
linen.  If  we  exclude  one  data  point  (Eastern) 
.he  correlation  between  assets  and  revenuea 
rises  to  R2  -  .96. 

In  "Eastern"  different? 

The  answer  is  yes.  The  value  of  the  A-300 
airbus  fleet  was  not  Included  In  the  asset 
statement  for  Eastern  Airlines. 

He  have  demonstrated  the  validity  of  the 
assumption  that  industries  develop  predictably 
-  to  nurvlve  and  expand,  money  must  be  invest¬ 
ed  -  increased  assets  are  required  to  increase 


Can  this  information  be  used? 

Yes.  An  analytic  expre  Ion  which  relates 
assets  and  revenues  car,  be  adapted  to  predict 
investment  costs  if  one  can  begin  to  structure 
the  other  variable  -  revenue. 

Let  me  illustrate  the  approach  - 


A  PREDICTION  OP  INDUSTRY  INVESTMENT  TO 
SUPPORT  SPS 


To  use  the  assets  -  revenue  equation  in 
attempting  to  size  the  impact  of  the  SPS 
program  on  the  economy,  we  must  know: 


1)  The  maximum  production  rate  of  satel¬ 
lites 

2)  The  cost  breakdown  by: 

a)  Satellite  production  coat 

b)  Ground  station  production  and 
installation  costs 

c)  Transportation  costs  to  orbit 
1  :  d)  Construction  costa  in  space 

For  the  examples  to  follow  I  have  used  a 
hypothetical  number  of  20  billion  dollars  per 
satellite  at  eeven  satellites/year  with  the 
..oct  categories  as  shown  in  Figure  9. 


Economic  Impact 

,  What  la  the  inveatment  required  by  Industry  and  government  to 
aisurt  economic  matunty  for  this  site  program 


Coat  figures  (example  for  calculations  only) 

1  Satellite  production  coat  (1)  6000 

2  Ground  receiving  nation  (2)  6000 

3  Satellite  ttanaport  costa  6000 

*  Satellite  -  In  apace  construction  -  2000 

Total  Unit  Coat  20,000 


Figure  9  -  Scenario  -  SPS  Rate  Hill 

Maximize  at  Seven  Units  per 
Year 


The  next  step  for  each  of  the  major  categor¬ 
ies  is  to  establish  the  "nature"  of  the  pro¬ 
duction  Job. 

Figure  10  illustrates,  for  example,  coats  of: 

500  million  for  the  multiple/common 
systems  on  the  satellite 

3000  million  for  the  solar  cell  blanket 

500  million  for  the  power  distribution 
system 

and  2000  million  for  the  microwave  trans¬ 
mission  system. 


wm 
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The  last  step  in  this  particular  exercise  ia 
to  use  the  revenue  generated  per  satellite 
for  each  Industry  category;  multiply  by 
the  rate  and  obtain  the  total  revenue  flowing 
through  each  industry  category/year  due  to 
the  solar  power  program  when  peak  rate  has 
been  reached.  Using  the  "market  line"  equa¬ 
tion  of  assets  to  revenue  we  can  than  calcu¬ 
late  the  asset  buildup  per  Industry  category. 
Sum  those  and  arrive,  in  this  case,  at  a 
figure  approaching  30  billion  dollars.  The 
results  for  this  example  are  presented  in 
Table  3. 


*CO#T  MJWMAI  lUUSTRATrV!  ONLY 


Table  3  -  Satellite  -  Revenue  by  Industry 
Category  for  Seven  SPS/Year 


Figure  10  -  Satellite  and  Ground  Systems 
Cost  by  Major  WBS  Elements 


The  third  step  in  this  exercise  is  for  each 
major  cost  category  (in  this  case,  satellite 
production  costs)  to  assign  the  cost  break¬ 
down  by  satellite  WBS  element  by  industry 
category  in  order  to  determine  the  amount  of 
revenue  (satellite  cost)  seen  by  each  indus¬ 
try  category.  This  la  demonstrated  in  Table  2. 
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Table  2  -  Satellite  Systema,  Production 
Coat  by  Industry  Category  per 
Satellite 


A  similar  set  of  calculations  for  the  ground 
systems  la  presented  in  Tables  4  and  5. 


Table  4  -  Ground  Systems  Production  Cost 
by  Industry  Category 


•  CCKI NUMMMAM  IlCUfTMTIVl  OM.V 


Rertenna  (2/at) 

Aerospace 

Electronics 

Elec 

Machinery 

Total 

Land 

- 

— 

— 

200 

Common 

2000 

400 

— 

2400 

Energy  Collection/ 
Conversion 

1000 

2000 

. — 

3000 

Power  distribution 

100 

100 

200 

400 

Total 

3100 

2500 

200 

6000 

For  example,  the  energy  conversion  systems 
par  satellite  would  provide  revenues  of; 


300  million  to  aerospace  category 
2500  million  to  electronics  industries 


and  200  million  to  electrical  machinery 
Industries. 
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Table  5  -  Ground  Systems 


Revenue  by  Imlwtfy  c«lc|iiry  for  7  SBS/yeai 


linJuviry 

Revenue  j 
per  $el  j 

Revenue 
per  year 

Citation 

Predicted 

.1100  1 

21.700 

R-  I.92A  •  245 

1 1.430 

1  lei  ironies 

'500  | 

17,500 

R-  1  J7A  »  II' 

12  691 

1  l<r  Machinery 

200  j 

1.400 

R-l  2JA4  111 

1,007 

1  "iat\ 

6000 

40.600 

25.12*  * 

bttf  I'lr  io»  fiywes uved  in  Ihh e».m|ile.  .well  nf  billion  unuW  be 
tm ill  I,p  by  imliistry  In  lundle  pccdiKliiiii  (obi  on  lhe  poond  wUem, 
f.  t  SPS  .1  |ienh  rale 


For  this  example,  assets  approaching  25 
billion  will  be  accumulated  by  industry  to 
support  the  ground  systems  production. 

The  transportation  costs  per  satellite  will 
generate  revenue  for: 

1)  The  aerospace  Industries  (airframes) 

2)  The  chemical  Industries  (propellants) 

3)  Ths  electronics  industries  (C^) 

4)  Something  akin  to  the  airline  indus¬ 
tries  (transportation  operations) 

The  data  is  prese  ted  in  Table  6. 


Table  6  -  Transportation  Revenue 
Earth  -  Leo  -  Geo 
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SELLING  PRICE  OF  SPS  POWER 


Finally,  let  me  take  a  cut  at  predicting  the 
Belling  price  of  power  derived  from  the 
assets/satellite,  the  availability  to  deliver 
power  as  a  percent  of  total  hours/year,  and 
an  equation  which  relates  revenues  to  assets 
for  the  typical  electrical  utility: 


First  -  Assets/satellite 
@  10X  of  cost 

Second  -  Availability 

Operating  hours 

Third  -  Kilowatt  hours/ 
year 

Fourth  -  Governing  equation 
(utilities) 

Fifth  -  Revenue 


10  billion 
902 

7890/year 


78.9  billion 

R  «  0.30A+50 
3.050  billion 


Finally-  Cost/kilowatt  hour  “  3.87  cents/kw  hr 


CONCLUSION 


Wlille  most  of  us  are  familiar  with  normal 
modes  of  cost  prediction,  e.g,,  learning 
curve  extrapolations  or  even  Delphi  techni¬ 
ques,  there  exist  problems  in  prediction  which 
defy  solution  by  "normal"  means.  In  particu¬ 
lar,  when  prediction  problems  arise  which 
involve  cost  projections  for  systems  which  lie 
over  the  economic  horizon,  we  must  use  method¬ 
ologies  which  are  consistent  with  the  fraction 
of  the  economy  involved  and  analytically 
derivable  relationships  which  arise  because  of 
market  factors.  The  mature  industry  approach 
is  such  a  methodology. 


ion  i»i*«iiAmt.i>*x»i«*»iw  «/xu*aati 

unmn  t«  nuMmfnMKHAmtmotmMmunnooKm 
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For  each  category  we  can  then  calculate  the 
revenue/industry/year  using  the  appropriate 
asset/revenue  equation  to  predict  assets 
approaching  28  billion  dollars  in  support  of 
tho  t-onsportatlon  tasks  for  SPS. 
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MEASURING  AND  PREDICTING  PRODUCTION  DISRUPTION 
COSTS  DUE  TO  DESIGN  UNCERTAINTY  AND  DELIVERY  URGENCY 

E.  8.  Cochran,  Management  Consultant 


Copyright  @  1978 
E.  B.  Cochran 


1 .  SUMMARY 


The  disruption  to  cost  and  delivery  often  found 
in  major  DoD  proqrams  usually  is  the  product  of 
two  factors.  First,  Is  the  inherent  uncertain¬ 
ty  of  development  work.  Second,  such  work  is 
performed  in  the  context  of  an  urgent  need  to 
deliver  production  units  to  the  military  cus¬ 
tomer.  The  same  factors  also  apply  to  the  rel¬ 
atively  less  frequent  disruptions  of  cotmercial 
products. 

This  paper  describes  the  result  of  further  re¬ 
searches  into  disruption  along  lines  outlined 
in  1977  by  a  paper  delivered  to  the  Sixth  DoD 
Acquisition  Symposium  [1].  One  project  pursued 
recently  i:  the  construction  of  an  interactive 
computer  moot1  for  the  disruption  process.  The 
Immediate  goal  i'as  to  predict  disruption  cost 
(in  terms  cf  proountion  manhours)  by  quantify¬ 
ing  their  dependence  on  uncertainty  in  the  de¬ 
velopment  phase  and  the  urgency  of  delivery 
dates.  Several  major  benefits  are  gained  by  a 
successful  effort:  more  realistic  appraisal  of 
the  cost  and  delivery  dates  for  a  major  program, 
both  before  go-ahead  and  during  its  conduct; 
improved  time-cost  tradeoff  analysis;  more 
effective  early-warning  of  cost  and  delivery 
difficulties;  and  more  objective  appraisa1  of 
the  facts  which  underlie  contractual  contro¬ 
versies  Involving  disruption.  An  interesting 
result  is  that  a  model  shows  far  greater  abil¬ 
ity  to  identify  and  measure  disruption  costs 
after  they  occur  than  is  provided  by  any 
accounting  system.  The  disruption  process  It¬ 
self  is  thereby  illuminated.  The  model  also 
appears  capable  of  Improving  the  accuracy  with 
which  responsibility  for  cost  overruns  and 
delivery  delays  can  be  assigned. 

Further  refinements  now  under  development  will 
facilitate  estimating  the  probable  range  of 
design  delays  and  changes  which  may  affect 
program  performance.  Presently,  the  model 
focuses  on  labor  hours  expended  In  a  long-cycle 
operation  producing  at  a  relatively  low  rate, 
while  Its  capacity  for  detailed  analysis  Is 
somewhat  limited  by  the  medl tin-sized  computer 
system  employed  to  date.  However,  the  princi¬ 
ples  and  techniques  used  lend  themselves  to 
other  production  structures  and  to  other  cost 
aspects  of  disruption,  such  as  labor  rates, 
overhead  and  material.  Substantial  programming 
has  also  been  done  to  develop  capability  to 
handle  more  intricate  problems  [6]. 


2.  INTRODUCTION 


The  Domestic  Environment 

It  is  hardly  news  to  state  that  neither  the 


political  leadership  nor  the  taxpayers  of  this 
country  are  in  a  mood  today  to  accept  greater 
government  expenses,  no  matter  how  justified. 
This  attitude  is  compounded  for  defense  ex¬ 
penditures,  where  technical  complexities,  long 
lead  times  and  philosophical  differences  weaken 
the  support  of  both  citizen  and  politician. 

Each  national  administration  begins  its  career 
with  clucking  over  what  it  considers  the  dis¬ 
graceful  overruns  perpetrated  by  Its  prede¬ 
cessor.  Every  few  years,  therefore,  we  have  a 
new  round  of  pontifi cation  over  the  heroic 
steps  to  be  taken  in  correcting  the  situation 
for  all  time.  The  current  pressures  are  in¬ 
tensified  by  a  mmber  of  unique  factors.  First 
is  a  milieu  of  social  change  and  great  politi¬ 
cal  sensitivity  to  it.  Second,  reaction  to 
Vietnam  has  not  yet  run  its  course,  and  our 
national  leadership  must  respond  to  continuing 
antagonism  toward  needs  expressed  by  the 
military.  Third,  there  is  a  national  realiza¬ 
tion  that  the  inherent  limits  to  growth  are 
forcing  the  United  States  toward  radical  re¬ 
allocation  of  resources  and  priorities. 

Fourth,  is  a  lowered  level  of  confidence  in 
the  judqement  and  pronouncements  of  public 
figures. 


The  DoD  Challenge 


In  the  midst  of  all  this,  the  DoD  grapples 
with  a  Brobdingnagian  management  task.  It 
facts  a  highly  determined,  technically  compe¬ 
tent  opponent  vrfilch  focuses  vast  and  increasing 
resources  consistently  on  its  long-range  impe¬ 
rialist  objectives.  In  the  last  decade  there 
has  been  serious  decline  in  our  military  capa¬ 
bilities,  both  relatively  and  absolutely,  and 
Important  erosion  of  NATO.  Despite  Intense 
competition  for  every  budget  dollar  from  other 
governmental  agencies,  CnD  must  deal  with  an 
unparalleled  rate  of  technological  development 
which  makes  costly  development  programs  a  way 
of  life.  These  often  contain  substantial  tech¬ 
nical  and  other  risks,  which  may  cause  serious 
discrepancies  between  plans  and  resui'-s. 

Recently,  for  example,  there  have  been  large 
Navy  overruns  and  related  bitter  confronta¬ 
tions  with  contractors.  The  Navy  is  certainly 
not  unique  in  this  respect;  there  is  no  dearth 
of  Air  Force  and  Army  experiences.  But  in  the 
current  domestic  environment,  it  was  perhaps 
inevitable  that  these  Navy  controversies  would 
stimulate  exceptionally  strong  political  reac¬ 
tion.  The  direct  effect  of  such  arguments  is 
serious  enough:  DoD  suffers  extended  program 
delays;  contractors  cannot  earn  a  decent  re¬ 
turn  on  their  Investment;  valuable  working 
relationships  are  eroded;  while  the  overruns 
and  delays  themselves  expand,  since  means  of 
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dealing  with  these  complex  situations  cannot  be 
worked  out  in  timely  fashion.  But  there  is 
more,  for  the  credibility  of  all  parties  to  the 
controversy  Is  degraded,  taxpayers  feel  frus¬ 
trated  and  political  leadership  feels  impelled 
to  take  "positive"  action.  And  so  now  we  hear 
that  major  long-range  Wavy  programs  are  being 
deferred,  cancelled  or  diluted.  No  one  knows 
how  far  the  effects  of  such  reaction  may  go. 

What  are  these  monumental  battles  about?  The 
outsider  only  sees  that  screams  of  "disruption" 
by  contractors  are  matched  with  charges  of 
"mismanagement"  by  the  llavy.  But  such  verbal 
jousting  Is  merely  the  tip  of  a  very  large  ice- 
bet  The  real  problem  is  the  failure  of  both 
sides  to  "f fe'-rlvely  understand  the  logic  of 
procurt me  c  . lit  h  involves  substantial  advance 
in  technology.  As  a  result,  there  are  unreal¬ 
istic  expectations  which,  despite  meticulous 
contractual  provisions,  make  massive  overruns 
and  schedule  delays  inevitable  and  produce 
complicated  disruption  controversies  which  cost 
much  time  and  money. 


Source  of  the  Problem 


In  ray  opinion,  this  lack  of  understanding  -  and 
communication  -  occurs  for  two  reasons.  First, 
the  phenomenon  of  disruption  itself  Is  by  far 
the  most  complex  problem  in  managerial  theory 
or  piactlce,  and  one  which  is  poorly  understood 
in  any  general  terms.  Second,  defense  product 
development  involves  the  roost  sophisticated 
cechr.ic.il  environment  possible;  it  is  on  area 
where  lift' a  can  be  learned  from  procurement 
manuals  and  whore  predictions  are.  fraught  with 
peril .  To  list  the  primary  questions  which 
repet tedly  surface  in  these  arguments  may  help 
show  the  difficulties: 

*  Whac  changes  really  occurred? 

°  Who  was  responsible? 

'  How  did  their  implementation  affect  cost 
and  delivery? 

°  Was  the  Implementation  timely  and 
efficient? 

®  Were  there  of  effects? 

0  What  did  th  y  >st? 

°  Were  good  management  practices  used? 

The  questions  seem  simple.  Actually,  they  raise 
profound  issue*.  Many  matters  of  fact  arise 
which  are  difficult  to  oofine  sharply.  Complex 
calculation*  nr*  needed  which  go  far  beyond  the 
objective  data  available.  Even  to  have  a  bare 
chance  to  find  answers  requires  that  the  under¬ 
lying  development  process  itself  be  woll  under¬ 
stood  by  the  partita  nr  odd*. 

But  ho  actual  practice  of  disruption  snalysin 
show-  little  evidence  of  progre*s  In  understand¬ 
ing  the  basic  issues.  For  example,  when  one 


reviews  contractor  methods  for  calculation  of 
disruption  claims,  one  is  struck  by  their  ad 
hoc  nature,  their  lack  of  fundamental  organiz¬ 
ing  principle,  their  inconsistency  of  approach 
from  one  case  to  the  next,  the  use  of  arbitrary 
technique.  One  senses  deep  confusion  in  these 
sad  but  earnest  attempts  to  explain  wh3t  are 
very  real  and  hurtful  situations,  and  such  con¬ 
fusion  invites  the  procurement  agencies  to  cut 
large  swaths  in  the  arguments.  The  agencies’ 
negative  responses  may  be  in  line  with  their 
responsibility,  but  they  do  little  to  clarify 
the-  realities  of  these  complex  situations. 
Meanwhile,  the  cloud  of  rhetoric  continues  to 


The  question  is  often  asked:  why,  with  all 
these  difficulties,  don’t  we  sim,  ly  reduce  the 
amount  of  overlap  or  concurrency  between  design 
and  development?  Why  make  something  before  it’s 
designed,  so  to  speak?  Where  would  General 
Motors  be  If  it  built  cars  this  way?  A  good 
question,  and  there  is  no  doubt  that  the  over¬ 
lap  should  be  at  an  absolute  minimum.  But 
there  is  another  side  to  the  coin.  Time,  too, 
is  a  resource,  and  DoD  cannot  always  afford  the 
luxury  of  a  leisurely  incremental  development 
program.  Further,  even  massive  overruns  may 
be  cheap  in  comparison  with  the  benefits  from 
earlier  delivery,  many  of  them  hard  to  quantify, 
CSA’s,  SRAM's  and  DD963's  are  not  Chevtolets, 
nor  even  Cadillacs. 

In  short,  concurrency  will  always  play  a  part 
in  DoD  acquisition  policy.  The  question  is, 
how  much  of  a  part?  To  answer  ’.his  requires  n 
new  approach. 


A  Modest  Proposal 


The  time  has  come  to  recognize  formally  that 
urgent  procurement  contracts  requiring  new 
technology  will  always  suffer  what  we  now  term 
"disruption".  It  may  help  to  define  that  term: 
disruption  costs  are  those  which  exceed  the 
costs  which  are  necessary  under  orderly  and 
predictable  conditions  of  design,  development 
and  entry  inro  production.  Merely  to  state 
tliis  tells  us  rb.it  few  significant  new  DoD 
programs  will  be  free  of  disruption.  The  costs 
of  disruption  can  easily  run  a  quarter  of  those 
for  an  entire  procurement  cycle,  and  an  even 
greater  ratio  for  the  pure  development  stage. 
That  being  so,  we  must  establish  realistic 
methods  by  which  to  predict  their  magnitude 
and  minimize  the  effects  when  they  occur. 

This  rmy  sound  suspicious;;  'Ike  Just  another 
call  for  better  management  procedn  a  subject 
which  has  received  much  attention  without  per¬ 
manent  success.  But  it  is  not  that  at  all. 
Rather,  it  calls  for  a  different  approach 
entirely,  one  which: 
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weeks. 


°  Accepts  the  potential  for  cost  overrun, 
though  with  intense  effort  to 
minimize  it; 

3  Requires  a  realistic  assessment  of  it; 
and 

*  Makes  this  philosophy  workable  by  using 
specific  methods  to  estimate  delay 
and  disruption  effects. 

The  first  two  items  of  this  proposal  are  found¬ 
ed  on  a  theory  of  disruption  presented  at  the 
Sixth  Annual  DoD  Acquisition  Research  Sympos¬ 
ium  (1).  The  third  introduces  a  computer 
modeling  procedure  briefly  described  by  the 
earlier  paper,  which  now  has  been  developed 
sufficiently  to  demonstrate  the  realism  and 
accuracy  of  the  approach.  The  crucial  step  is 
to  focus  attention  on  high-risk  areas.  This 
allows  us  to  estimate  the  possible  range  of 
cost  overrun  and  delivery  slippage.  Currently, 
the  emphasis  is  on  production  delivery  and 
labor  hours.  Related  modeling  procedures  are 
being  developed  to  allow  better  prediction  of 
the  pattern  of  design  delays  and  changes,  and 
effects  on  other  production  cost  items. 


Benefits  and  Cautions 


There  are  four  major  benefits  of  this  new 
philosophy.  First,  it  encourages  far  more 
realistic  consideration  of  a  proposal  to  under¬ 
take  a  new  program  -  since  attention  centers 
directly  on  the  potential  for  delay  and  disrup¬ 
tion.  Second,  the  model  itself  can  also  esti¬ 
mate  potential  savings  from  relaxation  of 
urgent  delivery  schedules  or  reduction  of 
design  risk,  or  the  opposite.  This  lends  real¬ 
ism  both  to  the  initial  evaluation  and  to  sub¬ 
sequent  status  reviews.  Third,  the  model's 
ability  to  quickly  translate  design  disruption 
into  production  cost  and  schedule  effects  per¬ 
mits  the  establishment  of  effective  early  warn¬ 
ing  procedures.  This  elor.a  Justifies  careful 
consideration  of  the  approach.  Fourth,  custom¬ 
er  and  contractor  can  Jointly  address  the 
effects  of  design  delays  and  changes, and  of 
schedule  revisions,  in  a  far  more  objective 
manner.  This  should  help  to  resolve  questions 
concerning  potential  disruption  effects  before 
they  expand  to  dominate  the  procurement  re¬ 
lationship.  Incidentally,  the  model  should  also 
be  an  unusually  effective  general  estimating 
tool. 

While  the  benefits  are  important,  we  must  exer¬ 
cise  some  caution.  First,  we  cannot  expect  in¬ 
stant  results.  The  construction  of  a  reasonable 
model  for  a  major  program  takes  time  and  money, 
even  though  modular  interactive  cecnnlques  were 
designed  into  the  first  r-ajor  sopllcation. 
Eventually,  of  course,  it  nay  be  feasible  to 
have  a  family  of  such  models  on  line,  which  may 
be  adapted  to  a  new  proposal  in  a  few  days  or 


Second,  once  a  program  has  been  decided  on, 
the  funds  related  to  the  estimate  of  potential 
disruption  costs  should  not  be  made  easily 
available  to  the  contractor.  For  they  would 
then  be  simply  considered  part  of  the  normal 
budget  and  spent  aa  a  matter  of  course.  There 
would  effectively  be  little  or  no  provision 
for  the  unplanned  costs  which  might  well  de¬ 
velop  later.  Obviously,  there  should  be  no 
reduction  in  the  efforts  to  minimize  disrup¬ 
tion  by  good  management,  development  incremen¬ 
talism  or  otherwise.  To  recognize  the  proba¬ 
bility  of  disruption  in  a  given  case  cannot  be 
considered  a  license  to  spend  the  money. 


3.  DESIGNING  THE  MODEL 


We  shall  begin  with  a  brief  look  at  an  ideal¬ 
ized  version  of  the  labor  hour  pattern  typical 
of  disrupted  production.  Exhibit  1  shows  such 
a  pattern,  developed  in  1959  by  the  author, 
which  he  dubbed  the  "S-curve"  [2).  Tne  base¬ 
line  for  this  example  is  an  ordinary  improve¬ 
ment  curve  of  85  percent  slope,  while  the 
bulged  area  above  it  represents  costs  due  to 
disruption.  The  size  of  the  bulge  varies 
according  to  what  may  be  broadly  termed  "lead- 
time"  or  "phase  overlap"  conditions. 

Now  the  disruption  mechanism  is  extraordinarily 
complex.  It  originates  with  production  delays 
and  task  changes,  and  evolves  through  the 
interrelationship  of  drawings,  production 
processes  and  vendor  activities.  The  overall 
effect  may  be  inferred  from  comparison  of 
actual  hours  with  a  suitable  benchmark  or 
"should-cost",  but  the  details  simply  cannot 
be  measured  directly  by  any  accounting  system. 
So,  as  a  first  approach,  we  might  examine  the 
leadtime  conditions  for  a  specific  case.  We 
may  then  estimate  their  effect  on  hours  by 
comparison  with  experience  on  other  programs 
[3:  155-200).  Interactive  computer  programs 
have  been  developed  to  facilitate  this  esti¬ 
mating  procedure. 

When  the  necessary  dsta  is  available,  the  pro¬ 
cedure  is  rapid,  inexpensive  and  reasonably 
accurate.  Unfortunately,  data  is  usually  hard 
to  come  by  or  the  conditions  of  a  new  program 
may  differ  widely  from  prior  experience.  It 
is  therefore  useful  to  develop  a  method  which 
does  not  depend  on  such  specialized  records 
and  which  is  more  adaptable  to  new  conditions. 
This  requires  detailed  calculations  which  focus 
on  the  more  significant  events  -  actual  or 
forecasted  as  appropriate  -  and  attaches  costs 
to  them  which  reasonably  replicate  their 
effects  on  operations.  Such  an  approach  is  far 
too.  complex  for  any  but  a  computer  modeling 
procedure. 


The  model  Itself  Is  developed  on  an  Interactive 
computer  program  which  allows  the  user  to  enter 
appropriate  design,  production  and  schedule 
characteristics  under  careful  scrutiny.  Exhibit 
2  provides  a  brief  flow  chart,  to  aid  in  ex¬ 
plaining  the  procedure.  In  view  of  the  shape 
of  the  disruption  labor  cost  pattern,  the  model 
is  sometimes  termed  an  "S-curve"  model. 


Basic  Provisions 


The  first  step  is  to  describe  the  production 
process.  This  incorporate'!  the  usual  prede¬ 
cessor-successor  relationships  found  in  PERT 
networks,  but  also  allows  for  considerably  more 
sophisticated  relationships  between  the  states 
of  completion  of  any  two  or  more  basic  activi¬ 
ties.  Exhibit  3  diagrams  the  situation  for  the 
model  being  presented  here.  For  each  unit 
there  are  ten  major  workcenters,  each  subject 
to  several  constraints.  In  total,  for  all  units 
covered  by  this  analysis  there  were  over  500 
constraints. 

The  second  step  calls  for  parameters  of  the 
production  facility  it«elf,  Including  its 
resource  capacities  an-1  growth  rates:  manpower 
by  skill,  facilities,  storage  space,  etc.  These 
>nrameters  also  constitute  significant  con¬ 
straints  on  facility  capacity  to  deliver  units, 
and  pressure  on  them  generates  cost  penalties. 

Third,  characteristics  oc  the  product's  cost  are 
entered  for  each  workcenter,  such  as  their  basic 
cost  level,  optimum  crew  site  and  improvement 
slope.  Reliable  estimates  of  the  basic  or 
"should-cost"  must  be  used,  since  they  affect 
the  interface  between  the  production  process 
and  the  facility's  limits.  After  considerable 
experience  with  parametric  estimating  tech¬ 
niques  (5),  I  feel  they  are  very  helpful  in 
establishing  the  model's  should-cost  data, 
provided  the  results  are  properly  matched  to  the 
facility  in  which  they  will  be  applied.  This 
phase  of  model  development  is  crucial  in  getting 
accurate  results,  and  may  require  extensive 
study  if  suitable  data  is  not  immediately  avail¬ 
able.  It  is  also  Important  to  consider  the 
degree  to  which  the  usual  cost  estimating  pro¬ 
cedure  incorporates  factuto  which  will  also  be 
measured  by  the  cost  penalty  factors  discussed 
below.  The  modeling  method  reveals  -  perhaps 
for  the  first  time  -  the  degree  to  which  ordi¬ 
nary  cost  judgements  are  effected  by  such 
factors. 

Fourth,  the  master  schedule  of  deliveries  is 
entered,  together  with  appropriate  "drop  dead" 
dates.  Using  the  network  pattern,  cost 
characteristics  and  design  delays,  the  program 
translates  the  master  schedule  Into  subordinate 
schedules  for  the  various  components.  This  data 


will  be  of  great  importance  In  determining  the 
amount  of  "crashing"  required  to  meet  schedules, 
and  the  associated  cose  penalties. 

Fifth  is  data  on  the  direct  effects  of  design 
uncertainty.  As  one  item,  delays  in  9tart 
dates  for  major  tasks  may  be  entered,  together 
with  expected  times  to  develop  the  necessary 
drawings.  The  model  will  then  determine  the 
earliest  possible  start  and  coopiate  dates. 

In  turn,  those  dates  are  compared  with  master 
schedule  requirements  to  define  Che  degree  of 
production  delay.  Another  group  of  entries 
concerns  the  timing  and  magnitude  of  design 
changes,  with  their  effects  on  lost  learning, 
on  rework  and  retrofit  activities  and  on  un¬ 
changed  work  (both  on  the  imsediace  cask  and 
on  others).  There  is  also  the  matter  of  gener¬ 
al  design  "turbulence",  which  produces  signifi¬ 
cant  rolling  obsolescence  without  necessarily 
causing  noticeable  growth. 

Sixth,  tuo  characteristics  of  the  labor  force 
are  required.  One  is  the  quantity  of  each 
skill  available  in  the  company  and  in  Che 
community.  Those  in  the  company  must  further 
be  described  in  terms  of  their  seniority 
structure,  and  both  groups  in  terms  of  their 
skill  level,  or  the  amounts  of  training  needed. 
The  second  describes  the  headcount  shrinkage 
for  each  seniority  layer  of  personnel  as  It 
continues  employment  over  time.  Such  shrinkage 
can  have  enormous  effect  on  the  disruption  costs 
to  be  computed  later,  and  care  should  be  taken 
in  developing  this  data. 


Cose  Penalty  Functions 


A  number  of  cost  penalty  functions  are 
essential  to  achieving  the  purpose  of  this 
model.  These  reflect  the  situations  which 
develop  during  production  under  disrupted  con¬ 
ditions,  and  during  periods  of  startup  and 
phaseout  of  operations.  The  model  uses  them 
to  estimate  the  cost  effects  of  those  abnormal¬ 
ities.  The  most  important  items  are  very 
briefly  summarized  below. 

Reductions  in  flow  time  arc  often  initiated  to 
compensate  for  design  delays  or  unexpectedly 
long  flow  times  in  predecessor  activities. 

This  may  produce  over-staffing  with  several 
types  of  inefficiency  resulting.  Multiple 
crews  (second  line  or  shift,  etc.)  will 
further  reduce  efficiency  by  diluting  the 
learning  curve.  At  the  same  time,  design 
delays  or  bottlenecks  elsewhere  may  require  a 
slowdown  of  work  In  a  given  workcenter.  Tills, 
too,  will  create  Inefficiencies  of  several 
types.  Important  inefficiencies  are  generated 
by  the  need  to  train  each  group  of  people 
newly  introduced  into  the  labor  force,  both 
during  the  manpower  buildup  phase  and  as  a 
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effects  generate  extra  labor  hours.  This 
modeling  method  explicitly  makes  such  dis¬ 
tinctions. 

The  ultimate  test  of  a  given  model  lies  In  its 
ability  to  reproduce  many  complex  events  in  a 
convincingly  realistic  manner.  As  we  shall 
sec,  this  model  meets  that  test.  There  is 
e'iery  reason  to  anticipate  a  similar  result  for 
other  applications. 


4.  OUTPUT  OF  THE  i'lODEl, 


THe  program  will  now  develop  an  estimate  of 
program  labor  hours.  Relevant  time-phased 
comparisons  between  projected  and  budgeted 
(or  actual)  hours  are  made.  The  differences 
are  identified  with  the  various  sources  and 
types  of  disruption  as  computed  by  the  model. 

The  analyst  may  then  adjust  the  model  para¬ 
meters,  to  play  "what  if"  games.  Using  the 
program's  interactive  features,  he  can  explore 
such  questions  as  the  cost  effect  of  various 
design  delays,  production  acceleration  rates, 
design  change  policies,  major  make-buy  decis¬ 
ions,  etc.  He  may  also  examine  the  effect  of 
different  cost  functions  for  specific  types  of 
disruptive  events.  Upon  command,  the  model's 
results  may  be  displayed  in  the  form  of  colored 
charts  on  a  CRT  terminal.  This  curther  facili¬ 
tates  prompt  evaluation  of  the  model's  pre¬ 
dictions  and  modification  of  scheduling  and 
production  policies. 


result  of  turnover.  Seasonal  factors  may  play 
a  part  when  work  is  done  outside  or  when  it 
affeits  the  nvuilabllity  of  new  personnel  or 
the  turnover  of  existing  staff. 

Many  of  these  events  may  also  create  unplanned 
interferences  between  crews  and  semi-finished 
work  due  to  space  limitations,  and  require 
sequence  changes  and  general  di scombobulation 
of  orderly  procedure. 

What  wc  term  "phasing"  effects  are  of  great 
Importance.  Of  relatively  small  Impact  under 
well-controlled  conditions,  they  can  climb  to 
.>ubs‘.intial  proportions  when  design  uncertainty 
and  v'ivery  urgency  exercise  their  opposing 
pressure  .  1  -tup  costs  are,  of  course,  at 

the  from  end.  they  mav  add  from  five  to 
twenty  percent  to  basic  labor  hours  for  early 
production,  depending  on  the  circumstances. 
Startup  is  sometimes  estimated  by  use  of 
improvement  curves, but  actually  must  be  added 
to  whatever  basic  cost  level  is  established. 
Phaseout  cost6,  often  called  "tailup",  have 
long  been  recognized  by  a  number  of  industries. 
Any  thoughtful  consideration  reveals  its  con¬ 
siderable  complexity  [4],  as  it  varies  wf -h 
the  prospeotu  of  other  assignments  for  tiie 
workmen,  the  rate  of  labor  reduction  (which 
ma>  cause  bumping  and  reassignment) ,  and  the 
effect  of  low  output  levels  which  generate  In¬ 
efficient  use  of  tooling  and  facilities. 

Erratic  workloads  result  from  design  changes 
and  deleys  and  their  ripple  effects,  as  well 
as  from  other  disruptive  events.  This  requires 
managers  to  keep  people  that  are  not  being 
fully  utilLzed,  in  anticipation  of  peaks  which 
lie  jusr  aluad.  Lastly,  important  anticipa¬ 
tion,  csrrvover  and  compounding  effects  can 
develop  ■'rom  all  these  situations. 

.’bile  the  penalty  functions  are  mathematical 
in  format,  for  each  one  the  user  need  only 
enter  a  simple  percent  penalty  for  a  specific 
ease.  Such  decisions  should,  of  course,  in¬ 
corporate  all  the  experience  available.  How¬ 
ever,  obtaining  reliable  detailed  measurements 
of  disruption  coats  is  a  practical  impossibil¬ 
ity.  Thus,  the  effect  of  these  functions 
heavily  depends  upon  r’  Judgement  of  experi¬ 
enced  managers  and  es.  .atora. 

If  this  gives  pause,  recall  that  the  only 
estimate  not  heavily  based  on  judgements  are 
those  prepared  for  new  lots  of  a  firm  design 
currently  In  production.  This  is  a  t-lvlal 
estimating  problem.  Any  estimate  of  real  im¬ 
portance  requires  substantial  Judgement.  The 
broad  judgements  normally  used  to  prepare  a  ma¬ 
jor  product  plan  grossly  understate  the  cost 
la-pact  of  design  uncertainty  and  schedule  com¬ 
pression.  An  important  reaoon  is  that  such 
Judg-  Tents  do  not  separate  two  distinctly 
ditf*“cnt  types  of  event:  first,  the  impact  of 
■lenlm  uiyert.iinty  on  piod-ict  ion  startup; 
utwoM  I,  the  pro,  Inu  msunot  In  which  those 


In  summary,  the  model  matched  ictual  results 
very  closely,  both  in  tots!  and  in  considerable 
detail.  Exhibit  4  shows  results  on  a  monthly 
basis;  tire  model  projected  monthly  values  to 
within  an  average  of  seven  percent.  The  per¬ 
formance  was  a  bit  worse  in  later  months,  where 
data  on  changes  and  delays  was  also  a  bit  weaker, 
l’erformnnce  on  a  task  basis  is  indicated  by 
Exhibit  5.  This  3hows  each  of  the  five  large 
units  involved,  with  the  work  segregated  into 
the  two  main  types  -  structural  and  non-struc- 
lural.  Again,  the  agreement  is  excellent,  and 
that  continues  to  be  so  as  we  delve  deeper. 
Naturally  there  ’*  some  widening  of  the  differ¬ 
ence  between  calculated  and  actual  hours  as  we 
BP  to  smaller  segments  of  the  program. 

This  close  agreement  is  even  more  impressive 
when  we  apply  the  model  to  the  circumstances 
of  the  contract.  With  a  substantially  lower 
design  cost  and  a  much  tighter  production  cycle, 
the  model  was  still  able  to  match  the  estimated 
should-cost  very  closely,  in  quantitative 
terms,  the  model  separately  repllc.,Lad  ns- 
bulit  and  as-contracted  costs  which  were  in  the 
ratio  of  2.5  to  one.  There  were  also  numerous 
confirmations  of  the  as-built  model’s  accuracy 
fiom  other  studies,  and  further  support  from 
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the  agreement  with  actual  and  as-contracted 
workflow  statistics. 


duce  far  better  evaluations  of  responsibility 
for  disruption  costs. 


Estimated  disruption  hours  amounted  to  some 
forty  percent  of  actual  hours  incurred  on  this 

program.  Their  distribution  by  type  was  as  Further  Extension  of  the  Model 

follows : 


Our  approach  may  be  extended  to  incorporate 

Phasing  1  Z  the  network  of  key  design,  test,  tooling. 

Change  Effects  30  facility  and  procurement  activities  which  pre- 

Personnel  24  cede  the  start  of  production.  This  will  allow 

Task  Distortion  9  specific  analysis  of  the  potential  for  design 

Task  and  Crew  Variability  13  delays  in  selected  high-risk  areas,  as  well  as 

Interaction  23  the  possible  effect  of  alternative  development 

'  .  paths.  Using  a  stochastic  approach,  we  could 

100  7.  estimte  the  probability  of  specific  production 

slippages  due  to  design  delays  and  changes 
arising  from  the  uncertainty  inherent  in  the 
new  technology  of  a  given  program.  The  re- 
The  phasing  item  represents  the  degree  to  which  mainder  of  the  model  will  then  estimate  the 

the  model's  tailup  calculation  exceeded  the  corresponding  cost  effect.  Such  a  capability 

should-cost  allowance.  Change  affects  repre-  is  now  under  development, 

sent  the  lo89  of  learning  due  to  design  and 

methods  changes,  plus  the  impact  on  methods  and  Development  of  similar  models  for  varying 

crew  assignment,  ripout  and  retrofit  costs  and  types  of  production  processes  offers  no 

the  effect  of  changes  on  unchanged  work.  Ail  special  difficulty.  It  does,  of  course, 

are  computed  ly  the  model  in  great  detail  require  the  analyst  to  develop  the  network 

following  est:  mated  parameters  provided  to  it.  structure  and  data  on  capacities,  basic  costs, 

Personnel  disruption  represents  excess  hours  etc.,  and  to  adapt  the  penalty  functions  to 

for  training,  crowding  of  crafts  and  the  cumu-  the  new  situation.  Such  work  Is  facilitated 

lative  effect  of  over-manning  on  the  rate  of  by  the  interactive  procedural  provided  by  the 

learning  for  ilpecific  tasks.  Distortion  com-  computer  program, 

prises  the  effect  on  current  efficiency  of  com¬ 
pression  or  stretchout  of  tasks.  Variability  Further  modification  to  include  overtime 

measures  the  effect  of  rapid  fluctuations  in  premium  and  escalation  of  labor  rates  is 

task  workloads  and  in  the  demands  made  of  the  relatively  simple.  Expansion  to  reflect  over- 

various  crafts;  these  require  the  plant  to  head  and  material  costs  is  certainly  feasible, 

maintain  personnel  levels  above  those  strictly  hut  could  get  very  complex  if  it  were  to  en- 

required  for  the  work  at  hand.  The  interaction  tail  the  construction  of  a  detailed  model  of 

category  is  the  result  of  a  month-by-month  and  the  company’s  organization  structure  or  vendor 

task-by-task  computation  of  disruption  com-  relationships.  We  have  done  financial  model¬ 
pounding  and  carryforward  effects.  ing  work  which  has  considerable  application 

here,  but  our  thoughts  concerning  the  degree 

These  effects  were  studied  on  a  unlt-by-unit  detail  required  are  still  being  formulated, 

basis  as  shotm  by  Exhibit  6.  Again,  the  results 
are  generally  reasonable  in  relation  to  the 
facts  of  this  case. 
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5.  CONCLUSION 


While  we  have  not  yet  employed  the  model  for 
this  purpose,  it  seems  logical  that  it  would 
prove  helpful  in  determining  the  responsibility 
for  disruption  costs.  This  murky  and  delicate 
subject  is  sometimes  addressed  by  critical-path 
analysis.  But  CPM  techniques  focus  entirely  on 
time  and  fail  to  consider  either  the  effect  of 
resource  constraints  or  the  multiple  and  inter¬ 
active  consequences  of  a  disruptive  event. 

Since  this  modeling  technique  gives  a  more  real¬ 
istic  representation  of  events,  it  should  pro- 
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AN  INVESTIGATION  OF  CHANGES  IN  DIRECT  LABOR  REQUIREMENTS 
RESULTING  FROM  CHANGES  IN  AIRFRAME  PRODUCTION  RATE 

Lieutenant  Colonel  Larry  L.  Smith 
Air  Force  Institute  of  Technology 


INTRODUCTION 


Ongoing  airframe  production  programs  sometimes 
experience  a  required  change  in  production 
rate  due  to  program  stretchouts  or  accelera- 
ti  -i*  These  rate  changes  are  occasioned  by 
.-uc I  act:  ns  us  budget  changes,  requirements 
ihongci  <  •  'ost  growth.  For  example  if  cost 
growth  -  •>.  j  .  he  planned  annual  funds  expen¬ 
diture  will  ue  exceeded.  To  prevent  exceeding 
annual  budget  iimits,  production  is  stretched 
out  ->o  lower  airframes  are  produced  in  the 
budget  year.  If  changes  in  airframe  produc¬ 
tion  rare  cause  important  changes  in  unit  coot, 
there  is  a  need  to  be  able  to  assess  this  cost 
impact  sc  that  ai.  equitable  contract  adjust- 
rent.  can  b»  made. 

In  an  earlier  paper  [l],  the  results  of 
research  into  the  impact  of  a  production  rate 
change  on  the  direct  labor  portion  of  air¬ 
frame  production  cost  was  reported  [2].  An 
extension  of  the  learning  curve  approach  was 
U3ed  to  examine  empirical  data  from  F-h,  F-102 
ar.i  K‘-l7.‘i  uirframe  production  programs.  The 
apprcKr  included  cumulative  airframes  and 
production  rate  83  independent  variables  and 
aire-t  labor  hours  per  Defense  Contractor 
i'iar.nmf  Report  iDCPR)  pound  as  the  dependent 
var loo 1  * • 

ft  was  found  that  the  production  rate  ex¬ 
plained  a  small  but  important  amount  of  the 
variation  in  the  direct  labor  requirements. 
Furthe-nore,  the  extended  approach,  with  both 
curjula!  1 /"  pi  eduction  and  production  rate  a3 
drivers,  predicted  direct  labor  requirements 
L"t.‘er  thin  the  standard  learning  approach 
v I '  ■  r.iv  cure' at  ive  pioduction  as  a  driver. 

In  1977,  Congleton  and  Kinton,  with  the  author 
as  en  advisor,  -enlicated  the  research  summar¬ 
ized  above.  Product  <’  from  F-5/T-38  air¬ 
frames  were  used  to  **  the  procedures.  This 
pap":  deso-ibes  sine  >,  their  findings  which 
msentlaily  validate  the  original  work  [33- 
First,  a  d"Scriptioti  of  the  research  is 
advanced.  Then  findings,  conclusions  and  some 
observations  are  presented. 


THE  THEORY  AND  THE  RESEARCH 


That  the  production  rate  is  an  important 
d>*t,ei -Inant  of  cost  is  an  Intuitive  observa- 
ti >n  It  follows  from  our  industrial 
novo  :tJo;,  heritage  of  higher  productivity  a- 
a ir  .ivided.  That  f.  change  in  th" 


production  rate  will  produce  a  change  in  the 
direct  labor  requirements  follows  from  the 
first  observation.  One  would  expect  an 
exogeneous  production  rate  increase  to  decrease 
direct  labor  hour  requirement  for  c  number  of 
reasons.  One  is  that  a  higher  rate  of  produc- 
-  "houid  allow  for  further  assembly  speci¬ 
alization  tn—.  avoiding  time  lost  in  switching 
from  one  task  to  another.  A  second  reason  is 
that  a  higher  production  rate  chi'.ld  allow  the 
spreading  of  batch  fabrication  s«  -ur  charges 
over  a  larger  number  of  units.  If  higner 
rates  lead  to  lower  costs,  one  might  also 
expect  that  lower  rates  of  production  would 
cause  an  increase  in  the  direct  labor  reouire- 
ments  t  produce  airframes. 

Ih  airframe  manufacture,  the  production  rate 
can  be  expressed  in  a  number  of  ways.  One 
method  used  in  the  study  was  to  divide  the 
number  of  airframes  in  a  production  lot  by  the 
time  spBn  over  which  airframes  were  delivered 
for  that  lot.  Thus  the  researcher  reeded  only 
the  lot  size  and  the  aircraft  acceptance  dates 
to  calculate  the  delivery  rate  proxy. 

Given  a  method  for  expressing  the  production 
rate,  one  needs  to  incorporate  '■his  variable 
into  a  procedure  for  evaluating  md  predicting 
its  impact  on  direct  labor  requirements.  The 
works  of  Ornini  [L : 7lJ  ard  Noah  [bblj  sug¬ 
gested  that  the  productic  1  rate  could  logically 
be  combined  with  cumulative  p'oduction  in  a 
multiplicative  model  of  the  form  y  =  AX’^xj*- 
where:  the  dependent  variable  y  represents 
some  direct  cost  indicator  such  as  direct 
assembly  hours  per  DCPR  pound  for  a  particular 
lot  of  airframes,  the  independent  variable  X3 
represents  cumulative  airframes  p. iduced  and 
the  independent  variable  xp  is  some  proxy  for 
the  production  rate.  A,  B,  and  C  represent 
coefficients  in  the  model.  This  model  is 
simply  an  extension. of  the  standard  learning 
eurve  model,  y  =  Ax'*.  The  multiplicative 
rcdel  described  above  was  used  in  the  original 
and  the  rppii-ot  1  research  efforts. 

The  data  for  replication  of  the  original 
effort  were  from  the  F-5/T-30  airframe  produc¬ 
tion  program.  The  data  were  stratified  by 
fabrication,  assembly  and  total  manufacturing 
entef  ies  as  well  as  the  different  models 
that  were  produced.  Ihe  researchers  examined 
lb  different  combi  oat  i  >p, .  of  the  data  by 

regression  analysis  in  ordet  t. . a’nate  the 

ability  of  the  procedure  to  oxpin  .ariat.ion 
in  the  dependent  variable.  A  sample  data  set 
*s  Include.,  in  Table  1 
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TABLE  1 


SAMPLE  DATA  SET 


AVERAGE 

ASSEMBLY 

CUMULATIVE 

MONTHLY 

CASE 

HOURS  TER 

PRODUCTION 

DELIVERY 

(LOT) 

DCPR  POUND 

PLOT  POINT 

RATE 

y 

X1 

x2 

16 

1.85 

382.0 

13.5 

17 

1.8? 

1*32.0 

21*.  0 

18 

1.79 

502.0 

33.3 

55 

0.76 

1*1*95.0 

16.1* 

!?6 

0. 71* 

1*558.5 

17.2 

57 

0.75 

1*701.0 

12.6 

In  addition  to  examining  the  explanatory 
ability  of  the  procedure,  the  researchers  also 
looked  at  itn  predictive  ability.  This'  was 
accomplished  by  truncating  the  most  recent 
year's  data  from  each  data  combination  or  data 
set.  After  developing  model  coefficients  for 
the  remaining  data  through  regression  analysis, 
•v-  the  known  but  unused  data  that  had  been  trun¬ 

cated  were  predicted.  The  forecasts  and  the 
actuals  were  then  compared  as  a  measure  of 
accuracy.  This  technique  was  used  for  both  the 
standard  learning  curve  procedure  and  the 
expanded  procedure  to  add  a  dimension  to  the 
comparison. 


FINDINGS  AND  CONCLUSIONS 


The  study  confirmed  that  the  production  rate  is 
an  important  variable  in  explaining  variation 
in  airframe  direct  labor  hour  requirements. 
Although  less  powerful  than  the  cumulative 
airframe  variable  (learning  curve  independent 
variable)  the  production  rate  variable  was 
found  to  be  statistically  significant  for  all 
combinationa  of  the  test  data.  These  include 
fabrication  and  assembly  as  veil  as  total 
direct  manufacturing  labor  hours  per  DCPR 
pound  [3:92]. 

The  concept  of  the  procedure  can  be  depicted  as 
In  Figure  1,  a  graphical  representation  of  one 
data  set.  The  downward  slope  of  the  curve 
reflectn  the  decreasing  cost  relationship  of 
the  standard  learning  curve  while  the  pertur¬ 
bations  in  tne  curve  reflect  the  "fine  tuning" 
effect  of  changing  production  rate  between 
Individual  lote  of  production.  The  "B" 
coefficient  Is  relatively  larger  than  the  "C" 
coefficient.  Thie  reflects  the  greater 
strength  of  cumulative  learning  as  compared  to 


the  production  rata  as  drivers  In  the  tsodej. 


GRAPHICAL  REPRESENTATION  OF  ONE  DATA  SET 
FICURE  1 


As  anticipated  from  the  theory,  the  procedure 
predicts  that  an  exogeneous  increase  in  the 
production  rate  will  result  in  a  direct  labor 
requirement  decrease.  A  corresponding 
production  rate  decrease  will  predict  a  labor 
Increase.  There  was  no  confirmation  that  the 
approach  was  better  for  one  of  the  three  data 
set  stratifications,  fabrication,  assembly  or 
total  hour*.  In  fact,  the  statistics  gave 
mixed  results  indicating  the  approach  was 
better  for  fabrication  hours  on  one  program 
and  better  for  assembly  hours  on  another 

[3.91*3. 

The  predictive  ability  of  the  expended  model 
was  substantially  better  than  the  standard 
learning  curve  model  in  the  vast  majority  of 
the  situations  tested  [3:95].  Mot  only  were 
the  prediction*  better,  they  were  more  stable 
over  increasingly  wider  time  spans. 

The  original  observation  that  one  should  not 
try  to  forswlate  a  generalized  coat  model 
using  coefficients  obtained  from  various 
production  programs  was  validated  [3:96]. 

Even  within  the  F-5/T-38  test  data,  the 
regression  coefficients  changed  within  a 
given  test  situation  at  successive  cases  were 
omitted  from  the  test  data  in  the  predictive 
ability  tests. 

The  proxy  for  production  rate  sometimes  gave 
discontinuous  data.  That  is,  one  lot  rate 
might  be  37.2  aircraft  per  month  while  the 
next  might  drop  to  27  per  month  because  of 
anomaliee  in  the  data.  Such  an  anomaly  might 
be  produced  by  a  delay  in  accepting  an  air¬ 
craft  for  a  minor  deficiency.  If  one  had 
ace“"«  to  the  final  planned  shop  production 
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rate,  it  might  be  a  better  production  rate 
proxy  than  the  one  studied. 

It  is  concluded  that  the  expanded  approach  to 
predicting  airframe  direct  labor  requirements 
is  superior  to  the  standard  learning  curve. 

It  is  particularly  veil  suited  to  predicting 
the  effects  of  a  required  change  in  the  rate 
of  production  in  an  ongoing  airframe  produc¬ 
tion  program.  One  would  most  likely  use  it  in 
checking  the  reasonableness  of  an  estimate 
arrived  at  by  more  conventional  methods  such 
as  detailed  estimating. 

It  ould  seem  worthwhile  for  airframe  program 
raeraa-.-rs  to  collect  the  necessary  production 
data  f  a  .'P' .  ‘  using  the  approach  if  needed. 
Cost  growth  and  the  frequently  accompanying 
production  stretchouts  are  commonplace  and  the 
ready  availability  of  the  needed  data  would 
facilitate  the  resulting  need  to  price  contract 
modifications. 

Finally,  it  seems  reasonable  that  the  expanded 
approach  would  be  useful  on  other  programs 
where  learning  curve  approaches  have  been 
successful.  Accordingly,  missile  airfr.vmes, 
avionics  and  engine  programs  are  likely 
candidates  for  further  3tudy. 


[5]!  Noah,  Joseph  W.,  "Resource  Input  vs. 

Output  Rate  and  Volume  in  the  Airframe 
Industry."  Draft  technical  report 
No.  TR-20B-USN,  Contract  N0001li-73-C-03i9, 
Alexandria,  Virginia:  J.  Vatson  Noah 
Association,  Inc.,  1971*.  (Privileged 
Information) 
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I.FAKNINC  CURVES,  PRODUCTION  RATH ,  AND  PROGRAM  COST!! I 

Norman  Keith  Womer,  Air  Korn*  Inxtltute  of  Technology 


ABSTRACT 


Economic  Models  of  the  production  to  order 
problem  frequently  concludn  that  the  size  of 
the  order  and  production  rate  each  Influence 
unit  costa.  Despite  this  fact,  the  empirical 
work  on  alrcrnft  costs  credits  production  rate 
with  little,  if  any,  explanatory  ability. 

These  conflicting  facts  are  resolved  in  this 
paper  by  use  of  a  model  which  permits  produc¬ 
tion  rate  to  be  a  decision  variable  in  the 
contractor's  production  planning.  We  derive 
an  optimal  production  plan  which  requires  pro¬ 
duction  rate  to  change  throughout  the  life  of 
the  program.  We  then  contrast  the  planning 
situation  where  alternative  order  sizes  are 
considered,  with  the  production  situation  where 
unit  costa  are  related  to  cumulative  output 
given  a  production  plan.  This  approach  pro¬ 
vides  guidance  for  the  use  of  data  on  past  pro¬ 
grams  in  the  evaluation  of  future  production 
plans.  It  also  provides  an  explanation  of  Che 
Impact  of  program  stretchouts  on  costs. 

INTRODUCTION  AND  BACKGROUND 

A  usual  Intermediate  product  of  production 
theory  is  the  cost  function.  The  cost  function 
relates  dollar  cost  of  production  to  the  quan¬ 
tity  of  output  produced  per  unit  of  time,  and 
in  some  cases,  prices  of  resources  used  in  the 
production  process.  The  form  of  the  cost  func¬ 
tion  depends  on  the  underlying  production  func- 
and  the  competitive  conditions  in  each  of  the 
resource  markets.  Its  form  also  depends  on 
constraints  imposed  on  the  firm's  production 
decision.  Cost  functions  derived  from  circum¬ 
stances  where  one  or  more  resources. are  fixed 
in  quantity  are  labeled  short  run  functions 
while  those  applicable  to  situations  when  all 
resources  are  variable  are  referred  to  as  long 
run  functions. 

While  the  length  of  the  time  period  involved  is 
frequently  implicit,  the  cost  function  is  a 
flow  concept  relating  the  time  rate  of  cost  to 
the  time  rate  of  output.  As  such,  its  relation 
to  various  stock  concepts  like  the  quantity  of 
capital  equipment,  the  cumulative  number  of 
items  to  be  produced  (volume),  and  work  experi¬ 
ence  of  the  organization  at  any  point  in  time 
is  difficult  to  specify.  These  stock  concepts 
are  frequently  Ignored  In  classroom  trsatments 
of  the  subject  and  in  many  attempts  at  empiri¬ 
cal  estimation  of  ths  cost  function.  This 
simplification  Is  sonatinas  justified  If  the 
firm  Is  In  a  steady  stats  situation  where  de¬ 
mand  rate  is  expected  to  continue  indefinitely. 
Hlrshlelfer  [A,  236-237]  .has  argued  that  the 
amplification  la  conalatent  aa  well  with  the 


•  liimini  In  vhl.-b  n<bim>  l»  experi e,j  «•«  l» 
i>iu|k>i  l  tonatn  to  produol  ion  lain-  NuvaMUu 
tees,  explicit  consideration  of  these  stock 
concepts  ia  of  crucial  importance  in  many  in¬ 
dustrial  eattlnga. 

The  stock  concepts  are  so  importune  in  tact, 
chat  in  soma  industries  variat  ions  in  coots  are 
explained  totally  by  stock  changes.  Ignoring 
the  flow  concepts  explicitly  treated  by  eco¬ 
nomic  theory.  For  example,  the  learning  curve* 
or  progress  functions  developed  to  describe 
costs  In  the  aircraft  Industry  typically  rclate 
costs  to  number  of  items  produced  without  any 
explicit  reference  to  production  rate  or  rate 
of  usage  of  resources. 

Attempts  to  Integrate  these  two  methods  of  de¬ 
scribing  variations  in  coats  of  production, 
learning  curves  and  cost  functions,  have  met 
with  only  limited  success.  Alchlan  [l]  and 
Hlrshlelfer  [4]  have  dlscusaed  some  of  the 
issues  Involved  and  have  provided  some  Intui¬ 
tive  expectations  about  the  form  of  the  result¬ 
ing  relation.  Alchlan  states  nine  propositions 
on  the  variations  of  program  coats  due  to 
changes  in  production  rate,  volume,  the  time 
horizon  and  the  firm's  production  experience. 
Hlrshlelfer  extends  this  work  and  relates  it  to 
more  trsditionsl  coat  theory.  However,  both 
works  stop  short  of  relating  variations  in 
costs  to  production  in  ways  that  arc  explicit 
enough  for  empirical  estimation.  Preston  and 
Keachle  [10]  also  relate  learning  to  cost  func¬ 
tions,  but  their  graphical  analysis  of  the  sit¬ 
uation  also  lacks  precision.  Oi  [4]  goes  some¬ 
what  further.  He  purports  to  derive  the  nine 
characteristics  that  Alchlan  proclaim#  from  an 
intertemporal  production  functions.  His  treat¬ 
ment  la  general  and  shows  a  potential  explana¬ 
tion  for  learning  In  terma  of  standard  produc¬ 
tion  theory,  but  it  too  falls  to  specify  the 
relations  precisely  enough  for  empirical  In¬ 
vestigation. 

Washburn  [12]  addresses  these  Issues  directly. 
He  formulates  a  model  which  relates  discounted 
cash  flow  to  production  rate  and  cumulative 
number  of  Items  produced.  This  model  draws 
heavily  on  (1)  the  characteristics  of  produc¬ 
tion  on  an  assembly  line  and  (ii)  the  effici¬ 
ency  of  "crews"  of  labor  at  each  position  on 
the  line.  This  rather  specialized  model 
polnta  the  way  for  the  generalization  below 
which  la  basad  on  standard  aconomlc  production 
functions. 

In  this  paper,  a  homogeneous  production  func¬ 
tion  Is  augmented  with  the  learning  hypothesis. 
The  firm  is  charged  with  production  to  a  cus¬ 
tomer  ordered  defined  ae  a  given  volume  of 
output  available  at  a  known  point  in  time. 
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The  order  serves  to  constrain  a  production 
program  which  is  assumed  to  be  carried  out  by 
minimizing  the  discounted  cost  of  producing. 

In  order  to  emphasize  the  impact  of  the  other 
stock  concepts,  the  services  of  various  capi¬ 
tal  stocks  are  treated  as  flows  in  this  paper. 
One  might  imagine  the  firm  leasing  capital 
equipment  for  varying  periods  of  time.  The 
prices  of  capital  are  then  rental  charges  for 
capital  services.  Thus  capital  is  not  dis¬ 
tinguished  from  other  inputs  to  the  production 
process. 

To  illustrate  the  results  of  this  theory,  we 
will  assume  that  relative  resource  prices  do 
not  change  during  the  production  program. 

(They  may  all  Increase  or  decrease  at  the  same 
rate,  however.)  This  permits  us  to  analyze 
the  production  situation  as  If  there  were  only 
one  "composite1'  input.  Secondly,  we  will 
assume  a  log  linear  form  for  the  production 
function. 

The  model  and  its  solution  is  described  in  the 
next  section.  These  results  are  compared  to 
traditional  learning  curves  In  the  Learning 
Curves  Section.  The  paper  is  briefly  summar¬ 
ized  in  the  Summary  Section. 


THE  MODEL 


The  variables  of  the  model  are  described  below: 


Q(<)  *  the  cumulative  quantity  of  output 
at  t 

Q(-t)  •  dQ/dt  "  the  production  rate  at  t 

x(-t)  -  the  rate  of  resource  use  at  t 

p  “  the  resource  price 

(i  ■  the  disc ount  rate 

C (t)  “  the  discounted  cost  of  producing 
Q  at  t 

T  “  the  total  length  of  the  production 
period 

V  •  the  volume  of  production  on  the 
program  attained  by  T 

6  -  the  elasticity  of  production  rate 

with  respect  to  cumulative  produc¬ 
tion  experience,  a  parameter  de¬ 
scribing  learning 

a  "a  returns  to  scale  parameter 


The  production  function  relates  the  rate  of  use 
of  '  ht-  composite  input  and  production 


experience  (measured  by  cumulative  output  to 
date)  to  output  rate  at  any  point  in  time. 
Cumulative  production  experience  is  presumed 
to  enter  the  production  function  by  permitting 
Hicks  neutral  technological  change  as  a  log 
linear  function  of  production  experience.  The 
resulting  production  function  is  written  as: 


Q  -  Q6  ** 


where  0<6<1  is  the  elasticity  of  production 
rate  with  respect  to  production  experience  and 
ct>l  implying  decreasing  returns  ro  scale. 

The  discounted  cost  incurred  oy  producing  Q 
at  t  is  defined  as: 


C  -  e-p*  px 


The  resource  price  and  the  discount  rate  are 
assumed  to  be  exogeneous  constants,  indepen¬ 
dent  of  time  and  any  of  the  decisions  of  the 
firm-  This  permits  the  firm  perfect  flexibil¬ 
ity  in  resource  use.  There  are  no  penalties 
for  altering  the  planned  rate  of  resource  use. 

The  firm  is  assumed  to  minimize  the  discounted 
cost  stream  incurred  to  produce  V  units  of 
output  by  time  T.  The  firm's  problem  may  be 
characterized  as: 


min  /  e  ^  px  dt 


s.t.  q  -  q®  x'/0 


no  Q(0)  -  0,  Q(T)  -  V 


This  is  a  problem  in  optimal  control.  The 
details  of  the  solution  in  a  more  general  con¬ 
text  are  given  in  Homer  [14], 

The  nature  of  the  problem  can  easily  be  seen 
by  substituting  from  (l)  into  (2).  This 
yields  the  discounted  cost  function: 


e'p  p  q° 


This  function  is  illustrated  in  Figure  1.  The 
nature  of  the  problem  is  find  the  proper 
tine  path  of  production  (relation  "  tween  Q 
and  ())  to  satisfy  the  constraints  and  mini¬ 
mize  total  costs.  In  the  figure,  total  costs 
are  illustrated  by  the  area  of  the  surface 
shove  the  relation  between  Q  and  Q. 
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Figure  1.  Cost  Versus  Production  Kate  and 
Cumulative  Quai'.lty 


The  mathematical  solution  to  the  problem  at 
(3)  la  given  by: 

Q(X)  -  v[(c',t/u-,-l)/(e|lTA,-1-l)]  1/1  -6  (5) 

This  optimal  time  path  of  output  Increases  at 
an  Increasing  rate  with  time  throughout  the 
program.  At  any  point  in  time,  cumulative 
production  Is  proportionate  to  volume  and  de¬ 
clines  with  tlje  length  of  the  production 
period. 

Differentiating  equation  (5)  and  substituting 
the  result  into  equation  (4)  yields: 

'  c  -  p  va(,-5)(epT/(a',)-ir° 

(6) 

r  p  T  „pt/<a-o 

I  (i  ->5)  (a-t )  j 

Here  we  see  the  rate  of  cost  grows  exponen¬ 
tially  with  time.  Its  Intercept  is  determined 
by  prices,  volume,  the  period  of  production 
and  other  parameters. 

Equation  (6)  may  be  integrated  over  the  length 
of  the  production  period  to  determine  the 
total  discounted  cost  of  production  incurred 
on  a  production  program  defined  by  V  and  T. 

C(V,T)  -  [p/ <a-l) ]a” 1  (l-6)"a  Va°"6) 
j(,pT/(o-i)_l-jl-o 

Thu  effect  of  volume  on  costs  clearly  Is  due 
both  to  decreasing  returns  to  scale  (a>l)  and 


learning  (0<4<ll.  The  net  effect  of  these  fwo 
forces  clenrly  depends  on  the  values  of  tlje  • 
parameters  Involved,  but  conceptually  costs 
may  rise  at  an  increasing,  constant,  or  de¬ 
creasing  late  with  volume.  Since  a>l  the 
model  does  require  that  discounted  costs  de¬ 
cline  with  the  length  of  the  program  for  a’  ' 
given  volume  of  produetlon. 

Ihe  cost  function  at  equation  (7)  correspond? 
to  a  planning  situation.  It  describes  tlje  1 
behavior  of  production  costs  for  alternntiye  ’ 
production  programs  if  the  time  path  of  pro-’’ 
duction  rate  is  chosen  In  an  optimal  manner. ’>  , 

The  time  path  of  cumulative  production  cost 
for  given  V  and  T  i»  found  by  integrating 
equation  (f>)  from  0  to  t  where  £<T.  If 
we  then  substitute  for  -t  from  equation  (5) 
cumulative  cost  Is  related  to  cumulative  out¬ 
put  at  any  time  in  Lhe  program  by: 

CU|V,T)  -  [p/ln-l)]0-1  (l-6)'a  V(a',)(‘-5) 

P  [Q(t>]'“5  repT/(o_,)-i],-a 

The  Impact  of  cumulative  production,  <}(■£)>  on 
costs  is  different  from  the  impact  of  plunged 
volume,  V.  While  the  impact  of  volume _de- 
pends  on  both  the  learning  and  the  returns  to 
scale  parameters  the  impact  of  cumulative  pro¬ 
duction  is  due  to  learning. 

The  cost  function  at  equation  (8)  describes 
the  relation  between  output  and  cumulative 
costs  for  a  given  program.  This  Is  referred 
to  as  the  production  situation  in  contrast  to 
the  planning  situation. 


LEARNING  CURVES 


A  learning  curve  which  relates  cumulative  dis¬ 
counted  costs  to  cumulative  quantity  produced 
is  consistent  with  equation  (8).  Also,  while 
the  "intercept"  of  the  learning  curve  depends 
on  many  fsclors.  Its  "slope"  depends  only  on 
the  parameter  which  we  have  associated  with 
learning.  Thus,  a  learning  curve1  estimated 
from  successive  observations  on  output  and 
cost  during  a  program  Is  consistent  with  the 
model. 


'This  discussion  Implies  that  the  empirical 
work  uses  discounted  costs  In  constant  dollars 
although  discounting  Is  rarely  mentioned  In 
the  learning  curve  literature. 
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Learning  curves  .in-  pai  i  it  ularlv  |><>|><> I as 
describt-rs  of  cost-.  on  .1  i :  <■  i  .* f  t  prngi arcs.  Un¬ 
fortunately,  1 he  use  ul  l.-.iiiiing  mivt-s  in 
CValual  111);  now  <ilni.il  t  |>i  uj.i.ie:S  is  not  .ilw.iys 
coils  1st 0111  with  t lit*  model  or  1  ho  estimating 
si  tn.it  Ion  desci  I  bed  above.  I  In:  distinction 
between  munition  (7)  and  1  lie  planning  situa¬ 
tion  to  which  it  applies  ami  the  empi ileal  en¬ 
vironment  ill  whnli  lea  1  nine  turves  are  esti¬ 
mated  using  equation  (8)  is  IrcqiieiUly  over¬ 
looked.  Thus,  learning  tii-ves  estimated  as 
above  are  used  to  evaluate  plans  that  relate 
cost  to  volume  tin  new  piograms  without  regatd 
to  the  returns  to  scale  parameter,  likewise, 
cross  sectional  analyses  tail  to  distinguish 
between  the  efiects  of  ci.riulul  ive  output  and 
volume  on  cumulative  costs. 

The  use  of  learning  curves  esl  limited  from  pio- 
ductlou  programs  for  these  purposes  can  be 
cxtremely  misleading.  In  comparing  alterna¬ 
tive  programs,  volume  and  time  are  frequently 
not  fixed,  lluis,  empirical  learning  curve, 
estimated  without  regard  to  these  variations 
do  not  i  Humiliate  the  tradeoffs  available. 

Kor  example,  consider  a  situation  in  which  air¬ 
craft  are  to  lie  produced  in  a  forty  month  pro¬ 
gram.  Figure  2  illustrates  learning  curves 
for  three  different  production  programs.  In 
each  case,  discounted  cumulative  average  costs 
are  plotted  against  number  of  aircraft  pro¬ 
duced  (equal loti  (8)  divided  by  Q(t)).  The 
difference  umong  the  curves  reflects  only  the 
fact  that  their  Intercept  depends  on  volume  of 
production,  .ill  other  parameters  are  the  same. 
Each  curve  Is  characterized  by  6  *  2/5  (ap¬ 
proximately  a  76Z  learning  curve)  and  a  «  6/3. 


Figure  2.  Cumulative  Average  Costs  of  Pro¬ 
duction,  a  *  6/3. 


riguri:  2  also  in.  hides  .list  outlied  1 11mt1l.it  i  ve 
average  costs  as  a  font  lion  of  planned  volume 
(equation  (7)  divided  iiy  V).  Cmve  1*  cor¬ 
responds  to  tills  pi. inning  situation.  Hie  his¬ 
tory  for  any  given  program  is  expected  to  fol¬ 
low  llie  learning  curve  appropriate  for  thut  . 
program's  planned  volume;  but  the  relation 
between  discounted  cumulative  average  coats 
and  planned  volume  Is  given  by  moving  among 
learning  curves  along  Cutve  P.  in  this  situ¬ 
ation,  P  lias  the  same  general  shape  as  Llie 
learning  turves,  hut  Its  slope,  which  depends 
on  it,  is  different. 

Figure  2  also  illustrates  'lie  elfect  of  start¬ 
ing  a  product  ion  plan  for  a  large  volume  and 
then  stopping  production  before  the  target  is 
reached.  For  example,  starting  a  program  to 
produce  260  aircraft  in  forty  months  and  men 
slopping  after  eighty  aircraft  are  produced, 
yields  discounted  unit  cos's  approximately 
20  percent  higher  than  wouln  have  been  re¬ 
quired  had  80  .literate  been  pt-inned  origin¬ 
ally.  The  original  production  plan  does  pro¬ 
duce  the  aircraft  In  only  26  months,  however. 
This  result  requires  that  all  those  resources 
which  wete  variable  In  the  planning  situation 
remain  so.  If  some  long  terra  contracts  for 
resources  were  signed  in  anticipation  of  a 
60  month  product  ion  program  costs  would  be 
still  higher. 

In  geneial,  the  impact  of  altering  T  or  V 
during  a  production  program  depends  on  the 
contractors  flexibility  In  altering  resource 
use.  If  the  planned  usage  of  some  resources 
cannot  lie  altered  during  the  program,  addi¬ 
tional  constraints  must  lie  placed  on  the  model 
and  altering  T  or  V  during  the  program  is 
likely  to  increase  program  costs. 

A  second  situation  Illustrates  (lie  effect  of 
o  on  the  relation  between  the  production 
situations  and  the  planning  situation.  The 
curves  In  Figure  3  differ  from  chose  in 
Figure  2  due  to  a  being  increased  from  6/3 
to  2.  Wlii  le  clils  does  nut  affect  the  slope 
of  the  learning  Curves,  it  does  change  their 
intercept. 

The  effect  011  the  planning  situation  is  even 
more  dramatic.  Here,  decreasing  returns  are 
so  strong  that  they  overpower  the  effect  of 
learning  so  chat  discounted  cumulative  aver  ■ 
age  costs  Increase  with  planned  volume  even 
though  each  program  la  still  characterized  by 
a  76  pciccnc  learning  curve. 

Those  two  situations  clearly  demonstrate  the 
effect  that  decreasing  returns  to  s<  ale  can 
have  mi  aircraft  costs.  They  emphasize  the 
necessity  to  estimate  returns  to  scale  among 
programs  mid  to  augment  measured  learning 
curves  with  this  Inforraailon  for  planning 
purposes. 
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Figure  3.  Cumulative  Average  Costs  of  Produc¬ 
tion,  a  »  2. 


The  above  model  is  also  useful  in  explaining 
certain  puzzling  aspects  of  the  empirical  work 
on  aircraft  costs.  Ever  since  Alchian's  1939 
paper  [1],  RAND  Reports  [6,  7,  8,  9]  on  air¬ 
craft  cost  estimation  have  attempted  to  Include 
both  volume  and  production  rate  as  independent 
variables  in  their  cost  estimating  relations. 
Even  though  Alchian's  model  argues  that  both 
variables  should  be  important,  the  resulting 
empirical  work  credits  production  rate  with 
little,  if  any,  explanatory  ability.  In  fact 
a  recent  study  [7]  concludes 

In  general,  however,  we  must  conclude 
that  for  predicting  the  overall  effect 
of  production  rate  on  aircraft  cost, 
genei'alized  estimating  equations 
based  on  statistical  analyses  of  our 
,  sample  of  military  aircraft  would  be 
too  unreliable  to  be  useful. 

In  the  above  model,  unlike  Alchian's2,  produc¬ 
tion  rate  is  a  decision  variable  and  is  chosen 
in  an  optimal  manner.  Therefore,  the  model  is 
consistent  vith  the  finding  that  the  effect  of 
production  rate  on  costs  cannot  be  distin¬ 
guished  from  the  effect  of  volume.  This  is 
especially  true  in  the  planning  situation  de¬ 
scribed  by  equation  (7) .  If  successive  obser¬ 
vations  on  costs  during  a  program  are  to  be 
explained,  then  equation  (8)  shows  that  no  time 
dependent  variable  (like  production  rate)  other 
than  cumulative  quantity  produced  at  is 
necessary  to  explain  costs. 


SUMMARY 

A  model  of  production  was  constructed  from  a 
production  function  augmented  by  learning. 

The  firm  was  charged  with  producing  to  a  cus¬ 
tomer  order  iefined  by  a  given  stock  of  output 
available  at  a  known  point  in  time.  The  prob¬ 
lem  of  minimizing  the  discounted  costs  of  pro¬ 
duction  was  then  solved  -■>  yield  the  time  path 
of  production  and  the  program  cost  function. 

The  program  coat  function  was  presented  in  two 
contexts,  the  planning  situation  in  equation 

(7)  and  the  production  situation  in  equation 

(8) .  The  comparison  of  these  situations  il¬ 
luminated  the  role  of  empirically  estimated 
learning  curves  in  the  evaluation  of  alterna¬ 
tive  production  programs,  and  the  impact  of 
altering  plans  during  a  production  program. 
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INTEGRATKD  MANUFACTURING  COST  KSTIMATINC  SYSTEM 


M,  Elkin,  Manager,  Pricing  and  Estimating 
Northrop  Corporation,  Aircraft  Group 


INTRODUCTION 

In  the  past  decades,  cost  has  become  an  in¬ 
creasingly  significant  parameter  in  the  design 
and  development  of  aircraft  systems.  Today, 
government  and  industry  find  themselves  oper¬ 
ating  in  an  environment  that  entails  the  re¬ 
sponsibility  for  selecting  design  concepts, 
materials,  and  processes  that,  in  combination, 
yield  aircraft  systems  that  require  the  least 
cost  to  acquire,  operate,  and  maintain  while 
still  achieving  performance  goals. 

Two  major  reasons  can  be  cited  for  this  cur¬ 
rent  emphasis  on  cost:  increasing  ownership 
costs  of  aircraft  systems  (Figure  1  -  this  fig¬ 
ure  shows  that  the  average  increase  in  constant 
dollar  terms  with  Inflation  removed  for  fighter 
aircraft  sys  :ems  exceeds  5%/year  compounded  in 
constant  dol  ar  terms.  That  is  why  the  DOD 
was  forced  tn  develop  complimentary  lower-cost 
alternatives  to  the  F-14  and  F-15  fighters;  if 
left  uncheck  :d,  fighter  aircraft  cost  growth 
would  have  e cceeded  9%  per  annum.  If  the  F-16 
and  F-18  mee :  their  deslgn-to-cost  goals,  costs 
will  be  redu :ed  to  a  little  over  5%  per  year) 
and  a  downward  long-term  trend  (in  constant 
dollars)  of  defense  procurement  funds  (Fig¬ 
ure  2) .  Government  and  Industry  are  faced 
with  the  cask  of  most  effectively  utilizing 
these  limited  funds  in  the  development  of  air¬ 
craft  systems,  i.e,,  meet  performance  goals 
with  a  minimum  of  cost.  Several  avenues  have 
been  investigated  to  solve  this  problem.  The 
Design-to-Cost  Concept,  the  implementation  of 
which  today  is  mandatory,  has  proven  to  be  an 
effective  way  of  keeping  cost  at/or  below  tar¬ 
get  levels.  This  concept  promotes  the  closer 
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integration  between  the  cost  and  technical 
communities  within  government  and  industry, 
where  cost  analysts,  in  addition  to  their  tra¬ 
ditional  functions  of  cost  estimating  and 
analysis,  become  more  involved  with  an  sensi¬ 
tive  to  requirements  of  the  technical  groups, 
while  the  design  and  manufacturing-  engineers 
become  increasingly  aware  of  the  cost  impacts 
of  their  designs  and  manufacturing  plans. 


The  implementation  of  the  Design-to-Cost 
(DTC)  Concept  involves  the  preparation  of 
tradeoffs  whereby  feasible  alternative  designs 
generated  by  Design  Engineers  and  manufactur¬ 
ing  plans  generated  by  Planners  are  evaluated 
on  the  basis  of  cost.  The  main  ingredients 
necessary  to  effectively  do  tradeoffs  are 
timeliness,  consistency  and  accuracy.  Timely 
support  by  cost  groups  allow  technical  groups 
to  generate  more  alternative  designs  and  manu¬ 
facturing  plans  thus  covering  a  larger  base 
from  which  the  most  cost  effective  designs 
and  plans  can  be  selected.  Consistency  and 
accuracy  of  estimates  provide  both  cost  and 
technical  groups  with  the  confidence  neces¬ 
sary  for  design  and  manufacturing  decisions 
relating  to  the  manufacture  of  airframe 
structures. 


Timing  is  a  very  significant  element  to  be 
considered  by  the  cost  analyst.  Life  cycle 
expenditures  for  a  new  system  span  20  -  30 
years  and  include  development,  production, 
operation  and  support  costs.  However,  the 
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major  commitment  to  these  expenditures  Is  made 
during  the  first  five  years  of  the  program 
where  approximately  907.  of  costs  are  locked 
In.  At  the  completion  of  the  study  (Prelim¬ 
inary  Design)  phase,  product  configuration  is 
reasonably  well  established.  When  the  product 
is  finally  prototyped,  design  is  solidified 
to  a  point  where  less  than  257.  of  the  antici¬ 
pated  PSD,  production  and  0  1  S  costs  can  be 
influenced.  By  the  time  production  is  initi¬ 
ated,  tooling  concepts,  manufacturing  and 
facilities  plans  will  have  been  sufficiently 
established  that  major  changes  to  these  non¬ 
recurring  costs  become  costly  and  impracti¬ 
cal.  Figure  3  illustrates  the  degree  of 
commitment  to  total  costs  in  relation  to  the 
timespan  u  a  »  ’V  systems  program. 
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FIGURE  3.  COST  COMMITMENT 


The  objective  of  D-T-C  is  to  increase  the  num¬ 
ber  of  feasible  design  alternatives  evalua¬ 
ted  at  this  conceptual  3tage.  This  allows 
for  a  larger  base  from  which  to  select  the 
most  effective  designs. 

In  the  past,  detail  estimating  (also  called 
"grassroots"  estimating)  has  been  relied  upon 
for  consistency  and  accuracy  in  estimating. 

As  used  by  Northrop,  this  methodology  utilizes 
predetermined  standards,  usually  developed 
by  Industrial  Engineers  to  generate  esti¬ 
mates.  It  uses  the  ">  ;oras-up"  approach 
whereby  estimates  of  t  -uctures  are  "built- 
up"  from  estimates  of  detail  parts.  This 
"itom-by-ltem"  accounting  of  structures  fabri¬ 
cation  and  assembly  costs  assures  consistency 
and  accuracy  in  total  structures  estimates. 

The  detail  estimating  approach,  however,  es  it 
is  used  today  has  two  major  drawbacks:  lack 
of  timeliness  and  high  cost.  The  time  arid 
effort  required  to  generate  a  detail  estimate 
is  conaldcrablo  compared  to  other  estimating 
approaches,  such  as  parametrics.  It  requires 
an  extend ve  amount  of  input  data  in  terms  of 
design  and  manufacturing  plan  definition  mak¬ 
ing  it  o  alow  and  oftentimes  costly  process. 


Parametric  estimating  has  received  wide  accep¬ 
tance  within  government  and  industry  primarily 
because  of  its  speed  and  ease  of  application. 
Its  accuracy  is  dependent  upon  the  extent,  con¬ 
sistency  and  homogeneity  of  the  data  base  from 
which  it  was  derived.  Estimates  generated 
parametrically  are  usually  at  a  level  of  aggre¬ 
gation  much  higher  than  those  generated  through 
detail  estimating.  The  basic  reason  for  this 
i‘s  that  actual  costs,  the  base  from  which 
parametric  relationships  are  derived,  are  not 
tracked  at  the  level  addressed  by  detail  esti¬ 
mating.  At  lower  levels,  therefore,  para¬ 
medics  becomes  Insensitive  making  it  ineffec¬ 
tive  for  detail  tradeoffs  often  required  in 
Design  to  Cost  implementation.  There  is  a 
definite  need  to  develop  a  tool  that  is  faster, 
more  consistent,  and  more  sensitive  For  trade¬ 
offs,  less  costly  and  more  accurate:  so  that 
the  cost  community  can  become  responsive  to 
the  requirements  of  the  technical  community  in 
the  joint  effort  to  get  a  good  hanr-le  on  cost 
at  the  cri tlcal  conceptual  stage. 

2 

I 

Realizing  this  need,  Northrop  formulated  a 
plan,  depicted  In  Figure  A,  that  Identifies 
an  Integrated  Manufacturing  Cost  Estimating 
System.  This  automated  system  will  provide 
manufacturing  cost  estimates  for  metallic  and 
composite  structures  that  are  timely,  consis¬ 
tent  and  accurate  and  at  a  cost  significantly 
lower  than  that  of  manual  detail  estimating. 


FIGURE  4.  STEPS  TO  DEVELOP  AN  AIRFRAME  STRUCTURES 
COST  ESTIMATif.'R  MODEL 


The  entire  system  is  based  on  Northrop1 s  In¬ 
dustrial  Engineering  Time  Standards  developed 
by  Industrial  Engineers  over  the  years  through 
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stop-watch  time  studies  and  other  piedeter- 
mlned  time  study  techniques.  Industrial  Engi¬ 
neering  Standards  provide  a  base  for  estimat¬ 
ing  at  levels  not  obtainable  through  histori¬ 
cal  data.  Detail  operations  are  studied  and' 
time  values  assigned  to  their  basic  elements 
'(PFAD  factors  excluded)  making  them  valid  in 
any  environment  so  long  as  operation  methods 
and  equipment  remain  the  same. 

This  paper  addresses  the  development  of  five 
modules  that  cover  composite  detail  parts  fab¬ 
rication,  composite  assembly,  metallic  detail 
parts  fabrication,  metallic  assembly,  and 
metallic/composite  integration  end  final 
assembly. 


BACKGROUND  ON  ADVANCED  COMPOSITES 


The  first  step  toward  the  implementation 
of  this  plan  wa3  accomplished  in  the  devel¬ 
opment  of  the  Advanced  Composite  Cost  Esti¬ 
mating  Model  (ACCEM)  -  a  computer-aided  esti¬ 
mating  system  for  advanced  composite  detail 
parts  fabrication.  This  model  establishes 
the  basic  approach  by  which  ail  other  models 
in  the  plan  are  to  be  developed. 

Advance  Composites  is  a  new  technology  that 
is  finding  broad  applications  in  the  aerospace 
industry.  Initially,  advanced  compositus  were 
developed  to  exploit  their  inherent  advantages 
of  low  weight  and  high  stiffness  when  compared 
to  conventional  structures.  Since  the  mate¬ 
rial  was  very  expensive  in  developmental  quan¬ 
tities,  an  Increase  in  coats  or  at  least  no 
cost  savings  were  expected  for  any  aircraft 
structure  in  which  advanced  composites  were 
substituted  for  conventional  metal. 

In  the  late  sixties,  Advanced  Composites  tech¬ 
nology  was  characterized  by  high  material 
costs  (close  to  $300/lb  for  graphite  epoxy), 
labor  intensive  fabrication  processes,  and  de¬ 
signs  that  directly  substituted  composite 
material  for  conventional  metals.  Since  then, 
through  extensive  research  and  development 
supported  b>  government  and  industry,  and 
through  the  ever  increasing  application  of 
composites  in  both  the  aerospace  And  commer¬ 
cial  sector:,  we  see  today  composite  material 
costs  in  th<  $30-$50/lb  range,  a  variety  of 
composite  mi terial  forms,  an  Increasing  per¬ 
centage  of  lutomatlon  of  composite  fabrica¬ 
tion,  development  of  innovative  manufacturing 
approaches,  and  innovative  designs  that  stay 
away  from  substitution  and  exploit  the  inher¬ 
ent  advantages  of  composite  materials,  l.e,, 
simpler  designs  that  result  in  less  detail 
parts  and  require  less  tools.  He  see  today, 
more  clearly  than  before,  the  cost  competi¬ 
tiveness  of  cemposltes  when  applied  to  air¬ 
craft  structures. 


the  government  ha*  bsen  vevy  Aggrctaivo  '\ 
the  development  of  advanced  composite*  tech¬ 
nology,  as  Indicated  by  the  increasing  dollar 
value  of  total  RDT&E  -  composite  related  - 
contracts  awarded,  in  spite  of  a  declining 
total  RDT&E  contract  funding.  Table  1  illus¬ 
trates  this  for  the  Air  Force  Flight  Dynamics 
and  Materials  Laboratories. 


TABLE  1  ROT  a  E  AIR  FORCE  CONTRACTS  RELATED  TO 
AERONAUTICS  HANDLED  JOINTLY  IY  AFML  A  AFFDL* 


FY  75 

FY  78 

FY  77 

FY  11 

AVERAGE 

ANNUAL 

PERCENTAGE 

INCREASE 

(DECREASE) 

ADVANCED 

COMPOSITES 

5.6M 

7  3M 

8  0M 

11.1M 

18% 

ALL  OTHERS 

1,214. 5M 

1.407.1  M 

1,222  OM 

1,101. 3M 

(2%) 

TOTAL 

I.220.1M 

1.414  4M 

1,230  OM 

1.112.4M 

(2%) 

From  1975  to  1976,  advanced  -  composite  -  re¬ 
lated  contracts  increased  from  5.6M  to  7.3M, 
a  307.  increase;  from  1976  to  1977  (7.3M  to 
8.0M),  a  97.  increase;  from  1977  to  1978  (8.0M 
to  11. 1M)  a  147.  increase.  During  this  entire 
time  period  (1975-1978)  total  RDT&E  funds 
fell  by  97..  Funds  spent  on  advance  composites 
as  a  percent  of  total  RDT&E  contracts  has  in¬ 
creased  from  0.467.  in  1975  to  0.527.  in  1976, 
to  0.657.  in  1977  and  1.00%  in  1930.  Other 
members  of  the  defense  community  have  been 
equally  aggressive  in  pushing  composite  struc¬ 
ture  applications. 


ADVANCED  COMPOSITE  COST  ESTIMATING  MODEL 
(ACCEM) 


A  survey  conducted  by  an  Air  Force  Ad  Hoc 
Composites  Study  Team  in  1975  revealed  that 
one  of  the  major  Inhibitors  to  the  widespread 
use  of  composites,  was  a  lack  of  confidence  in 
composite  cost  data  due  to  its  non-existents. 
This  problem  was  recognized  by  Northrop  in 
1974  when  the  company  proposed  to  develop  a 
computerized  cost  estimating  methodology  baaed 
upon  the  I.E.  Standards  approach  for  advanced 
composites. 


The  ACCEM  was  developed  by  Northrop  under  a 
one-year  Air  Force/Navy  funded  contract.  The 
objective  of  this  program  was  to  develop  a 
computerized  methodology  for  estimating  the 
recurring  costs  associated  with  the  fabrica¬ 
tion  of  advanced  composite  detail  parts.  Be¬ 
cause  advanced  composites  was  a  relatively 
new  technology,  Northrop  felt  that  the  exten¬ 
sive  participation  of  the  government  and  in¬ 
dustry  members  in  the  development  of  this 
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ESTIMATING  LABOR  COSTS 


program  would  make  the  ACCEM  a  more  useful 
and  worthwhile  estimating  tool.  In  the  course 
of  developing  the  ACCEM,  therefore,  a  free 
exchange  of  Ideas  and  data  was  promoted  and 
encouraged  through  various  govemment/lndustry 
briefings  conducted  by  Northrop. 

The  ACCEM  computer  model  Is  composed  of  three 
modules:  Factory  Labor  Standards  Estimating, 
Support  Functions  Estimating  and  Cost  Projec¬ 
tion.  The  Factory  Labor  Standards  Estimating 
Module  Is  the  foundation  of  this  methology.  ' 
It  utilizes  Industrial  Engineering  time  stan¬ 
dard  equations  to  calculate  the  "pure"  labor 
hours  associated  with  the  detail  fabrication 
operations  performed  for  composite  parts.  In 
addition,  material  requirements  In  terms  of 
total  am  .1“  usage  and  scrap  are  calculated 
In  detail.  This  computerized  procedure  Is 
primed  by  a  description  of  the  parts  to  be 
fabricated,  specifying  its  construction,  the 
materials  used,  and  the  fabrication  processes 
to  be  performed. 


There  are  four  basic  steps  followed  by  the 
ACCEM  in  estimating  labor  costs:  factory 
labor  standards  estimating,  Tn-factory  labor 
hours  estimating,  support  labor  hours  esti¬ 
mating,  total  labor  dollars  estimating. 

1.  STANDARDS  ESTIMATING 


Standards,  as  defined  in  the  context  of  the 
ACCEM  program,  represent  the  time  required  to 
perform  basic  work  content  of  a  task.  The 
total  task  includes,  in  addition  to  basic  work 
content,  other  activities  that  do  not  directly 
contribute  to  the  fabrication  of  a  part,  sucb 
as  attention  to  the  personal  needs,  delays, 
slowdown  due  to  fatigue,  coffee  breaks,  etc. 
These  activities  are  covered  in  what  Is  termed 
"variance, "  as  discussed  lat‘  r. 


The  Cost  Projection  Module  calculates  esti¬ 
mated  actual  factory  labor  hours  at  a  user- 
specified  production  unit  by  the  application 
of  variance  factors  and  improvement  cu  -ve 
slopes  to  the  factory  labor  standard  hours 
generated  by  the  Standards  Estimating  Module, 
it  also  applies  the  labor,  material  and  over¬ 
head  rates  to  arrive  at  total  recurring  cost. 
Estimates  of  unit,  cumulative,  and  cumulative 
average  cost  at  specified  production  units 
are  generated  based  upon  user  request. 

The  Support  Functions  Estimating  Module  esti¬ 
mates  recurring  engineering,  tooling,  quality 
control,  manufacturing  engineering,  and 
graphic  services  as  well  as  support  material 
thnugb  the  application  of  cost  estimating 
relationships  (CF.Rs). 

An  overview  of  the  ACCEM  computerized  esti¬ 
mating  system  Is  presented  in  Figure  5, 


Factory  labor  standards  estimating  is  accom¬ 
plished  by  Industrial  Engineering  Standard 
equations  that  are  "built  in"  the  Standards 
Estimating  Module  of  the  ACCEM.  These  equa¬ 
tions  define  the  standard  hours  necessary  to 
perform  a  given  operation  in  terms  of  physical 
characteristics  of  the  part  that  the  operation 
Is  being  performed  on. 

The  equations  are  primed  by  description  of 
part  construction,  process,  and  material 
form,  which  are  made  through  input  sheets  de¬ 
signed  for  this  program. 

Industrial  Engineering  Standard  equations  were 
developed  from  basic  stop  watch  time  studies 
performed  in  Northrop  of  various  composite 
fabrics' Ion  operations.  These  operations 
cover  layup,  part  consolidation,  core  prepa¬ 
ration  and  finishing.  The  time  studies  were 
plotted  using  decimal  hours  and  part  dimen¬ 
sions  as  variables.  Least  squares  lines  were 
fitted  through  these  plot  points.  Equations 
of  these  lines  define  the  I.E.  Standard  equa¬ 
tion  for  that  operation. 

An  example  of  an  I.E,  Standard  equation  for 
layup  of  3"  and  12"  wide  unidirectional 
graphite  tape  Is  presented  in  Figure  6. 


PART  COMPLEXITY 


The  cost  estimating  system  contains  factors 
and  equations  that  quantity  the  complexity  of 
a  composite  part.  This  complexi  /t  defined 
in  terms  of  bends,  is  measured  by  the  amount 
of  additional  effort  required  to  form  the  part 
to  Its  required  shape  during  the  layup  pro¬ 
cess.  The  hours  representing  this  additional 
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FIGURE  I.  LAVUf  OF  3"  A  12"  UNI  G/E  TAPE 

effort  are  added  to  the  total  fabrication 
hours. 

Bends  have  been  classified  under  two  major 
categories:  Straight  Bends  and  Curved  Bends. 
Straight  bends  have  bend  lines  that  follow  a 
straight  line  pattern.  They  may  be  sharp 
(abrupt  change  In  ply  plane  direction)  or  ra¬ 
dial  (gradual  change  In  ply  plane  direction, 
i.e.,  having  a  radius  of  curvature).  In 
addition,  straight  bends  may  be  described  as 
male  (layed  up  on  a  male  tool)  or  female 
(layed  up  on  a  female  tool).  Curved  bends 
have  bend  lines  that  follow  a  curved  pattern. 
They  cause  either  a  shrink  or  stretch  condi¬ 
tion  In  the  part  flanges.  Figures  7  and  8 
Illustrate  these  different  types  of  bends. 

The  hours  associated  with  each  type  of  bend 
were  derived  through  a  detailed  analysis  of 
data  collected  from  actual  observation  of 
layup  operations.  When  laying  up  on  bends, 
extra  effort  is  required  to  smooth  down  piles 
along  the  bend  line.  The  amount  of  extra 
effort  required  varies  for  each  type  of  bend 
and  Is  generally  a  function  of  bend  length 
and,  when  applicable,  radius  of  curvature 
and  flange  width.  Aa  an  example,  smoothing 
down  a  ply  layed  up  on  a  male  tool  along  a 
straight  bend  simply  involves  the  application 
of  pressure  along  the  exposed  headline.  For 
curved  bends,  however,  pre-heating,  cutting 
of  gores  or  darts  and/or  stretching  of  plies 
might  be  necessary  tc  obtain  the  desired  part 
shape.  These  degrees  of  complexity  have 
been  quantified  and  are  contained  in  the 
Standards  Estimating  Module. 
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2.  PROJECTION  OF  STANDARDS 


The  standards  calculated  through  the  Indus¬ 
trial  Engineering  Standard  equations  account 
only  for  the  basic  work  content  of  a  task  and 
do  not  allow  fur  other  elements  which  are  part 
of  factory  labor  as  experienced  in  a  real  pro¬ 
duction  environment,  such  as  fatigue,  waiting 
time  for  tools  and  materials,  attention  to 
personal  needs,  etc.  Pigure  9  depicts  the 
total  work  content  of  factory  labor. 
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Developing  estimates  of  factory  labor  hours  at 
specified  units  of  production  is  accomplished 
by  the  application  of  appropriate  variance 
factors  to  the  standards.  These  variance 
factors  represent  allowances  for  these  ele¬ 
ments  which  must  be  accounted  for  in  estimat¬ 
ing  the  total  work  content  of  factory  labor. 

In  applying  variances  to  the  standards,  the 
computer  calculates  the  appropriate  variance 
factor  by  solving  the  variance  equations  de¬ 
veloped  in  this  program.  These  variance  equa¬ 
tions  define  the  factors  to  be  used  given  the 
unit  number  and  the  process  Involved,  l.e. 
iaytp,  part  consolidation,  core  preparation 
or  finishing.  The  variance  application  rou¬ 
tine  Is  pe.'fo  .ied  In  the  cost  projection  mod¬ 
ule  Of  the  ACCEM. 

The  development  of  the  variance  and  improve¬ 
ment  curve  equations  were  based  on  fiberglass 
and  aluminum  honeycomb  core  fabrication  data. 
Fiberglass  experience  was  selected  as  a  base 
for  developing  variances  for  composite  related 
operations,  l.e.,  layup,  part  consolidation, 
and  finishing,  because  of  Its  closj  similarity 
to  composites  particularly  In  methods  o"  fab¬ 
rication.  Variances  for  each  process,  l.e., 
actual  hours  divided  by  standards,  were  plotted 
on  logarithmic  charts, 

Anclysls  of  these  plots  shows  the  distinctive 
behavior  of  variance  points  In  relation  to 
production  units,  i.e. ,  the  initial  units  have 
greater  fluctuations  about  a  least  squares 
line  and  show  a  much  steeper  slope  compared 
to  the  latter  production  units.  To  more 
closely  simulate  these  actual  experier :es  and 
be  sensitive  to  these  observed  characteris¬ 
tics,  the  "dog-leg"  approach  was  fitted 
through  the  initial  10  plot  points  (represent¬ 
ing  unit3  1  through  10)  and  then  through  sub¬ 
sequent  points.  The  two  best  fit  curves  were 
then  made  to  Intersect  to  determine  the  break 
point  In  the  "dog-leg"  curve.  An  alternative 
approach  that  vas  Investigated  was  the  hyper¬ 
bolic  function  of  the  forms  Y  ■>  A  +  —  . 

These  curves  have  a  shape  in  the  logarithmic 
grid  that  Is  similar  to  a  logarithmic  "dog¬ 
leg",  l.e.,  the  slopr  c  these  curves  starts 
out  steep  and  grad*  .  y  flattens  out  as  the 
number  of  units  Increase.  Variance  curves  for 
layup,  core  preparat-.cn,  part  consolidation 
and  finishing  are  illustrated  In  Figure  10. 


3.  SUPPORT  LABOR  ESTIMATOR) 


Support  labor  covers  the  recurring  activities 
performed  In  support  of  the  factory  effort. 
This  Includes  recurring  quality  control,  engi¬ 
neering,  tooling,  planning  ar.d  graphics  ser¬ 
vices.  Fneh  of  the  support  labor  functions  Is 
est*  anted  as  a  percentage  of  factory  labor. 
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This  procedure  follovs  two  steps.  First,  the 
appropriate  factor  Is  determined  by  solving 
the  equations  that  have  been  developed  In  the 
ACCEM  for  each  of  the  support  labor  elements. 
These  equations  (cost  estimating  relationships) 
relate  the  factors  to  be  applied  to  labor  to 
the  production  unit  number.  The  derived  fac¬ 
tors  are  then  applied  to  factory  labor  hours 
to  arrive  at  labor  hours  for  each  support  labor 
element. 

The  support  labor  equations  were  developed 
based  on  Northrop' s  fiberglass  fabrication 
history.  The  user,  however,  is  provided  the 
option  of  using  his  own  factors.  This  option 
can  be  exercised  through  the  cost  projection 
input  sheets;  this  automatically  preempts  the 
support  labor  equations  contained  in  the 
program. 


4.  LABOR  RATES  APPLICATION 


Labor  hours  estimates  for  factory  and  support 
are  projected  to  dollars  through  the  applica¬ 
tion  of  labor  rates,  which  are  provided  by  the 
user  through  the  cost  projection  input  sheets 
of  the  ACCEM. 


MATERIAL  ESTIMATING 
1.  PRODUCTION  MATERIAL  ESTIMATING 


Composite  material  costs  are  also  estimated 
by  the  ACCEK's  standards  estimating  module. 
From  inputs  that  describe  the  dimensions  and 
orientation  of  each  ply,  the  computer  deter¬ 
mines  the  minimum  amount  of  composite  material 
necessary  to  cover  each  ply,  in  multiples  of 
the  composite  raw  material  width.  The  mate¬ 
rial  used  for  each  ply  is  then  accumulated  to 
determine  the  total  material  usage.  Scrap  is 
calculated  by  the  difference  between  the  net 
ply  area  and  the  area  covered  by  the  material. 
To  illustrate  this  procedure,  an  example  is 
presented  below. 

Production  material  costs  are  calculated  by 
taking  the  net  material  used  in  square  Inches 
(total  material  usage  -  scrap)  and  converting 
this  into  pounds  by  applying  the  appropriate 
density  factors  resident  in  the  program.  The 
cost  per  pound  of  this  material  is  then  ap¬ 
plied  to  the  weight  of  the  net  material'  used 
to  obtain  production  material  dollars. 


2.  MANUFACTURING  MATERIAL  ALLOWANCE 


Manufacturing  allowance  accounts  for  the  cost 
of  rework  and  scrap  material  experienced  in 
the  production  environment. 


I" 


TOTAL  MATERIAL  USED  •  15x25  ■  375  mm. 

SCRAP  MATERIAL  •  (15-10x25  •  25«qin. 

PRODUCTION  MATERIAL  -  375  -  25  ■  350 sqm. 

Catena"  •thickness , density (im/cu m.> . )™ " 

PRODUCTION 

MATERIAL  x  UNIT  COST  (S/lb)  •  PRODUCTION 
WEIGHT  ^MATERIAL  COST  (SI 


PRODUCTION  MATERIAL  ESTIMATING 


The  CER  FOR  Manufacturing  Allowance  is  as 
follows: 

MA$  «  (0.02FL?)  +  (SCRAP?) 

where: 

MA?  »  Manufacturing  Allowance 
FL$  “  Factory  Labor  Dollars 
SCRAP?  ■  Scrap  Material  Dollars 

The  scrap  material  costs  are  calculated  In  tbs 
same  manner  as  production  material  and  becomes 
part  of  manufacturing  material  allowance. 


SUPPORT  MATERIAL 


Support  Material  consists  of  purchaatd  parts, 
equipment  standard  parts,  and  process  material 
required  to  supjort  the  fabrication  of  compos¬ 
ite  parts.  This  category  covers  tuoling,  en¬ 
gineering  and  allocated  material,  and  includes 
such  items  ts  vacuum  film,  Oenaburg  cloth, 
thermocouple  wire,  teflon,  potting  compounds, 
and  adhesive  agents. 

The  CER  for  Recurring  Support  Material  is  as 
follows: 

SH?  -  0.30  (DM?) 

where: 

SM?  ■  Support  Material  Dollars 
DM?  -  Direct  Material  Dollars 


ESTIMATING  LABOR  OVERHEAD,  MATERIAL  BURDEN 
AND  G  &  A 


Labor  overhead  Is  estimated  by  the  cost  projec¬ 
tion  module  of  the  ACCEM  by  applying  factors 
to  factory  labor  dollars.  The  cost  projection 
input  sheets  allow  the  user  to  enter  the  ap¬ 
propriate  labor  overhead  factors. 

In  the  same  manner,  material  burden  is  calcu¬ 
lated  through  the  application  of  material  bur¬ 
den  rates  to  total  material,  i.e.,  production 
material,  support  material  and  manufacturing 
material  allowance. 

Gener-.i  and  Administrative  costs  are  estima¬ 
ted  as  a  pcrcen. ige  of  total  labor  and  mate¬ 
rial  (Including  labor  overhead  and  material 
burden).  This  percentage  is  likewise  speci¬ 
fied  by  the  user  in  the  input  sheets. 


ACCEM  FEATURES 


The  salient  features  of  the  ACCEM  that  make  . 
an  effective  tool  in  cost  analysis  are  as 
follows: 

•  Estimates  in  detail  -•  The  model  identi¬ 
fies  the  detail  operations  involved  in 
fabrication  and  determines,  from  its 
broad  Industrial  Engineering  Standards 
base,  the  costs  associated  with  each  of 
these  operations.  In  addition,  it  is. 
capable  of  estimating  total  material 
usage,  costs  for  each  type  materiol, 
material  scrap  factor,  and  weight  of 
the  part.  As  a  result,  high  cost  areas 
related  to  design  and  manufacturing  pro¬ 
cesses  become  readily  identifiable  -  a 
very  significant  facet  in  design/process 
evaluation. 

•  Fast  --  The  computerization  of  this  meth¬ 
odology  provides  the  capability  of 
generating  timely  cost  information.  In 
addition,  it  nulckly  responds  to  changes 
in  a  design,  material  process,  and  other 
parameters  that  Itr-  t  costs. 

•  Trade-off  Capabi.-ty  —  This  system  was 
designed  to  be  sensitive  to  alternative 
manufacturing  processes  and  parts  design. 
This  sensitivity  provides  the  user  with 
the  capability  for  determining  relative 
cost  differences  between  alternative  de¬ 
signs  end  manufacturing  processes,  at  a 
total  level  or  at  a  detailed  level. 

This  trade-off  capability  exists  in  all 
phases  of  composite  structures  develop¬ 
ment.  At  the  conceptual  level,  this  sys¬ 
tem  can  generate  all  sample  data  required 
to  make  a  reasonable  assessment  and  eval¬ 
uation  of  alternative  design  concepts. 


The  data  generated  will  show  In  detail 
the  areas  where  cost  differences  lie  and, 
therefore,  enable  the  user  to  determine 
where,  when  and  why  a  design  concept  Is 
more  cost  effective  when  compared  to 
other  concepts. 

•  Cost  Effective  —  The  application  of  the 
ACCEM  requires  considerably  less  time 
and  Manpower  than  does  the  manual  detail 
estimating  process. 

•  Adaptability  --  The  ACCEM  has  been  struc¬ 
tured  to  allow  the  incorporation  of  new 
Drocesses,  materials  and  equipment  as 
data  u£  •  -es  available. 


ACCEM  MODIFICATION 


A  project  to  modify  the  ACCEM  is  currently 
being  planned.  The  objective  of  this  modifi¬ 
cation  l-  to  make  the  ACCEM  an  even  more  ef¬ 
fective  lojl  Cor  composite  cost  analysis.  It 
will  Incorporate  new  standards,  new  methods, 
new  materials  and  new  ideas  generated  through 
feedback  from  the  various  ACCEM  users  in 
industry. 

Specific  areas  identified  for  modification 
include: 


•  Input  Methodology 

Inputs  to  the  ACCEM  are  being  redesigned 
for  simplicity  and  adaptability  to  an 
"on-line"  mode.  The  number  of  input 
sheets  will  also  be  cut  down  from  the 
current  six  pages  to  one. 

•  Output  Data 

The  Modification  effort  will  provide 
users  with  a  selection  as  to  the  type 
of  output  desired.  Three  basic  types 
will  be  provided: 

1)  detail-showing  all  detail  opera¬ 
tions,  parameters,  and  calculated 
labor  and  material; 

2)  standard  -  showing  operation  cate¬ 
gories  and  calculated  labor  and 
material  costs; 

3)  Sumaary  -  showing  labor  and  mate¬ 
rial  costs  for  the  structure. 


The  scope  of  the  current  ACCEh  will  be 
expanded  to  include  the  assembly  of 
composite  parts;  other  composite  mate¬ 
rials  such  as  Boron,  Kevlar,  etc.;  mate¬ 
rial  price  fluctuations;  production 
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rate  changes  and  their  Impact  on  manu¬ 
facturing  costs;  new  composite  manufac¬ 
turing  methods  such  as  automated  cut¬ 
ting  techniques;  automated  ply  transfer, 
etc. 

b  Standards 

Industrial  Engineering  standards  In  the 
ACCEM  will  be  updated  based  upon  most 
recent  Industrial  Engineering  Studies 
of  composite  operations.  These  new 
standards  will  increase  the  system's  ac¬ 
curacy  and  consistency  in  estimating. 


The  ACCEM  concept  has  become  the  basis  or 
foundation  for  an  extension  into  other  cost 
estimating  modules. 

The  Second  part  of  Northrop* s  overall  plan  Is 
the  development  of  an  estimating  system  for 
metallic  detail  parts.  Two  major  models  are 
currently  being  developed  by  two  project  teams 
in  Northrop:  The  Sheet  Metal  Automated  Cos' 
Estimating  Model  (SMACEM)  and  the  Machine  1 
Parts  Automated  Cost  Estimating  Model  (MPACEM). 

These  two  models  cover  the  cross-hatched  por¬ 
tion  of  Figure  11. 


FIGURE 11.  STEPS  TO  DEVELOP  AH  INTESNATED 
MANUFACTURING  COST  ESTIMATING  MOOEL 


SHEET  METAL  AUTOMATED  COST  ESTIMATING  MODEL 
(SMACEM) 

Northrop  Is  nearing  completion  of  the  develop¬ 
ment  of  the  computerized  methodology  for  esti¬ 
mating  factory  labor  hours  associated  with  the 


fabrication  of  sheet  metal  parts.  The  SNAt.KM 
will  provide  an  estimating  capability  appli¬ 
cable  to  operations  Including  cutting  (e.g. 
shear,  saw,  rout,  punch,  drill),  forming  (e.g., 
hydropress,  brakepress ,  drawpress,  drop  harocr, 
stretchwrap,  roll  form),  and  other  operations 
necessary  to  complete  the  fabrication  of  parts 
made  from  aluminum  sheet  stock. 


Since  a  relatively  high  portion  of  Northrop1 s 
manufacturing  effort  addresses  aluminum  sheet 
metal  fabrication,  o  computerized  methodology 
offered  significant  potential  benefits.  The 
SMACEM  will  provide  these  benefits  for  esti¬ 
mating  sheet  metal  parts  as  well  ns  serve  as 
a  model  for  the  other  areas  of  metals 
fabrication. 


Estimating  factory  labor  hours  associated  with 
sheet  metal  fabrication  involves  1)  determin¬ 
ing  the  manufacturing  concept,  2)  defining  the 
manufacturing  plan  by  Identifying  the  opera¬ 
tions  in  sequence,  3)  Identifying  the  basic 
standards  data  associated  with  those  opera¬ 
tions,  4)  applying  the  data  to  calculate  set 
up  and  run  time,  and  5)  applying  variance  fac¬ 
tors  and  learning  curves  to  arrive  at  esti¬ 
mated  hours.  The  SHACEM  approach  augments  the 
fundamental  Industrial  Engineering  Standards 
approach  with  the  application  of  Standard  Man¬ 
ufacturing  Plans  to  aszict  with  step  2)  as 
well  as  steps  3)  "-  5) . 

Standard  Manufacturing  Plans  identify  the  op¬ 
erations  generally  Involved  with  a  particular 
manufacturing  concept.  They  aid  the  planning 
process  by  providing  a  baseline  of  conmon  ele¬ 
ments.  These  standard  plans  were  compiled 
from  analysis  of  the  shop  plans  generated  for 
normal  production  operations. 

The  SMACEM  contains  over  thirty  standard  plans 
from  which  the  user  can  select  and  modify  if 
necessary  to  fit  the  unique  characteristics 
of  the  part.  Based  upon  user-specified  physi¬ 
cal  and  operational  parameters  the  SMACEM  iden¬ 
tifies  the  associated  standards  basic  data  and 
applies  the  data  to  calculate  set  up  and  run 
time  standards. 

As  of  this  writing,  the  SMACEM  computer  pro¬ 
gram  is  being  Installed  at  Northrop,  and  is 
expected  to  be  operational  in  July  1978.  The 
next  activity  will  be  to  expand  the  model  to 
cover  other  materials  (e.g.  titanium,  steel, 
and  magnesium)  and  forms  (e.g.  extrusions, 
tubes). 


MACHINED  PARTS  AUTOMATED  COST  ESTIMATING 
MODEL  (MPACEM) 


The  detail  cost  estimating  procedure  currently 
used  st  Northrop  provides  a  methodology  for 
deriving  accurate  factory  labor  cost  estimates 


for  detail  machined  parts.  The  procedure  is 
basically  a  manual  effort  from  the  time  an 
engineering  drawing  or  statement  of  work  is 
analyzed  and  a  process  plan  developed  to  the 
breakdown  of  the  operations  into  their  work 
content,  application  of  associated  labor  stan¬ 
dards  and  summarization  into  a  cost  package. 
This  procedure  is  lengthy,  time  consuming  and 
complex  because  of  the  numerous  alternate 
product  types,  machine  capabilities  and  shop 
practices  to  be  considered.  The  current  situ¬ 
ation  is  such  that  cost  estimates  must  be 
developed  faster  in  order  to  meet  proposal 
deadlines,  yet  still  maintain  an  acceptable 
level  of  accuracy,  consistency  and  auditability. 

The  MPACr..-.  -ill  reduce  the  standards  applica¬ 
tion  manhours  by  controlling  most  of  the  nan- 
ual  decision  making  effort  relative  to  defin¬ 
ing  the  detail  work  content  and  applying  as¬ 
sociated  labor  and  machining  standards.  The 
approach  will  entail  use  of  feasible  data 
management  techniques  such  at  grouping  data 
into  higher  level  categories  or  averaging  labor 
standards  based  on  analysis  of  types  of  prod¬ 
ucts  and  machining  methods.  Furthermore,  it'-, 
conceivable  that  techniques  used  in  existing 
computer  systems  developed  by  other  companies 
will  be  incorporated  in  Hi’ACEM  when  the 
racthocoiugy  or  standard  data  arc  compatible. 

MPACEII  will  tie-in  to  Northrop' s  future  Com¬ 
puter  Aided  Manufacturing  (CAM)  system  and 
other  business  systems.  The  CAM  project  is 
planned  to  integrate  the  design,  process 
planning  and  standards  application  functions. 
The  benefits  associated  with  CAM  are  encourag¬ 
ing  and  represent  a  tool  to  increase  the  pro¬ 
ductivity  of  today's  cost  estimator. 


SYSTEM  DESCRIPTION 


MPACEM  will  have  the  capability  of  1)  providing 
sec  up  and  run  standard  hours  by  machine  type, 
operation  and  work  element,  2)  providing  a 
summary  total  of  standards  by  part  and  3)  pro¬ 
viding  timely  output  reports  and  various  for¬ 
mats.  Furthermore,  the  system  will  be  designed 
so  as  tc  minlnize  the  •  e  to  maintain  the  sys¬ 
tem  logic  or  create  n*  output  formats. 

This  system  will  replace  most  of  the  current 
manual  effort  associated  with  defining  the 
work  content  of  detail  machined  parts,  apply¬ 
ing  labor  standards  to  the  work  content  using 
Northrop' s  Basic  Standard  Data  Manual  and  pre¬ 
paring  all  hondwrlttan  backup  documentation. 
ThoHu  objectives  will  ba  achieved  with  compu¬ 
terized  methodologies  initiated  by  input  data 
provided  by  cost  estimators  defining  the  part 
size  and  shape,  material  type,  machine  types, 
machining  operations,  holding  devices,  cutting 
tools  and  metal  removal  requirements.  Using 
this  input  data,  the  system  will  compute  1) 
the  applicable  work  elements  and  labor  standards, 


and  2)  machining  feeds  and  speeds,  nurafcer  of 
cuts  and  machining  standards.  The  logic  will 
be  developed  from  detailed  analysis  of  the 
present  end  expected  standard  application 
methodologies.  Currently,  they  are  not  well 
defined  or  standardized.  Each  estimator  uti¬ 
lizes  his  own  decision  paths  to  determine  the 
methods  .and  standards  to  manufacture  a  part. 
Since  there  are  several  alternate  manufactur¬ 
ing  paths  and  Interpretations  of  the  data  in 
the  Basic  Standard  Data  Manual,  standard  appli¬ 
cation  inconsistencies  do  occur.  This  system 
will  direct  estimators  towaid  more  accurate 
u— '  '•onsistent  results  by  minimizing  the  sub¬ 
jectivity  osi  stated  with  interpreting  the 
Basic  Standard  Data  Manual. 


PARAMETRIC  MODELING 


Our  previous  discussion  has  been  couched  in 
terms  of  addressing  Northrop1 s  cost  estimat¬ 
ing  methodology  and  the  expansion  of  the 
Advanced  Composite  Cost  Estimating  Model  as 
well  as  the  development  of  estimating  systems 
for  sheet  metal  fabrication  and  the  machining 
of  metallic  parts.  As  you  recall,  all  of 
these  systems  are  based  upon  "grassroots" 
estimating  i.e.,  total  structure  estimates 
are  built  up  from  detail  estimates  of  the 
structure's  components. 

However,  parametric  estimating  which  is  based 
on  Cost  Estimating  Relationships  (CRR's)  is 
still  with  us  and  is  accepted  and  widely  em¬ 
ployed  by  both  government  and  Industry  be¬ 
cause  of  its  speed  and  case  of  application. 
This  technique  utilizes  mathematical  rela¬ 
tionships,  also  called  Cost  Estimating  Rela¬ 
tionships  (CER's),  derived  from  historical 
data  that  relate  physical  parameters  of  a 
structure  to  cost.  Parametric  equations  range 
from  very  gross  rules-of-thumb  type  relation¬ 
ships  to  more  detailed  multi -variate  equations. 
Its  accuracy  is  dependent  on  the  extent,  con¬ 
sistency  and  homogeneity  of  the  data  base 
from  which  it  was  derived.  For  new  technol¬ 
ogies,  such  as  advanced  composites,  relevant 
historical  data  is  lacking  or  non-existent. 

A  by-product  of  Northrop's  effort  in  the  de¬ 
velopment  of  automated  estimating  systems 
based  on  Industrial  Engineering  Time  Stan¬ 
dards  will  bo  the  capability  of  generating  a 
homogeneous  set  of  cost  data  to  derive  CF.R's. 
This  data  will  be  virtually  unlimited;  thus 
the  potential  for  increased  accuracy  and  re¬ 
liability  will  be  substantially  enhanced  and 
for  superior  to  current  CER's  that  are  based 
on  historical  data.  See  Figure  12. 

Dependent  variables,  such  as  factory  labor, 
standard  hours,  total  recurring  co...a,  etc,, 
and  independent  variable*,  such  as  weight, 
surface  area,  etc.,  can  be  abstracted  from 
the  outputs  of  the  ACCEM,  the  SMACEH,  and  the 
MFACEH.  For  example,  reg  'cssion  analysis  can 
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FIGURE  12.  PARAMETRIC  ESTIMATING 


be  performed  relating  surface  area  and  stan¬ 
dard  hours  In  an  unlimited  number  of  generated 
outputs  with  the  resulting  equation  (CER)  used 
for  parametric  estimating.  An  Increase  In  the 
number  of  estimates  generated  will  Increase 
the  accuracy  and  reliability  of  the  relation¬ 
ship.  This  capability  can  be  expanded  by 
adding  parts  to  make  up  assemblies;  by  adding 
assemblies  to  make  up  sections;  and  by  adding 
sections  to  make  up  the  total  airframe.  This 
will  provide  Northrop  with  a  total  cost  data 
bank.  For  example,  if  a  request  is  made  by 


the  Uni  Led  Stales  Government  for  a  mol  esti¬ 
mate  for  a  new  fighter  aircraft  and  the  only 
Information  which  Is  provided  la  the  appioxl- 
mate  size,  type  of  construction  and  maturlal 
form.  With  Just  this  Information  being  desig¬ 
nated  Northrop  will  have  the  capability  to 
generate  an  estimate  for  the  aircraft  In  de¬ 
tail  by  just  changing  a  few  cards  In  the  data 
set. 


SUMMARY 


Cost  has  become  a  significant  parameter  In  the 
design  and  development  of  aircraft  systems. 

Design-to-Cost  is  a  concept  that  Is  being  im¬ 
plemented  throughout  Industry  to  attain  better 
control  of  cost,  especially  at  the  early  stages 
of  aircraft  systems  development. 

To  be  effective,  Deslgn-to-Cost  tools  must  be 
available  during  the  early  stages  of  design 
development.  Current  tools  for  estimating, 
i.e.,  parametrlcs  and  "grass-roots"  have  their 
merits  but  are  Inadequate  for  the  requirements 
demanded  by  Design-to-Cost  (l.e.,  accuracy, 
speed,  and  sensitivity  to  detail  design  and 
manufacturing  process  variations). 

To  respond  to  these  requirements,  Northrop 
has  Implemented  a  plan  to  develop  a  computer¬ 
ized  methodology  utilizing  the  Industrial 
Engineering  Standards  approach.  The  first 
phase  of  this  plan  was  accomplished  In  the 
development  of  the  Advanced  Composite  Cost 
Estimating  Model  (ACCEM)  funded  by  the  Air 
Force  and  the  Navy. 

A  capability  similar  to  the  ACCEM  is  currently 
being  developed  in-house  for  metalllcs.  The 
final  goal  of  this  plan  Is  the  development  of 
the  Integrated  Manufacturing  Cost  Estimating 
System  which  will  estimate  costs  of  total  coro- 
posi te/metallic  airframes  and  structures  in 
detail  as  well  as  for  proposed  weapon  systems 
by  parametric  sizing. 
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IN  DEFENSE  OF  BEST- AND- FINAL  OFFER 

Lucille  S.  Schlcsser,  Headquarters  Air  Force  Acquisition  Logistics  Division 


It  is  time  that  someone  spoke  up  for  that 
much-maligned  event  in  the  source  selection 
process  called  best-and-final  offer.  The 
most  interesting  aspect  in  the  continuing 
bitter  and  biting  criticism  of  that  process 
is  that  it  comes  primarily  from  the  aerospace 
industry.  One  of  the  latest  was  an  article 
in  the  Defense  Systems  Management  Journal 
which  alleges  that  the  "procedures  places 
(sic)  the  procurement  process  in  the  realm 
of  a  used  car  auction  .  .  ."  (1:2  and  1:3) 
There  are  still  a  few  of  us  around  (but 
apparently  not  many!)  who  remember  that  the 
process  was  instituted  as  a  result  of 
complaints  by  that  same  industry.  They  very 
vigorously  and  Insistently  stated  that  some 
common  cutoff  date  had  to  be  established  to 
prevent  auctioning.  How  then  did  the  best- 
and-final  offer,  which  was  devised  to  resolve 
that  complaiit,  later  become  the  culprit  in 
new  allegatiins  of  auctioning? 

Let  us  review  some  history.  In  1959,  the 
ASPR  read  as  follows: 

"(a)  The  hormal  procedure  in  negotiated 
procurements,  after  receipt  of  initial 
proposals,  is  to  conduct  such  written  or  oral 
discussions  as  may  be  required  to  obtain 
agreements  most  advantageous  to  the 
Government.  Negotiations  shall  be  conducted 
as  follows: 

(I)  where  a  responsible  offeror  submits- 
a  responsive  proposal  which,  in  the  contract¬ 
ing  officer's  opinion,  is  clearly  and  sub¬ 
stantially  more  advantageous  to  the 
Government  than  any  other  proposal,  negotia¬ 
tions  may  be  conducted  with  that  offeror 
only;  or 

(II)  where  several  responsible  offerors 
submit  offers  which  are  grouped  so  that  a 
moderate  change  in  either  the  price  or  the 
technical  proposal  would  make  any  one  of  the 
group  the  most  advantageous  offer  to  the 
Government,  further  negotiations  should  be 
conducted  with  all  offerors  in  that  group. 
Whenever  negotiations  are  conducted  with  more 
than  one  offeror,  no  indication  shall  be 
made  to  any  offeror  of  a  price  which  must  be 
met  to  obtain  further  consideration,  since 
such  practice  constitutes  an  auction  technique 
which  must  be  avoided.  No  Information  regard¬ 
ing  the  number  or  Identity  of  the  offerors 
participating  In  the  negotiations  shall  be 
made  available  to  the  public  or  to  anyone 
whose  official  duties  do  not  require  such 
knowledge.  Whenever  negotiations  are  being 
conducted  with  several  offerors,  while  such 
negotiations  may  be  conducted  successively, 
all  offerors  participating  In  such 


negotiations  shall  be  offered  an  equitable 
opportunity  to  submit  such  pricing,  technical, 
or  other  revisions  in  their  proposals  as  may 
result  from  the  negotiations.  All  offerors 
shall  be  informed  that  after  the  submission 
of  final  revisions,  no  Information  will  be 
furnished  to  any  offeror  until  award  has  been 
made.  Modifications  of  proposals  received 
after  the  submission  of  final  prices  shall  be 
considered  only  under  the  circumstances  set 
forth  in  ASPR  3-804. 2(b)  (relating  to  late 
proposals)."  (1:343) 

Note  that  we  could  negotiate  with  only  one 
proposer,  if,  in  the  judgment  of  tliecontract- 
ing  officer,  that  one  proposal  was  clearly 
the  best. 

Also  note  that.  If  negotiating  with  more  than 
one  proposer,  "auction  techniques"  were  for¬ 
bidden,  but  the  reference  is  in  relation  to 
improper  Indication  of  a  price  which  must  be 
met.  Multiple  negotiations  could  be  held 
successively  with  those  who  submitted  tech¬ 
nically  acceptable  proposals,  but  each  must 
be  offered  an  opportunity  to  submit  a  “final 
revision."  ^here  is  no  mention  of  a  single 
cutoff  date  for  alT"rev1s1ons. 

In  practice  what  happened  was  that  proposers 
maneuvered  very  carefully  not  to  be  the  first 
to  submit  "final  revisions."  Their  reasoning 
was  that  they  were  afraid  those  prices  would 
leak  and  their  competitors  would  come  in 
below  them.  Sometimes  they  submitted  a 
revision  consisting  of  a  portion  of  that 
which  they  were  willing  to  reduce  without 
calling  it  "final"  and  waited  to  see  if  the 
contracting  officer  was  going  to  accept  it  or 
if  he  was  going  to  negotiate  with  someone 
else.  If  the  proposer  found  that  In  fact 
negotiations  were  going  on  with  others,  he 
often  submitted  another  revision.  The 
situation  became  like  a  game  of  tennis  with 
three  or  four  balls  in  play. 

There  were  many  criticisms  of  this  system. 
There  were  accusations  from  Industry  that 
evaluators  and/or  contracting  officers  were 
arbitrary  in  their  decisions  to  negotiate 
with  only  one  proposer;  there  were  claims  of 
leaks  (deliberate  or  othenvfse)  which  led  to 
auctioning.  Contracting  officers  complained 
of  harassment  by  aggressive  competitors 
during  the  successive  negotiation  cycles  and 
of  an  Inability  to  pin  proposers  down  to  a 
"final  revision.” 

In  1962,  the  ASPR  was  revised  to  alleviate 
seme  of  these  perceived  Ills.  Excerpts  of 
that  Issue  follow: 
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"(a)  After  receipt  of  initial  proposals, 
written  or  oral  discussions  shall  be  con¬ 
ducted  with  all  responsible  offerors  who 
submit  proposals  within  a  competitive  range, 
price  and  other  factors  considered.  .  . 

(b)  ...  Whenever  negotiations  are  con¬ 
ducted  with  several  offerors,  while  such 
negotations  may  be  conducted  successively, 
all  offerors  selected  to  participate  in  such 
negotiations  (see  3-805.1 (a)  above)  shall  be 
offered  an  equitable  opportunity  to  submit 
such  price,  technical,  or  other  revisions 
in  their  proposals  as  may  result  from  the 
negotiations.  All  such  offerors  shall  be 
informed  of  Hie  specified  date  (and  time  if 
desired)  of  the  closing  of  negotiations  and 
that  any  revisions  to  their  proposals  must 
be  submitted  by  that  date.  All  such  offerors 
shall  be  informed  that  any  revision  received 
after  such  date  shall  be  treated  as  a  late 
proposal  in  accordance  with  the  'Late 
Proposals'  provisions  of  the  request  for 
proposals  .  .  ."(2:354.1) 

Note  the  requirements  to  negotiate  with  all 
those  "within  a  competitive  range,"  the  first 
time  that  phrase  appears.  Contracting 
Officers  were  required  to  inform  proposers 
of  a  specified  date  and  time  of  closing  of 
negotiations  and  to  apply  the  provisions 
concerning  late  proposals  after  that  date. 

This  revision  deleted  the  authority  to  negoti¬ 
ate  with  only  one  proposer  unless  award  could 
be  made  without  further  discussion,  and  ' 
unless  a  notification  as  to  that  possibility 
had  been  placed  in  the  request  for  proposal. 

Now,  we  had  ostensibly  taken  care  of  the 
problems  under  the  previous  method,  but  note 
that  "competitive  range"  was  in  no  way 
defined.  Also,  there  was  still  latitude  for 
the  contractors  to  submit  more  than  one 
revision  since  the  words  "best-and-final 
offer"  or  "common  closing  date"  do  not  appear. 

So  once  again  we  had  allegations  of  unfair 
limiting  of  numbers  of  competitors  and  the 
contracting  officer  was  aseiged  by  numerous 
changes  from  the  comoe:  ng  contractors  up 
until  he  declared  negot-.ations  "closed." 

The  words  regarding  best-and-final  offer  and 
conmon  closing  date  are  relatively  recent. 

They  did  not  appear  in  the  ASPR  until 
Hay  1973. 

And  where  are  we  today?  Since  1962,  up  until 
the  recent  test  of  the  so-ctlled  "four-step" 
approach ,  contracting  officers  have  had  no 
latitude  to  negotiate  with  only  one  pi'oposer. 
They  iave  carried  on  extensive  parallel 
neyot  attons  with  all  those  In  the  competitive 
range  and  competitive  range  is  given  a  very 
hrond  Interpretation  in  the  current  ASPR. 
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Atjthe  end  of  these  dicussions/negotiations, 
all  competitors  remaining  in  the  competitive 
range  have  one  final  opportunity  to  submit 
revisions  which  (since  1973)  must  be  received 
byia  corunon  cutoff  date  established  by  the 
contracting  officer, 
j 

What  icomplaints  came  from  this  system?  First 
wejhaive  had  the  allegation  that  we  do  tech¬ 
nical  leveling  in  our  discussions,  but  most 
of  all  we  have  had  the  allegation  that  best- 
and-final  offer  procedures  constitute  auction¬ 
ing'  The  problem  is  that  we  hear  that 
complaint,  re  matter  what  method  is  used  to 
close  negotiations  but  we  hear  no  solutions. 

It} will  be  very  Interesting  to  see  what  comes 
out  of  the  requirement  in  the  four-step 
approach  for  a  common  cutoff  date  for  final 
proposals.  Even  though  negotiations  may  sub¬ 
sequently  take  place  with  one  offerpr,  won't 
tnat  conmon  cutoff  date  be  viewed  tjy  Industry  . 
as } a  last-and-final  chance  and  therefore  be 
considered  as  having  auctioning  overtones? 

i 

In  fact,  such  allegations  were  made)  in 
connection  with  the  test  cases,  1.^.,  that 
contractors  offered  buy-in  proposal's  at  this 
point,  after  having  "discovered"  that 
competitor(s)  were  below  them  in  price. 

(3:20) 

I  consider  some  conmon  cutoff  date  a  necessity 
unless  we  return  to  the  1959  system  of 
discussing/negotiating  only  with  the  one  who 
appears  best  technically  on  the  basis  of  the 
original  proposal  without  allowing  any 
revisions.  It  appears  that  negotiating  with 
one  proposer  is  economical,  both  to  the 
Government  and  to  industry.  Would  industry 
be  willing  to  accept  the  fact  that,  if  they 
misunderstood  the  terms  of  the  request  for 
proposal  in  any  way,  they  would  not  have  an 
opportunity  to  offer  supplemental  or 
corrected  material?  Would  the  Government  be 
willing  to  take  that  same  chance,  that  some¬ 
one  highly  competent  might  misconstrue  and 
thereby  lose  all  opportunity  for  award?  Some 
Government  negotiators  offered  as  a  criticism 
of  the  test  of  the  four-step  approach,  the 
inability  to  hold  any  extensive  discussions 
prior  to  selection  of  the  one  with  whom  to 
negotiate.  But  we  must  keep  in  mind  that  GAO 
has  ruled  that  there  must  be  an  opportunity 
at  a  conmon  time  for  best-and-final  offers 
if  any  questions  are  discussed  with  any  of 
the  proposers,  and  therefore  we  are 
immediately  back  to  the  perception  of  auction 
if  any  discussions  are  necessary. 

i 

Or,  even  if  we  negotiate  with  more  than  one, 
would  we  really  want  to  complete  negotiations 
down  to  a  firm  handshake  on  price?  «ould  the 
contracting  officer  be  accused  of  deliberately 
accepting  offers  that  were  noncompetitive  in 
order  to  force  out  some  proposers? 
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In  1972,  in  an  article  printed  in  the  NCMA 
Anthology,  a  vice-president  of  one  of  the 
major  aerospace  contractors,  in  discussing  a 
then-new  NASA  directive,  stated  that  the 
directive  .  .  also  recognizes  that  efforts 
to  obtain,  in  the  process  of  evaluation  and 
selection,  detailed  commitment  in  contractual 
form  from  each  of  the  competing  sources  lead 
inevitably  to  auction  techniques  .  . 

(4:83)  So,  if  we  tried  to  establish  firm, 
final  agreement  during  the  negotiation 
process,  we  would  return  once  more  to  the  old 
allegations  of  auction. 


The  four-step  method  is  an  attempt  to  compro¬ 
mise  the  obvious  disadvantages  posed  by  the 
above  questions.  It  has  many  positive 
aspects,  although  I  do  not  believe  it  will 
eliminate  the  problem  of  buy-in  or  allega¬ 
tions  of  auctioning  as  long  as  we  have 
"discussions"  followed  by  a  best-and-final 
offer,  even  though  that  process  precedes 
negotiations  with  one  offeror. 


While  there  has  been  much  ado  in  recent 
years  concerning  the  erosion  of  the  authority 
of  the  contracting  officer,  it  appears 
highly  unlikely  that  we  will  be  able  to 
revert  to  the  authority  he  had  in  1959.  If 
we  could,  then  at  least  on  smaller  or  less 
complex  procurements,  which  do  not  require 
full  scale  source  selection  procedures,  we 
could  permit  the  selection  of  one  competitor 
with  whom  to  negotiate  without  any  require¬ 
ment  for  discussion  and  revisions.  The  mere 
fact  that  this  could  be  done  would  force  the 
submission  of  the  best  possible  offer  on  the 
first  round  of  proposals,  and  selection  of 
one  with  whom  to  negotiate  under  that 
system  would  eliminate  any  need  for  best-and- 
final  offers. 


However,  having  experienced  the  difficulties 
that  can  be  caused  by  numerous,  uncontrolled 
"revisions"  in  the  1959-62  era.  It  does  not 
seem  realistic  or  practical  or  desirable 
to  eliminate  a  common  cutoff  for  revisions, 
including  price  revisions,  if  discussions  or 
negotiations  or  clarifications— call  it  what 
you  wish— are  going  to  go  on  with  several 
proposers,  either  under  the  four-step  method 
or  under  the  tystem  of  parallel  negotiations. 
Notwithstandirg  the  criticism  leveled  at 
best-and-fina  offer,  it  seems  the  only  fair 
way.  It  can  ie  abused,  but  I  believe  the 
allegations  o:  abuse  to  be  overstated. 
Repetitive  requests  for  best-and-final  offers 
are  not  the  norm.  Nevertheless,  any  admin¬ 
istrative  procedure  can  be  abused  and  this 
one  has  been  both  abused  and  misused  by  both 
parties.  Nevertheless,  there  seems  to  be 
no  reasonable  alternative.  It  is  not 
credible  that  proposers  or  the  contracting 
officers  want  to  return  to  a  system  of 
repetitive  revisions  precipitated  by  the 
competitors'  perception  of  where  they  stand 


in  the  competition  as  the  source  selection 
process  evolves.  Without  some  provision 
for  a  date  for  the  final  offer,  that  is 
exactly  what  would  happen— again! 
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FOUR-STEP  SOURCE  SELECTION 
MEANINGFUL  DISCUSSIONS  STILL  A  PROBLEM 

Laurence  M.  Small,  Enquire 
Counsel 

Applied  Technology  Laboratory 
US  Army  Research  &  Technology  Laboratories  (AVRADCOM) 
Fort  Eustis,  Virginia 


As  part  of  revised  Department  of  Defense  (DOD) 
Directive  A 105. 62,  "Selection  of  Contractual 
Sources  for  Major  Defense  Systems",  a  service 
test  of  a  four-step  source  selection  concept 
for  the  selection  of  sources  and  negotiation  of 
contracts  for  advanced,  engineering  and  opera¬ 
tional  systems  development  was  established.1 
The  fou:  ■>  Lap  irocess  was  Initiated  to  improve 
weapons  systems  source  selection  and  to  correct 
the  alleged  procurement  abuses  of  government 
technical  leveling  and  auction  techniques,  and 
industry  buy-ins.” 

The  four  steps  in  the  process  are  briefly  sum¬ 
marized  as  iollows: 

(1)  Solicitation,  submission  and  evalua¬ 
tion  of  technical  proposals, 

(2)  Submission  and  "valuation  of  cost/ 
price  proposals, 

(3)  Selection  of  contractor,  and 

(4)  Negotiation  and  award  of  definitive 
contract.  3 

The  Armed  Services  Procurement  Regulation  (ASPR) 
language  applicable  only  to  the  special  four- 
step  test  process  was  promulgated  in  Defense 
Procurement  Circular  (DPC)  75-7,  Feb.  27,  19764, 
and  modified  the  ASPR  3-805.3  (1975  edition) 
language  by  adding  the  following  paragraph 
dealing  with  Discussions  with  Offerors: 

(b)  In  discussing  technical  proposals 
for  procurements  involving  advanced, 
engineering  or  operational  systems 
development  (see  (4-101)),  contracting 
officers  shall  apprioe  offerors  selected 
to  participate  in  discussions  of  only 
those  identified  liciencles  ir.  their 
proposals  that  1<  d  to  a  conclusion 
that  (1)  the  meaning  of  the  proposal 
or  some  aspect  thereof  is  not  clear, 

(ii)  the  offeror  has  failed  to  ade¬ 
quately  substantiate  a  proposed  tech¬ 
nical  approach  or  solution,  or  (iii) 
further  clarification  of  the  solici¬ 
tation  is  required  for  effective  compe¬ 
tition.  Technical  deficiencies  clearly 
relating  to  an  offeror's  management 
abilities,  engineering  or  scientific 
judgment,  or  his  lack  of  competence 
of  inventiveness  in  preparing  his 
proposal  shall  not  be  disclosed™ 

Meaningful  discussions  shall  be  con¬ 
ducted  with  the  respective  offerors 


regarding  their  cost/price  proposals. 

Such  discussions  may  Include: 

(1)  cost  realism; 

(ii)  mathematical  errora  or  in¬ 
consistencies; 

(iii)  correlation  between  costa 
and  related  technical  elements,  and 

(iv)  other  cost/price  factors 
necessary  for  complete  understand¬ 
ing  of  both  the  Government  require¬ 
ment  and  the  proposal  for  meeting  It, 
including  delivery  schedule,  other 
contract  terms,  and  trade-off  con¬ 
siderations  (with  supporting  rationale) 
among  such  elements  as  performance, 
design  to  coat,  life  cycle  cost,  and 
logistic  support.  Offerors  shall  be 
afforded  a  reasonable  opportunity  to 
correct  or  resolve  deficiencies  and 
submit  revisions  to  either  their  tech¬ 
nical  or  co8t/price  proposals.5 
(Emphasis  added) 

The  normal  (not  the  special  test)  language  of 
ASPR  concerning  discussions  wich  offerors  pro¬ 
vides  for  the  Identification  pf  proposal  de¬ 
ficiencies  in  the  technical  ana  cost/price 
areas  and  the  opportunity  for  offerors  to  sub¬ 
mit  revisions  to  proposals  based  on  those  dis¬ 
cussions.  Importantly,  a  "deficiency"  is  de¬ 
fined,  "as  that  pars  of  an  offeror's  proposal 
which  would  not  satisfy  the  Government's  re¬ 
quirements."5 

This  dichotomy  in  handling  discussions  of  pro¬ 
posal  deficiencies  between  the  normal  and 
special  test  programs  has  caused  misunder- 
,  standing  and  confusion  on  the  part  of  both 
industry  and  government. 

Although  seventeen  DOD  programs  were  selected 
■as  four-step  test  program  candidates,1  only 
two  have  gone  through  the  complete  procure¬ 
ment  cycle  including  protest  to  the  Comptrol¬ 
ler  General  of  the  United  States. 

The  grounds  of  protest  to  the  General  Account¬ 
ing  Office  (GAO)  in  both  the  protest  of 
AlResearch  Manufacturing  Company  of  Arizona5 
and  GTE  Sylvanla.  Inc.*,  centered ,  inter  alia, 
on  the  Government's  alleged  failure  to  conduct 
meaningful  discussions  i,.  violation  of  DOD 
Directive  4105.62.  The  meanlngfi  ’  discus¬ 
sion  issue  arose  primarily  because  the  govern¬ 
ment  four-step  evaluators  and  negotiators  are 
not  permitted  to  discuss  an  offeror's  techni¬ 
cal  proposal  deficiencies  relative  to  his 
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management  abilities,  lack  of  competence  or 
inventiveness,  or  engineering  or  scientific 
judgment,  During  the  discussion  period  offer¬ 
ors  may  be  apprised  only  of  those  identified 
deficiencies  in  their  proposals  that  leaa  to 
a  conclusion  that  "(a)  the  meaning  of  the  pro¬ 
posal  or  some  aspect  thereof  is  not  clear  (b) 
the  offeror  has  failed  to  adequately  substan¬ 
tiate  a  proposed  technical  approach  or  solu¬ 
tion,  or  (c)  further  clarification  of  the 
solicitation  is  required  for  effective  compe¬ 
tition."^-®  Thus  both  industry  and  government 
contract  negotiators  have  difficulty  in  deter¬ 
mining  what  constitutes  a  proposal  deflclencv 
vls-a-vic  a  proposal  clarification. 

Although  distinguishing  between  proposal  defi¬ 
ciencies  and  proposal  clarifications  is  rela¬ 
tively  new  to  DOD  participants  in  the  four- 
step  selection  process,  GAO  has  had  occasion 
to  deal  with  similar  matters  in  several  NASA 
procurements. 11  The  DOD  four-step  source  se¬ 
lection  procedures  are  very  similar  to  NASA's 
in  that  discussion  of  proposal  deficiencies 
or  weaknesses  are  specifically  prohibited. 17 
Both  procedures  state  the  need  to  allow  com¬ 
petitive-range  offerors  the  opportunity  for 
discussions  of  technical  proposals  to  clarify 
or  substantiate  the  proposal,  or  clarify 
solicitation  meaning  when  needed.  Also  the 
procedures  specifically  prohibit  discussions 
of  technical  weaknesses  (NASA's  term)  or 
deficiencies  (DOD's  term)  relating  to  an 
offeror's  lack  of  competence,  diligence,  in¬ 
ventiveness,  or  lack  of  management  abilities, 
engineering  or  scientific  Judgment.13 

Since  the  DOD  procedures  are  comparable  to  the 
NASA  procedures,  GAO  has  used  their  prior  de¬ 
cisions  involving  NASA  procurements  as  an  aid 
in  deciding  the  DOD  four-step  source  selection 
process  protests.!^ 

In  deciding  both  AlReaearch  and  GTE  Sylvania. 
GAO  utilized  their  lengthy  decision  dealing 
with  the  selection  procedure  for  the  space 
shuttle  main  engine  contractor. 13  GAO  wres¬ 
tled  with  the  conflict  between  NASA's  limited 
discussion  rule  and  the  10  U.S.C.  2304(g) 
(1970)  statutory  requirement  that  "written  or 
oral  discussions  shall  be  conducted  with  all 
responsible  offerors  who  submit  proposals 
within  a  competitive  rappe,  price,  and  other 
factors  considered."  GAO  discussed  the  "jgis- 
lative  history  of  the  statute  and  concluded 
that  while  the  statute  did  not  define  the 
nature,  scope,  or  extent  of  the  required  dis¬ 
cussions,  it  was  clear  in  their  view  that  com¬ 
petition  was  to  be  maximized  and  that  dis¬ 
cussions  be  "meaningful  by  making  them  dis¬ 
cussions  in  fact  and  not  just  lip  service. "W 

GAO  has  indicated  that  dlscutnions,  to  be 
meaningful,  must  Include  the  pointing  out  of 
deficiencies  in  an  offeror's  proposal.17  How¬ 
ever,  GAO  has  recognised  that  limitations  can 
be  placed  on  the  extent  and  content  of  dis¬ 
cussions  in  order  to  avoid  transfusion  or 


leveling,1®  as  t  /idenced  by  the  NASA  and  DOD 
procedures. 

In  the  protest  of  Sperry  Rand  Corporation,1^ 
GAO  interpreted  the  phrase  "discussions  with 
offerors  within  the  competitive  range"  to  in¬ 
clude  the  identificatl on  of  ambiguities  and 
uncertainties,  but  not  technical  deficiencies. 
The  underlying  rationale  is  that  to  point  out 
deficiencies  during  discussions  would  unfairly 
compromise  the  competitive  process  by  leveling 
the  technical  disparities  between  the  weak  and 
strong  competitors. 

GAO  has  acknowledged  the  potential  in  research 
and  development  procurements  for  the  disclo¬ 
sure  to  other  competitors  of  the  "fruits  of  an 
offeror *8  innovative  efforts."71  Thus,  the 
weaknesses  in  a  protestor's  proposal  were 
deficiencies  only  in  comparison  with  relative 
strengths  of  the  selected  company.  Therefore, 
discussions  concerning  deficiencies  and  com¬ 
parative  weaknesses  would  inevitably  involve 
technical  "leveling"  and  "transfusion".  7 
To  avoid  this  technical  transfusion  and  level¬ 
ing,  discussions  could  be  properly  limited  to 
the  clarification  of  proposals.  Thus, 

”...  where  the  meaning  of  a  proposal  is 
clear  and  [evaluators  have]  enough  information 
to  assess  its  validity  and  the  proposal  con¬ 
tains  a  weakness  which  is  inherent  in  the 
proposer's  management  engineering  or  scien¬ 
tific  judgment  or  is  the  result  of  its  own 
lack  of  competence  or  inventiveness  in  pre¬ 
paring  its  proposal,  the  contracting  officer 
shall  not  point  out  the  weakness."7’ 

GAO  on  ruling  on  the  question  of  whether  or 
not  the  statutory  requirement  for  discussions 
required  the  identification  of  all  deficien¬ 
cies  and  weaknesses,  stated: 

.  .  .  [it]  is  a  matter  of  Judgment 
primarily  for  determination  by  the 
procuring  agency  in  light  of  all 
the  circumstances  of  the  particular 
procurement  and  the  requirement  for 
competitive  negotiations,  and  that 
such  determination  is  not  subject 
to  question  by  our  Office  unlesn 
clearly  arbitrary  or  without  a 
reasonable  basis.  However,  the 
statute  should  not  be  Interpreted 
in  n  manner  which  discriminates 
ayarnst  or  gives  preferential  treat- 
to  any  competitor.  Any  discus¬ 
sion  with  competing  offerors  raises 
the  question  as  to  how  to  avoid  un¬ 
fairness  and  unequal  treatment.  Ob¬ 
viously,  disclosure  to  other  proposers 
of  one  proposer's  innovative  or  in¬ 
genious  solution  to  a  problem  is  un¬ 
fair.  He  agreed  that  such  'trans¬ 
fusion'  should  be  avoided.  It  is 
also  unfair,  we  think,  to  help  one 
proposer  through  successive  rounds 
of  discussions  to  bring  his  original 
Inadequate  proposal  up  to  the  level 
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of  ocher  adequate  proposals  by  point¬ 
ing  out  those  weaknesses  which  were 
the  result  of  his  own  lack  of  dili¬ 
gence,  competence,  or  inventiveness 
in  preparing  its  proposal.2^ 

The  protest  of  GTE  Svlvania,  Inc.25  took  a 
somewhat  different  tack  on  the  issue  of  what 
constitutes  meaningful  discussions.  The  pro¬ 
testor  alleged  major,  material  changes  to  the 
winner’s  proposal  in  step  four  of  the  procure¬ 
ment  process.  The  DOD  Directive  explicitly 
states  what  can  and  cannot  be  discussed  in 
step  four,  i.e. ,  final  negotiations  leading  to 
a  defin  cive  concract: 

Negoliatio  .s  ,  :ter  selection  shall 
not  Involve  material  changes  in  the 
Government's  requl  ements  or  the  con¬ 
tractor's  proposal  which  affect  the 
basis  for  source  selection.  In  the 
event  that  such  changes  are  desired 
by  the  Government,  the  competition 
will  be  reopened  in  accordance  with 
existing  Af.?R  requirements.26  (Eu- 
phai.'.s  added) 

In  the  instant  protest  the  Air  Force  admitted 
substantial  changes  amounting  to  a  35  percent 
increase  in  cost,  however,  such  changes  did 
not  effect  the  "basis  for  source  selec¬ 
tion."27 

GAO  has  previously  held  that  where  a*ard  of  a 
cost- reimbursement  contract  is  contemplated, 
the  importance  of  analyzing  proposed  costs  in 
terms  of  their  realism  is  apparent,  since,  re¬ 
gardless  of  the  proposed  co3ts  submitted  the 
Government  will  be  obliged  to  reimburse  to  the 
contractor  its  allowable  costa.  Xt  is  impor¬ 
tant  that  the  Government  contracting  person¬ 
nel  exercise  Informed  judgments  as  tc  whether 
proposals  are  realistic  with  respect  to  pro¬ 
posed  C08t9  and  technical  approach,  and  lack 
of  realism  may  result  in  upward  adjustment 
to  an  offeror' a  costs.28 

While  GAO  has  stated  that  the  proper  time  for 
exploring  costa  of  proposals  within  a  compet¬ 
itive  range  is  during  negotiations  and  not 
after  receipt  of  beat  an>'  Inal  offerors/’ 
they  have  approved  of  r  Government's  deci¬ 
sion  to  make  significant  cost  and  adjustments 
to  proposals  after  best  and  final  offers  ate 
in. 

tr,  the  protest  of  Ball  Aerospace  Company-''7,  a 
non- 1' AS  A,  non-four  atop  procurement  which  did 
not  oxproaaly  provide  lor  thle  adjustment  pro¬ 
cess,  GAO  eaid: 

We  3ee  no  significant  difference 
between  a  process  which  allows  cost 
ad’ustoenc  of  proposed  coats  after 
the  clone  cf  discussions  for  pur¬ 
poses  of  determining  the  successful 
contractor  -  even  though  no  forma', 
adjustments  of  contract  price  is 


v  •*  -‘.oiy  made  -  and  an  undisclosed 
‘.i  .'  ijustment  process  used  in  award 
c. which  ultimately  results  in 
a  .  ■  '  contract  price  more  in  line 

'  i  cue  Government  evaluated  price 
-  was  done  here.27- 

It  i,  interesting  to  note  that  while  the  NASA 
cod  1  --e-adures  track  closely  provision  for 
prin  /-.*  ,n,  NASA  has  no  comparable  provision 
dee".  ,j  -  th  negotiatin' .8  involving  material 
in  the  final  step  of  the  ae'-'ttion 
proc  -S3. 22 

This  difference  \i  the  two  procedures  did  not 
apparently  bother  GAO  because,  "both  contem¬ 
plate  c-ia".  and  technical  adjustments  in  the 
selected  proposal  prior  to  award  based  on 
negotiations."22 

GAO  went  on  to  say  while  they  approve  that 
significant  percentage  adjustments  can  be  made 
In  the  selected  offeror's  proposal,  such  appro¬ 
val  is  based  on  assumptions  that  adequate  cost 
8nd  technical  discussions  have  been  previously 
conducted  among  competitive— cage  offerors; 
that.  ;all  offerors  have  been  permitted  to  aub- 
01-  bust  and  final  offers  as  a  remit  of  those 
discussions;  that  the  Government  projections 
of  ultimate  changes  li  the  successful  offeror's 
proposal  are  sound;  and  chat  the  ultimate 
changes  in  the  successful  offeror's  proposal 
do  not  affect  the  underlying  assumptions  which 
prompted  the  select-on.26 

In  3uranarlzing  the  GAO  rules  on  whai  consti¬ 
tutes  meaningful  discussions,  the  Comptroller 
General  has  stated  that,  "extent  and  content 
of  meaningful  discussions  .  .  .  ate  not  sub¬ 
ject  to  any  fixed,  inflexible  rule,22  and 
"what  will  constitute  such  discussion  is  a 
natter  of  judgment  primarily  for  determina¬ 
tion  by  the  procuring  agency  in  light  of  ail 
the  circumstances  of  the  particular  procure¬ 
ment  and  the  requirement  for  competitive 
negotiations  .  .  .."26 

As  can  be  seen  GAO' s  many  pronouncements  on 
meaningful  discussions  center  on  the  mainte¬ 
nance  of  effective  competition,  »nd  equal  and 
fair  treatment  for  all  offeroro  within  a  frame¬ 
work  which  preserves  the  integrity  of  the  pro- 
curcmee-  ovsten  an  assures  that  the  Govern¬ 
ment  procures  me  goods  and  services  which  it 
requires  on  terms  advantageous  to  the  Govern¬ 
ment.  Unfortunately  the  voluminous  GAO  com¬ 
ments  on  what  constitute?  ''meaningful  discus- 
slona"  really  gives  little  guidance  to  govern¬ 
ment  and  industry  contract  ne go vis rets. 

In  at  least  one  protest  to  GAO,  the  contract¬ 
ing  officer  decided  that  negotiations  should 
be  limited  to  price  alone,  as  It  was  b--icvcd 
that  discussions  would  have  compromised  the 
technical  proposals  through  trtisfi’Bion 
of  ldeno,  methodology,  and  concepts.27  While 
looking  at  such  limitations  on  meaningful 


108 


discussions  in  the  abstract,  they  could  become 
so  limited  in  scop  and  content  that  the  dis¬ 
cussions  would  amount  to  nothing  more  than  "a 
ceremonial  exercise  with  meaningful  discussions 
transposed  almost  entirely  into  the  final  nego¬ 
tiations  i'tag->."38  Conceivably,  other  con¬ 
tracting  activities  might  ignore  the  tenor  of 
the  DOD  Directive  and  conduct  business  as 
usual  and  have  lull  blown  negotiations  rather 
than  meaningful  discussions  within  the  context 
of  the  four-step  directive. 

It  appears  from  close  analys's  of  the  GAO  dis¬ 
cussions  of  the  A1 Research  and  GTE  Sylvanla 
cases  that  the  government  and  contractor  aego- 
t’  -".ors  in  the  four-step  process  are  often 
co 'pciled  to  engage  in  potential’;-’  harmful 
wo.-d  games.  The  government  t.:  %  ,tiaeor  must 
carefully  couch  uuestions  in  very  precise 
language  to  convey  concerns  relating  to  the 
offeror's  proposal  without  violating  the  four- 
step  procedures.  Ihus,  while  a  ,u®stion  sim¬ 
ply  asks  for  clarification  of  the  proposal, 
an  offeror  Inevitably  will  search  for  possible 
hidden  meanings.  With  this  sort  of  trans¬ 
action  it  is  questionable  whether  ar  not  the 
minds  of  the  parties  really  meet  prior  to 
actual  negotiations  in  step  four.  Since  real 
negotiations  do  not  commence  until  after  the 
potential  contractor  has  been  selected,  the 
potential  for  material  changes  in  the  final 
step  based  on  misunderstandings  is  ripe.  Or, 
on  the  other  hano,  a  competent  offeror  might 
be  eliminated  from  step  four  due  to  the  fear 
of  government  representations  of  the  likeli¬ 
hood  of  technical  leveling. 

The  perceived  fear  of  technical  leveling  may 
sacrifice  the  welfare  of  Individ  DOD  pro¬ 
grams  in  the  name  of  the  integrity  of  the  pro¬ 
curement  process.  The  suggested  dimple  solu¬ 
tion  of  forcing  offerors  to  present  their  best 
proposal  initially  loses  sight  of  the  overall 
govemme  it' s  desire  for  scientific  and  tech¬ 
nological  superiority,  especially  In  the  area 
of  research  and  development,  which  can  only  be 
achieved  through  full  understanding  by  both 
parties. 39 

:71th  more  and  more  DOD  procurements  coming  un¬ 
der  the  mantle  of  the  four-step  procurement 
.•ro.-.ess,  it  is  anticipated  that  GAO  will  be 
requently  called  upon  to  refine  the  meaning- 
fax  discussion  problem  within  the  foregoing 
context.  The  determinative  issue  from  GAO's 
standpoint  is  not  necessarily  'rhet'nsr  ’•'.itui’ig- 
ful  discussions  were  conducted,  but  whether 
effective  competition  was  maintained  and 
whether  offerers  were  permitted  to  compete  on 
an  equal  basis.  0 

It  is  suggested  that  rather  than  Che  overly 
restrictive  and  obviously  confusing  language 
contained  in  the’  DOD  Directive  pertaining  to 
the  scope  of  meaningful  discussions,  a  simple, 
concise  statement  that  procuring  activities 
shall  not  indulge  in  technical  leveling  during 


discussions  would  suffice. 

In  order  for  the  government  to  obtain  the  op¬ 
timum  goods  and  services  it  desires,  more 
liberal  interpretations  as  to  the  extent  of 
discussions  should  he  permitted  in  order  to 
fully  inform  offeror'  without  misunderstand¬ 
ing  of  government  revjiromer.es  and  eliminate 
problem  areas  in  proposals,  without  technical 
leveling. 


FOOTNOTES 

1.  Issued  January  6,  1976,  by  the  Deputy 
Secretary  of  Defense.  See  ASPR  6-101  for 
definitions  of  advanced,  engineering  and  op¬ 
erational  systems  evelopirent. 

2.  "6-Step  Sourc  Selection",  A  Study  to  Test 
and  Evaluate  New  .‘.ource  Selection  Procedures, 
Interim  Report,  31  July  1977. 

3.  Section  III.D.5,  DOD  Directive  6105.62, 
supra  note  1. 

6.  Implementing  instructions  to  start  the 
service  test  of  the  four-step  source  selec¬ 
tion  process  had  been  Issued  by  Deputy  Assist¬ 
ant  Secretary  of  Defense  for  Procurement  (I&L) 
Memorandum  Oct.  28,  1975,  end  was  reaffirmed 
and  clarified  by  a  similar  memorandum  of  Mar. 

6,  1976. 

5.  The  existing  ASPR  3-805.3  language  was 
unchanged  except  for  renumbering  paragraphs. 

It  should  be  noted  that  the  Aimed  Services 
Procurement  Regulation  (ASPR)  was  replaced  by 
the  Defense  Acquisition  Regulation  (DAR), 
effective  Mar.  8,  1976 

6.  ASPR  3-805. 3(a)  (1976  edition): 

All  offerors  selected  to  participate 
In  discussions  shall  be  advised  of 
deficiencies  in  their  proposals  and 
shell  be  offered  a  reasonable  op¬ 
portunity  to  correct  or  resolve  the 
deficiencies  and  to  submit  such  price 
or  cost,  technical  or  other  revisions 
to  their  proposals  that  may  result 
from  discussions.  A  deficiency  is 
defined  as  that  port  of  an  offeror's 
proposal  which  would  not  satisfy  the 
Government' a  requirements. 

7.  ;  ee  note  2  supra.  Not  all  selected  pro¬ 
curements  had  to  meet  the  DOD  Directive  5000.1 
oefinition  of  t.  major  program,  i.e.,  $50  mil¬ 
lion  in  projected  K&D  funds  or  $200  million 

in  projected  production  funds. 

8.  56  Ccsp.  Gen.  989  (1977). 

9.  Comp.  Gen.  Dec.  B-186272,  Nov.  30,  1977. 

10.  ASPR  3-305.3  test  language  supra. 
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11.  Sec  e.g. .  55  Comp.  Gen.  802  (1976);  55 
Coop.  Gen.  715  (1976);  54  Comp.  Gen.  562 
(1975);  54  Comp.  Gen.  408  (1974);  and  53  Comp. 
Cen.  977  (1974). 

12.  NASA  Procurement  Directive  70-15,  Decem¬ 
ber  3,  1975,  currently  in  effect. 

13.  Supra  note  8. 

14.  Supra  note  11. 

15.  Comp.  Gen.  Dec.  B- 173677  (?.),  March  31, 

1972;  summarized  in  51  Comp.  Gen.  621  (1972). 


39.  ASPR  4-102  (1976  edition). 

40.  55  Comp.  Gen.  802,  807  (1976). 
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A  MEW  LOOK  AT  CONTRACTORS'  PAST  PERFORMANCE 
Colonel  Michael  A.  Nassr,  Air  Force  System*  Command 


BACKGROUND 


The  concept  of  rewarding  and/or  penaliz¬ 
ing  defense  contractors  based  on  their 
past  performance  is  certainly  not  new. 
Hitch  and  McKean  identified  its  impor¬ 
tance  in  I960: 

. . .Nothing  spurs  a  contractor  as 
effectively  as  knowledge  that  his 
performance  will  be  compared  direct¬ 
ly  with  that  of  a  rival  or  rivals, 
with  appropriate  rewards  and  penal¬ 
ties — either  in  the  short  run  (by 
the  terms  of  the  current  contract) 
or  the  somewhat  longer  run  (in  the 
next  or  later  contracts) . 

(7:232-233) 

Frederick  M.  Scherer  thoroughly  explored 
the  concept  of  competition  based  on  con¬ 
tractor  reputation  and  identified  numer¬ 
ous  difficulties  with  such  a  system  in¬ 
cluding  the  problem  of  time,  quality, 
and  cost  weighting;  the  difficulty  of 
measurement  without  the  influence  of 
biases;  and  the  problem  of  blending  good 
and  poor  jobs  together  to  obtain  an 
overall  index  of  contractor  performance. 
(10:68-101) 

Today's  Armed  Services  Procurement  Regu¬ 
lation  (ASPR)  states  that  " . . . .  the  Con¬ 
tracting  Officer  shall  consider  not  only 
technical  competence,  but  also  all  other 
pertinent  factors  including  management 
capabilities,  cost  controls,  and  past 
performance  in  adhering  to  contract  re¬ 
quirements,  weighing  each  factor  in  ac¬ 
cordance  with  the  requirements  of  the 
particular  procurement..."  (underscoring 
supplied).  (3:1-903. l(iii) ) 

The  Air  Force  regulation  on  source  se¬ 
lection  outlines  a  separate  section  on 
"Offerors'  Past  Performance"  as  part  of 
the  source  Selection  Advisory  Council 
Analysis  Report  (2:A-4);  and  until  re¬ 
cently  the  weighted  guidelines  method  of 
the  ASPR  included  a  factor  for  contrac¬ 
tors'  past  performance  in  computing  the 
profit  or  fee  objective.  (8:23) 

Despite  this  apparent  recognition  of  the 
importance  of  a  contractor's  historical 
performance,  the  Department  of  Defense 
currently  displays  scant  evidence  of 
placing  meaningful  emphasis  in  this 
area.  It  is  not  uncommon  to  find  a  case 
in  which  a  company  has  received  a  very 
desirable  new  program  award  after 


completing  an  essentially  unsatisfacto¬ 
ry  performance. 

This  situation  is  in  stark  contrast  to 
that  of  the  private  sector  whore  organi¬ 
zations  generally  maintain  a  rist  of 
preferred  vendors  and  suppliers.  The 
"preferred  list"  is  primarily  deter- 
mind  by  experience  from  previous  con¬ 
tracts  and  frequently  is  the  major  in¬ 
fluence  in  the  determination  of  future 
awards.  (5:303-304) 

Competition  in  the  defense  marketplace 
is  such  that  contractors  give  top  pri¬ 
ority  to  moving  into  promising  new 
fields  arid  thereby  promoting  capabil¬ 
ities  for  winning  future  programs. 
Achieving  good  performance  on  current 
programs  becomes  of  secondary  impor¬ 
tance.  Unfortunately,  there  is  no  con¬ 
certed  program  is  the  Department  of 
Defense  to  effectively  counter  this 
condition. 

Thus,  today's  source  selection  authori¬ 
ty  (SSA)  is  missing  an  important  and 
powerful  tool  for  forming  hia  selection 
decision.  Although  he  may  be  presented 
with  some  subjective  and  sketchy  infor¬ 
mation  on  past  performance,  it  gener¬ 
ally  is  lacking  in  comparable  depth  or 
consistency . 


LESSONS  OF  THE  PAST 


What  can  be  done  to  rescue  the  source 
selection  authority  from  this  dearth  of 
meaningful  past  performance  data? 

Since  the  problem  is  not  a  new  one, 
there  is  ample  information  from  the 
past  which  bears  examination. 

In  the  1960's  the  Department  of  Defense 
developed  considerable  experience  with 
its  Contractor  Performance  Evaluation 
(CPE)  system.  The  system  encompassed 
R(D  programs  of  $2M  per  year  or  $10M 
overall  and  production  programs  of  flOM 
per  year  or  $20M  overall.  (l:VI-4) 

The  CPE  system  required  a  total  of  eight 
DOD  forms  to  be  completed  on  a  semi¬ 
annual  basis  by  project  managers, 
service  evaluation  groups,  and  contrac¬ 
tors.  (Figure  1)  (l.-VI  18-43) 


CPE  DOCUMENTATION 

DD  Forms 

Subject 

1446 

Contract  Brief 
(Description) 

1096-1 

Technical  Performance 

1996-2 

Schedule  Performance 

1996-3 

Cost  Performance 

96-9 

Narrative 

1996-5 

Contractor's  Comments 

1947 

Departmental  CPE  Group 
Report 

1447  c 

Continuation  Sheet 

FIGURE  1 

The  submission  and  review  process  for 
these  forms  was  quite  extensive 
(Figure  2)  prior  to  being  forwarded  to 
the  DOD  Data  Bank  at  the  Defense  Docu¬ 
mentation  Center  for  future  use  by 
source  selection  organizations,  con¬ 
tracting  officers  and  the  renegotiation 
board.  (1: VI-4-9) 

When  it  was  initiated  in  1963,  the  CPE 
program  was  designed  to  be  fact-oriented 
to  the  maximum  extent  possible.  There 
was  provision,  however,  for  judgmental 
commentn  by  both  the  project  manager  and 
the  contractor.  This  aspect  of  the  pro¬ 
gram  allowed  it  to  degenerate  into  .one 
of  verbal  duels  between  project  offices 
and  contractors  whenever  hone3t  differ¬ 
ences  of  opinion  arose.  (8 : 3^—35) 

A  survey  conducted  in  1967  by  Air  Force 
Systems  Command  found  that  CPE  data  was 
being  used  in  varying  degrees  by  source 
selection  advisory  councils  hut  there 
was  only  one  inetar.  where  it  proved  to 
be  a  decisive  fac  or  in  contract  award. 
(8:37-3e)  Thuo  there  was  no  firm  evi¬ 
dence  that  the  program  vas  achieving  its 
prime  objective  despite  years  of  opera¬ 
tion  and  extensive  involvement  of  both 
governmont  and  contractor  personnel. 

In  Novambar  of  1970  the  program  was 
formally  onnoolsd  as  not  bsing  cost 
effective  o $  useful  for  source  selec¬ 
tion.  Its  sophistication  and  the  volume 
of  paper  which  it  generated,  helped  lead 
to  i t t  demise.  A  prime  cause,  however, 
wn»  i  -o  fniiuro  to  employ  a  methodology 


for  consistent  UBe  of  the  data  by  source 
selection  authorities  and  contracting 
officers . 

Experience  from  the  CPE  of  the  1960's 
points  to  the  fact  that  a  successful 
program  of  the  future  must  emphasize 
simplicity  and  the  prime  elements  of 
cost,  schedule  and  technical  perfor¬ 
mance.  Subjective  narrative  assessments 
should  be  avoided  and  a  consistent 
methodology  for  utilization  must  be 
developed,  enforced,  and  continuously 
t.c?Vod  to  determine  its  effectiveness. 


PROPOSED  CONTRACTOR  PERFORMANCE  PROGRAM 


There  is  still  a  need  for  a  structured 
program  to  measure  and  take  -into  ac¬ 
count  a  contractor's  past  performance. 
Few  dispute  that  past  performance 
should  L  _  considered  somewhere  in  the 
source  selection  process.  Diverse 
opinions  exist,  however,  as  to  the  type 
of  information  required  and  the  manner 
in  which  it  should  be  employed. 

The  author  is  proposing  a  simplified, 
fact-oriented  data  system  that  records 
the  cost,  schedule  and  performance 
status  of  major  Department  of  Defense 
contracts  that  have  been  active  in 
recent  years.  Included  is  a  suggestion 
on  hov»  this  information  can  be  used  by 
source  selection  activities. 

Initially  it  is  recommended  that  the 
information  be  accumulated  on  Depart¬ 
ment  of  Defense  contracts  over  $5M 
which  are  currently  active  or  which 
have  been  completed  during  the  past 
three  years.  The  data  generated  would 
be  succinct  and  broken  into  four  areas: 
(1) administrative,  (2)  cost,  (3)  sched¬ 
ule,  and  (4)  performance: 

Administrative  -  A  listing  of  the 
contract  number;  dollar  value,  pro¬ 
curing  agency;  acquisition  phase 
(advanced  development,  production, 
etc.);  brief  description  of  work; 
names  and  telephone  numbers  of 
government  project  manager,  PCO, 
and  ACO;  dates  of  contract;  and 
type  of  contract. 

Cost  -  Per  cent  over  or  under 
target  and  dollar  amount  (actual 
for  completed  and  estimated  at 
completion  for  active  contracts). 
Number  and  dollar  amounts  o' 
claims  submitted  and  claims 
approved/disapproved . 
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FIGURE  2 
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Schedule  -  Months  the  contract  has 
Seen  delinquent/total  contract 
months.  Reasons  for  delinquencies. 
Changes  mads  to  original  schedule 
ar.d  reasons. 

Performance  -  Number  of  DD  250  ac¬ 
ceptances;  numbers  of  major  defi¬ 
ciencies  and  conditional  accep¬ 
tances  on  DD  250's.  Number f  of 
deviations  and  waivers.  Numbers 
of  specifications  and  test  plans/ 
reports  resubmitted  for  approval. 
(Figure  3) 


DATA  COLLECTION 


The  proposed  information  can  be  gathered 
in  a  number  of  ways.  The  author  sug¬ 
gests  that  it  be  maintained  by  adminis¬ 
trative  contracting  officers  and  be  up¬ 
dated  as  required  in  order  to  be  sub¬ 
mitted  to  procuring  agencies  in  con¬ 
junction  with  contractor  proposals.  It 
is  important  that  the  contractor's  most 
receht  experience  is  included, as  recent¬ 
ly  ruled  by  the  General  Accounting 
Office  (GAO)  (6:A-7).  Until  a  DOD-wide 
system  or  requirement  is  established, 
requests  for  proposals  can  solicit  the 
desired  information  from  offerors  and 
this  data  can  be  validated  in  pro¬ 
award  surveys.  The  mere  fact  that  such 
information  is  being  requested  from 
offerors  will  serve  to  put  them  on 
notice  that  the  Department  of  Defense 
is  giving  added  emphasis  to  contractors' 
past  performance. 

Air  Force  Systems  Command  (AFSC)  already 
has  a  computerized  procurement  informa¬ 
tion  program,  the  Automated  Management 
Information  System  (AMIS) ,  which  can 
possibly  be  tapped  to  add  the  above  data 
on  contractor  performance.  An  addition 
to  the  current  AMIS  could  be  made  so 
that  the  information  would  be  continu¬ 
ously  and  immediately  available  to  all 
organizations  in  AP'C.  Sincj  the 
Defense  Logistics  gency  will  be  ex¬ 
changing  procur..me-  fc  information  with 
AMIS,  needed  information  could  be  in¬ 
cluded  on  all  contracts  administered  by 
the  Defense  Contract  Administration 
Service  (DCAS) . 


UTILIZATION  IN  SOURCE  SELECTION 


The  method  and  form  in  which  this  infor¬ 
mation  ia  used  can  be  standardized  to  a 
simple,  basic  report  for  presentation  to 
source  selection  authorities.  The  cost 
ir'^rmation  would  reflect  the  number  of 


contracts  which  met  or  were  over  or 
under  target  costs.  Schedule  informa¬ 
tion  would  reflect  total  months  of  orig¬ 
inal  contracts  and  the  number  of  months 
delinquent  and/or  of  schedule  extension, 
and  the  technical  performance  portion 
would  reflect  the  quality  of  the  pro¬ 
ducts  delivered  by  indicating  the  num¬ 
ber  of  deviations,  conditional  accep¬ 
tances,  etc.  on  a  percentage  basis  re¬ 
lative  to  the  total  items  delivered. 
Dollar  values  would  be  totaled  to  show 
gross  overrun/underrun  for  the  total 
contracts  charted.  Examples  of  summary 
charts,  •>  ‘  ~h  might  be  developed  for 
source  selection  purposes  are  shown  in 
Figures  4  and  5. 

Since  standardized  incorporation  of 
such  information  in  the  source  selection 
process  will  constitute  a  new  emphasis 
on  past  performance,  requests  for  pro¬ 
posals  must  clearly  state  the  manner  in 
which  past  performance  will  be  con¬ 
sidered  as  part  of  the  criteria  for  con¬ 
tract  award.  In  the  event  a  contractor 
has  not  performed  on  previous  Depart¬ 
ment  of  Defense  contracts,  it  can  be 
stated  that  information  relative  to  per¬ 
formance  on  comparable  non-DOD  contracts 
may  be  requested.  In  any  event,  it 
should  not  be  implied  nor  intended  that 
data  contained  in  any  computerized  data 
bank  will  constitute  the  sum  total  of 
all  past  performance  information  to  be 
considered  by  the  source  selection 
authority.  Other  pertinent  factual  in¬ 
formation  such  as  that  which  might  be 
gathered  from  contact  with  piogram 
managers  or  contracting  personnel,  can 
and  should  be  made  available  for  the 
SSA's  consideration. 

The  person  or  persons  who  consolidate 
the  past  performance  information  for 
presentation  to  the  SSA  must  be  cogni¬ 
zant  of  serving  a  vole  of  collation  and 
summarization,  not  one  of  evaluation. 

If  additional  information  is  gathered 
on  one  prospective  contractor,  then 
comparable  information  should  be 
gathered  on  all  others. 

Since  the  prime  objective  of  the  pro¬ 
gram  is  to  influence  source  selection, 
a  feedback  system  is  required  to  con¬ 
tinuously  evaluate  whether  past  per¬ 
formance  information  is  actually  play¬ 
ing  a  role  in  source  selection  decisions. 
A  survey  form  to  be  completed  by  source 
selection  tuthorities  and/or  PCO's, 
could  piovjde  the  inr''*-rv»tion  desired 
regarding  effectiveness  of  *■*>'*  program. 


ADMINISTRATIVE 


Contract  Number: 

Dollar  Value: 

Procuring  Agency: 

Acquisition  Phase:  (Development  or  Production) 

Brief  Description  of  Work: 

Name  and  Telephone  No.  of:  Government  Program/Projeot  Manager: 

PCO: 

ACO: 

Dates  of  Contract: 

Type  of  Contract  (e.g.  FFP,  CPIF,  etc.): 


\  COST  (fOR  CPIF,  CIFF,  FPIF,  FPIS)  j 

PER  CENT  over  or  under  target  (actual  for  completed  oontracte  and 

MEAC  for  active  contracts): 

Dollar  Amount  ever  or  under  target: 

Number  and  Dollar  Amounts  of  o la ins  submitted: 

Number  and  Dollar  Amounts  of  claims  disapproved: 

SCHEDULE 

Number  of  months  contract  uas/has  been  delinquent  and  reason(s): 

Per  cent  of  months  contract  was  in  delinquent  Btatua  (l.e.  total  months 
delinquent  divided  by  total  contract  months): 

Number  of  times  original  schedule  has  been  changed,  by  how  muoh,  and 
reasons  for  change: 


PERFORMANCE 


Number  of  DD  250  Acceptances: 

Number  of  Major  Defioieneles/Conditional  Acceptances  on  DD  250's: 
Number  of  Deviations  Granted: 

Number  of  Waivers  Granted: 

Number  ■>?  Test  Plans  and  Reports  Submitted  for  Approval: 

Number  Submitted  Late: 

Number  of  Test  Plans  and  Reports  Resubmitted  fc.  Approval: 

Number  of  Specifications  Submitted  for  Approval: 

Number  Submitted  Late: 

Number  of  Specifications  Resubmitted  for  Approval: 


f 
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FIGURE  4 
1 


CONTRACTOR  XYZ 

NO.  OF  DEVELOPMENT  CONTRACTS:  12  (7  COMPLETE,  5  ACTIVE) 
TOTAL  DOLLAR  VALVE:  $2I3M 


COST 

SCHEDULE 

CONTRACTS  OVER  TARGET:  10 

TOTAL  CONTRACT  MONTHS:  210 

CONTRACTS  UNDER  TARGET:  2 

IMONTHS  CONTRACTS  DELINQUENT:  19  (9%) 

GROSS  PER  CENT  OVER/UNDER  TARGET 
COSTS:  8%  (I7M)  OVER 

MONTHS  OF  SCHEDULE  CHANGE  DUE  TO 
NONPERFORMANCE:  22 

PERFORMANCE 

NO.  OF  DELIVERABLE  ITEMS:  93 

NO.  OF  DEVIATIONS  AND  WAIVER?:  34 

NO.  OF  MAJOR  Pr  'CIENC1ES  ON  ORIGINAL  ACCEPTANCE  INSPECTIONS:  7 

i 

5  NO,  OF  CONDITIONAL  ACCEPTANCES:  14 

i 

TEST  PLANS/SPECIFICATIONS  SUBMITTED  LATE:  25/300  -  8.3% 

TEST  PUNS/SPECIFICATIONS  DISAPPROVED:  33/300  •  11% 

CONCLUSIONS 


The  purpose  of  source  selection  is  to 
select  a  contractor,  not  merely  to 
choose  between  competing  proposals.  Yet 
the  emphasis  in  most  Department  of 
Defense  source  selections  is  overwhelm¬ 
ingly  upon  the  evaluation  of  technical 
proposals.  The  difference  between  con¬ 
tractors  is  seldom  illuminated  as  artic¬ 
ulately  as  are  the  differences  between 
their  proposals. 

A  practical  reporting  system  on  contrac¬ 
tors  '  past  performance  is  urgently 
needed  in  order  to  consider  past  as  well 
an  proposed  performance  when  selecting 
DOD  contractors.  A  system  is  proposed 
which  will  provide  factual  data  to 
source  selection  groups  and  which  will 
not  require  the  generation  of  complicated 
or  sophisticated  information  which  might 
cause  expenditure  of  inordinate  man¬ 
hours.  At  a  later  date  it  may  be 
desirable  to  develop  performance  indices 
in  each  of  the  three  areas  of  cost, 
schedule  and  performance. 

It  is  recommended  that  the  proposed 
system  be  initiated  at  a  division  within 
Air  Force  Ststems  Command.  The  Elec¬ 
tronic  Systems  Division  at  Hanscom  AFE, 
Massachusetts  has  already  taken  actions 
to  include  such  information  in  the 
source  selection  process  and  HQ  AFSC 
has  recently  issued  a  policy  letter 
requiring  past  performance  consideration 
for  source  selection.  Since  this  re¬ 
juvenated  concept  has  significant  impli¬ 
cations  for  the  defense  industry  over¬ 
all,  recommend  it  be  presented  to  the 
Council  of  Defense  and  Space  Industries 
Association  (CODSIA)  for  their  review 
and  comments. 

In  the  latter  part  of  1978  a  "debugged” 
and  coordinated  program  can  be  expanded 
to  ail  of  Air  Force  Systems  Command 
with  subsequent  adoption  by  the  entire 
Department  of  Defense.  With  a  positive 
determination  by  *  management  and 
with  an  open  mind  y  those  who  must 
implement  such  a  program ,  we  can  take 
a  giant  step  towards  improving  the 
relationship  between  past  performance 
and  future  awards. 
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SENSITIVITY  OF  OFFERORS'  SCORES  TO  VARIATIONS  IN  ITEM  WEIGHTS  AND  ITEM  SCORES 


David  A.  Lee,  Air  Force  Institute  of  Technology 


INTRODUCTION 


Numerical  scoring  of  offeror's  proposals  in 
accordance  with  AFLC  Supplement  I  (16  February 
1977)  to  AFR  70- IS  (16  April  1976)  is  carried 
out  in  the  following  way:  before  proposals  are 
received,  the  Source  Selection  Advisory  Council 
(SSAC)  identifies  key  areas  most  significant 
for  the  success  of  the  program,  and  determines 
•  the  relative  importance  of  each  area.  The  SSAC 

also  makes  shredouts  of  significant  items  in 
each  area.  The  SSAC  allots  numerical  weights 
to  each  item,  of  each  area,  subject  to  the  re¬ 
quirements  that  the  sum  of  all  the  weights  will 
equal  10C0,  that  the  sum  of  the  weights 
assigned  to  each  area  will  reflect  the  relative 
importance  of  that  area,  and  that  the  item 
weights  will  reflect  the  relative  importance  of 
each  item  within  an  area.  When  proposals  are 
received,  the  Source  Selection  Evaluation  Board 
(SSEB)  assigns  a  score  to  each  proposal,  on 
each  item.  These  item  scores  range  from  0  to  1 
and  reflect  the  fraction  of  the  weight  allotted 
to  each  item  earned  by  the  offeror's  response. 
SSEB  members  do  not  know  values  of  the  weights 
assigned  by  the  SSAC.  An  offeror's  total  score 
is  then  computed  as  the  sum  of  the  products  of 
the  item  scores  with  the  corresponding  weights. 
The  scoring  and  weighting  example  given  in  AFLC 
Supplement  I  to  AFR  70-15  is  shown  in  Table  I. 

When  the  numerical  scoring  and  weighting  is 
completed,  offerors'  proposals  are  compared 


(ranked  or  ordered)  by  comparing  their  total 
scores.  This  brings  up  the  question  of  the 
sensitivity  of  the  total  scores  to  small  vari¬ 
ations  in  the  choices  of  item  weights,  and  to 
small  variations  in  item  scores.  In  particu¬ 
lar,  one  would  like  to  know  whether  such  var¬ 
iations  could  cause  offeror  A  to  have  a 
greater  total  score  than  offeror  B  in  one  case, 
while  making  B's  score  exceed  A's  in  another. 
The  question  is  not  entirely  trivial,  because 
the  requirements  of  AFR  70-15  and  AFLC 
Supplement  i  thereto  restrict  the  choice  of 
weights.  In  this  paper  we  show  that,  while 
small  relative  variations  in  weights  or  scores 
may  indeed  reverse  the  ranking  of  two  offerors’ 
total  scores,  there  are  fairly  simple,  common- 
sensical  tests  which  identify  rankings  that 
cannot  be  overturned  by  relatively  small 
changes  in  item  weights  or  item  scores. 


Let  us  begin  by  describing  the  scoring  and 
weighting  procedure  quantitatively.  This  can 
be  done  by  the  equations  and  inequalities 
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156 

(Area  4) 

Item  I 

10 

1 

.SO 

120 

06 

Area 

Total: 

120 

06 

TOTAL 

1000 

367 

Table  1 
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M1 

l 

3=1 


M 


2 

l 

3=1 


"n 

>••■>  I 

3=1 


WI  >  w2 


*  '<M  ,  i  =  1 . N 

i 


0  <  s!  <  1 


(3) 

(4) 

(5) 


In  equations  (1)  and  (2),  S  is  the  total  score, 
N  is  the  number  of  areas  identified  by  the 
SSAC,  M.  the  number  of  items  associated  with 

the  l**’  area,  s^  is  the  offeror's  score  on 
i  i 

item  j  o'  -ri •  i,  and  w.  is  the  weight 

assigned  to  item  j  of  area  i.  Equation  (1) 
gives  the  procedure  for  computing  an  offeror's 
total  score.  Equation  (2)  expresses  the 
requirement  that  the  weights  add  up  to  1000, 
and  inequalities  (3)  express  the  requirement 
that  the  total  of  the  weights  assigned  to  each 
area  reflects  the  predetermined  relative  im¬ 
portance  of  that  area.  Inequalities  (4)  state 
that  the  item  weights  reflect  the  relative  im¬ 
portance  of  the  items  within  an  area,  a  1 
inequalities  (S )  specify  the  convention  that 
item  scores  range  from  0  through  ». 

Now,  let's  consider  the  question  of  whether 
offeror's  rankings  can  be  overturned  by  rela¬ 
tively  small  changes  in  item  weights,  for 
fixed  item  scores.  We  work  with  two  offerors, 

A  and  R.  let  A's  item  scores  be  aj,  and  de¬ 
note  B's  item  scores  by  .  Then  A's  total 

score  S,,  and  B's  total  score  S„,  arc  given  by 

A 


M. 

l 


*  y  i 

l=i  3=1 


aW,  SB 


M. 

l 


l  l  b  w 


i=l  j=i 


J  ] 


(6) 


We  can  simplify  our  work  considerably,  and 
still  answer  the  question  of  interest,  by  con¬ 
sidering  a  restricted  case,  in  which  all  the 

item  weights  except  wj  and  w*  are  kept  fixed , 
and  in  which  A  and  B  have  the  same  item  scores 


.  r  11. 

except  for  a,,aj  an- 


2’ 


SA  =  V'l  4  “2W2 


Then 


Q. 


SB  ■  b'A  4  b2W2  4 


where 


11  1  >  . 

I  l  V'j 
1-.'  I-I  !  1 


M1 

y.  -Sv 

|«.x 


(7) 


(8) 


;  TA  5  Vl  +  a2W2’  TB  =  blWl  4  b2w2  (9> 
That  is,  A  ranks  ahead  of  B  if  T,  >  T_,  and 

conversely.*  Now,  we  ask  our  question  in  this 
restricted  setting.  That  is,  is  it  possible 
that,  given  fixed  aj.a^  and  bj.b^,  there  exist 

admissible  choices  of  and  w^  which  differ 

relatively  little.,  such  that  for  one  choice 

t!  >  T„,  while  for  the  other,  T„  >  T.?  We'll 
A  B  BA 

find  such  choices  below,  and,  since  our  re¬ 
stricted  case  is  a  valid  particular  case  of 
t...  "•'ueral  question,  the  question  will  be 
answered ,  , .  " 

In  order  to  meet  (23  with  ail  wei< hts  except 
Wj  and  w^  fixed,  we  may  vary  w^  a  id  w?  only 

while  keeping  their  sum  constant.  That  is,  we 
must  have 


Wj  +  Wj  =  K  =  1000  - 


N  Mi 

l  l 

i=2  j=l 


M. 

i 

l 

3=3 


1 

w. 

) 


(10) 


To  preserve  the  relative  importance  inequality 
(4) ,  we  must  have 


W1  ”  w2  >  w3 


(11) 


A  principal  reason  for  going  to  this  present 
"two-dimensional  restriction"  is  that  pictures 
can  now  be  made  to  illustrate  our  proceedings. 
In  particular,  relations  (10)  and  (11)  may  be 
graphed  as  in  Pig.  1: 


in  i bat  the  rank  of 


S.  and  S_  will  he  detet - 

A  D 


mined  vi l<'l>  h)  the  partial  scores  and 

wli*  I  o 


•In  (9)  and  In  the  following,  the  common 
superscript  "l"  is  omitted  from  wj  and  w* 
for  clnritv  in  writing 


1 
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Figure  1  shows  that  we  are  free  to  vary  Wj  ami 
w2  along  the  interval  I  of  the  line  w[  »  w.,  -  k. 
That  is,  any  choice  of  Wj  and  w2  on  this  line 

will,  taken  together  with  the  fixed  weights, 
meet  (2),  (3)  and  (4). 

Now,  let  us  ask,  "what  condition  must  hold,  if 
=  Tg?"  In  that  event,  we  must  have 

Vl  +  w2a2  -  wlbl  +  w2b2>  or 

WjCaj-bp  ♦  w2(a2-b2)  =  0  (12) 

Now,  (12)  is  the  equation  of  a  straight  line 
in  the  w,  -  w,  plane.  This  is  the  line 

A  4 

Ta  =  Tg.  On  one  side  of  this  line,  >  Tgj 

on  the  other,  <  Tg.  Thus:  If  the  straight 

line  (12)  intersects  I,  then  there  will  be 
admissible  choices  of  w^  and  w2>  for  some  of 

which  >  Tg,  and  for  some  of  which  Tft  <  Tg. 

Actually,  it  is  easy  to  write  a  condition  on 
al’  a2’  bl  and  b2  sucb  tbat  tbe  intersecti-°n 
occurs.  Straightforward  analysis  shows  that 
the  intersection  does  occur,  provided 


Whenever  (13)  is  met,  the  complete  picture  of 
the  situation  is  shown  in  Figure  2: 


W 


Figure  2 


For  Wj  and  w2  on  segment  PQ,  TA  >  Tg-  for  w( 
and  w2  on  QR,  TA  '  TR. 

Actually,  since  Wj  >  w2  and  w2  >  and 

Wj  ♦  w2  =  K,  w^  <:  K/2,  so  that  Wg/£X-Wj)  <  1, 

always.  Thus  (13)  can  always  be  met  for  some 
choice  of  a1(  b1(  a2>  b2> 

SPECIFIC  EXAMPLE 

Suppose  that  all  the  item  weights  except  w. , 

1  1  J 
w2,  and  w^  add  up  to  650,  and  that  w^  =  50. 

Then  K  *  300,  and  (10)  and  (11)  take  the  forms 
Wj  +  w2  *  300.  (14) 

and 

Wj  >  w2  >  SO  (15) 

Inequalities  (13)  become 


A  choice  of  factor  scores  which  satisfies  (16) 
is: 


a2  *  .9  b2  =  .4  (17) 

Two  choices  of  weights  which  satisfy  (14)  and 
(15)  are: 


Case 

I. 

w^  =  200,  w2  ■  100 

(18) 

Case 

II. 

Wj  »  180,  w2  =  120 

(19) 

For  the  item  scores  of  (17)  and  the  weights  of 
Case  I,  TA  ■  210,  Tg  *  220,  so  that  offeror  B 

ranks  ahead  of  offeror  A.  But  for  these  same 
item  scores,  the  weights  of  Case  II  lead  to 
Ta  *  216,  Tg  »  210,  so  that  offeror  A  ranks 

ahead  of  offeror  B.  The  weights  of  Cases  I 
and  II  differ  from  their  means  by  5\  for  Wj, 

and  by  9%  for  w2>  Thus,  it  is  true  that  rela¬ 
tively  small  changes  in  item  weights  can 
change  offeror's  rankings  for  given  item 
scores. 


FIXED  WEIGHTS  AND  VARYING  FACTOR  SCORES 


This  case  is  much  simpler  than  the  previous 
one,  because  the  conditions  (5)  which  item 
scores  must  meet  are  much  simpler  than  condi¬ 
tions  (2),  (3),  and  (4)  on  the  item  weights. 

To  see  that  indeed,  relatively  small  changes 
in  item  scores  can  overturn  offeror's  rankings, 
consider  the  case  of  offeror  A  and  offeror  B, 


w 
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with  identical  item  scores  except  for  the 
first  two  items  of  area  1.  let  A's  and  B's 
scores  on  those  items  be  the  ones  given  in 
(17),  and  let  the  weights  for  these  items  be 
those  of  Case  I  (equation  (18)).  Then  B's 
total  score  exceeds  A's  by  10  points.  If  then 
B's  scores  are  each  reduced  by  10%,  and  A's 
increased  by  10%,  A's  total  score  exceeds  B's 
by  33  points. 


A  DOSE  OF  COMMON  SENSE 


Actually,  there  are  straightforward,  common- 
sonsical  rules  which  give  firm  guarantees  that 
certain  ~>r  ngs  cannot  be  overturned  by  rela¬ 
tively  small  ihanges  in  item  woights,  item 
scores,  or  both.  Very  likely,  the  rules  are 
alroady  applied  routinely,  as  a  matter  of  good 
judgement.  They  are  simple  to  describe: 

Rule  1:  The  ranking  of  two  offerors  whose 
total  scores  differ  by  an  amount  which  is 
greater  than  P%  of  their  sum,  cannot  be  over¬ 
turned  by  changes  in  weights  for  which  the 
greatost  relative  change  does  not  exceed  P%. 

Rule  2:  The  ranking  of  two  offerors  whose 
total  scores  differ  by  an  amount  which  is 
greater  than  P%  of  their  sum  cannot  be  over¬ 
turned  by  changes  in  factor  scores  for  which 
the  greatest  relative  change  does  not  exceed 
P%. 

Rule  3:  "he  ranking  of  two  offerors  whose 
total  scores  differ  by  more  than  the  product  of 

the  factor  (fSo  +  2)  anc*  t*,eir  sura>  cannot 

be  overturned  by  any  combination  of  changes  in 
item  weights  and  item  scores,  for  which  the 
greatest  relative  change  does  not  exceed  P%. 

All  these  rules  follow  from  one  fairly  straight¬ 
forward  calculation.  If  weight  wu  is  changed 
by  an  amount  6wj,  and  item  scote  si  is  changed 

by  an  amount  6s  j,  then  total  score  S  will 
change  to  the  value  c  +  5s,  where 


S  ♦  6S  *  \  l  (s!  +  6s!) (w!  +  6wb 
i*l  j  =  \  3  3  3  3 

N 

*  S  +  l  l  [s^«w-  ♦  6sM  +  4s^6wjl ,  (20) 

ej  ■'  3  '  *  ’  J 

so  that 

N  Mi 

«S  -  l  l  [s*6w*  *  6s!w*  *  6s*6w*]  (21) 

K  i  , .  l  ’  ’  J  1  >  > 

We  may  re-write  (21)  as 


s^1 

6w! 

♦  s!«! 

6s! 

_1 

3  3 

w1 

3 

3  3 

s! 

3 

s.  w. 

r  ) 


Since  the  magnitude  of  a  sum  does  not  exceed 
the  sum  of  the  magnitudes  of  its  terms, 


i  i 
s.w. 

6w! 

*  sV 

6s! 

— i- 

3  J 

w* 

3 

3  3 

i 

*3 

.  .  6s*  6w* 

sV  -4  -4 

33  s*  w! 

j  j 


In  (22),  the  fact  that  all  s^  and  w^  are  posi¬ 
tive  has  been  used. 

Now,  a  sum  is  not  decreased  if  each  of  its 
terms  is  either  made  algebraically  larger  or 
left  the  same.  Therefore 

N  Mi  .  .  6w*  N  Mi  .  .  ow* 

l  l  s,w.  -4  <  l  l  s  w  max  -4 

i=l  ;=1  3  3  w*  i=l  j=l  3  3  i.j  w: 


6w!)  N  Mi  .  . 

raa*  4  I  I  sjwj 

i,j  w-l  »=1  j“l  3  3 


Similar  arguments  hold  for  each  tern  of  (22), 
so  that,  defining 

6s! 

1 1 6s  j  |  =  max  -4  (24) 

i,j  Sj 


6w. 

|  |6w|  |  =  max  —4-  (25) 

i.j 

we  have 

|6s|  <  ||6w||.S  ♦  ||6s||-S  ♦  ||6w|M|6s||-S, 
|6S| 

and  -  ,  ,  the  relative  change  in  3,  is 
bounded  by 

!i§!<  i  |6w|  j  ♦  |  |6s|  |  *  ||4w|M|6s||  (26) 

Rules  (1),  (2),  and  (3)  are  immediate  conse¬ 
quences  of  (26).  For  example,  if  on!>  the  item 


•  v-'-  r. 
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weights  are  changed,  | | 6s | j  will  be  zero,  and 
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SL(1  ♦  IIMI)  >  su(i  -  IIMI). 

which  implies 

Su  -  SL  <  ||«w||-(Su+SL)  (.’7) 

Inequality  (27)  is,  of  course,  a  mathematical 
statement  of  Rule  1.  Rule  2  follows  exactly 
similarly,  when  ||6w||  is  taken  to  be  zero. 
Rule  3  follows  from  the  observation  that,  when 
both  scores  and  weights  fluctuate  subject  to 
the  conditions 

||6w||  <  f,  | |6s| |  <  f, 

then 

•  S  2f  ♦  r  =  f (f+2)  . 

Then  Su  cannot  be  reduced  to  less  than 
S  (1  -  f(f*2)),  while  S.  cannot  be  increased 

11  L 

to  more  than  S^(l  -  f(f+2)),  so  that  the 
offerors'  ranking  can  be  overturned  only  if 

SL(1  ♦  f (f+2))  >  Su(l  -  f(f»2)) , 

which  implies 

Su  -  SL  <  f(f*2)(Su+SL).  (28) 

Equation  (28)  is  a  statement  of  Rule  3. 


IIM I 

If  then  original  offerors'  total  scores  are  Su 

and  S^,  with  Su  >  S^,  under  change  of  weight 

S  cannot  be  reduced  to  less  than 
u 

S  (1  -  ||6w||),  and  cannot  be  increased  to 
more  than  SL(1  +  ||5w||).  Therefore  the 
offerors'  ranking  can  be  overturned  only  if 


CONCLUSION 


The  order  of  numerical  scores  of  proposals  can 
be  overturned  by  small  relative  changes  in  item 
weights  and  item  scores  whenever  differences 
between  scores  are  small  fractions  of  the 
scores,  even  when  item  weights  meet  all  the 
requirements  of  AFR  70-15  and  AFLC  Supplement  I 
to  that  regulation.  However,  as  specified  in 
Rules  (1),  (2),  and  (3)  above,  when  differences 
between  offeror's  total  scores  are  not  small 
fractions  of  the  scores,  the  order  of  scores 
cannot  be  overturned  by  snail  relative  changes 
in  item  weights  and  scores. 


THE  FUNCTIONAL  VALUE  OF  UNCERTAINTY  IN  THE  PROCUREMENT  PROCESS 


Charle3  W.  N.  Thompson,  Northwestern  University 


INTRODUCTION 


Where  the  performance  (or  product)  require¬ 
ments  of  the  end  product  or  service  are  com¬ 
pletely  specified  (and  the  means  of  verifica¬ 
tion  are  easily  available,  and  where  time  and 
cost  estimates  are  reasonably  related,  the 
procuring  agency  can  have  reasonable  confi¬ 
dence  in  beginning  the  procuring  process.  If 
one  or  more  bidders  are  able  to  reasonably  es¬ 
timate  the  costs  and  time  related  to  providing 
the  specified  product  or  service,  the  poten¬ 
tial  for  a  successful  procurement  appears  to 
be  reasonably  good. 

In  contrast,  where  performance  (or  product) 
requirements  are  subject  to  significant  uncer¬ 
tainty,  where  the  time  and  cost  to  provide  are 
uncertain,  and  where  means  of  verification  arc 
difficult  or  uncertain,  the  cumulative  effect 
of  all  of  these  uncertainties  is  usually  con¬ 
sidered  to  present  conside-able  problems  in 
the  procurement  process,  and  a  wide  variety  of 
methods  have  been  developed  by  both  procuring 
agencies  and  contractors  to  solve  these  prob¬ 
lems. 

Research  to  improve  our  understanding  of  the 
relationship  between  a  specific  method  and  a 
desired  result  (or  to  improve  our  ability  to 
achieve  a  desired  result)  takes  many  forms  but 
may  be  characterized  by  two  major  dichotomies: 
first,  the  difference  in  approach  (and  pur¬ 
pose)  between  the  practitioner  and  the  re¬ 
searcher,  and,  second,  the  difference  in  ap¬ 
proach  between  those  who  use  verbal  (usually, 
behavioral)  models  and  those  who  use  mathe¬ 
matical  ("quantitative")  models.  These  dif¬ 
ferences  not  only  limit  cooperative  approaches 
to  shared  problems,  but  also  limit  the  ability 
and  willingness  to  draw  upon  'solutions  devel¬ 
oped  by  the  "other"  group  [34].  These  differ¬ 
ences  are  often  expressed  in  terms  of  credi¬ 
bility  (lack  of  rigor)  and  usefulness  (lack  of 
relevance) . 

Drawing  upon  specific  experience  with  a  wide 
variety  of  procurement  practices  and  research 
on  the  procurement  process,  the  characteristic 
coasnonly  identified  as  "uncertainty"  is  used 
to  analyse  a  sec  of  illustrative  problems  and 
hew  various  solution  methods  are  designed  to 
deal  with  problems.  Graphical  models  (in  the 
general  form  of  those  familiar  in  systems 
analysis  and  production  control)  will  be  used 
to  provide  a  comon  language  bridging  the  two 
dichotomies  ‘‘nd  an  analytical  tool  for  des¬ 
cribing  specific  procurement  problems  from  the 
point  of  vi*v  of  both  the  buyer  and  the  seller. 

It  is  proposed  that  "uncertainty"  provides  a 
relatively  stable  and  ubiquitous  dimension  for 


analyzing  a  great  variety  of  problems  ard 
methods,  and  that  graphical  models  provide  a 
useful  common  language. 


UNCERTAINTY  AS  A  PROBLEM 


Uncertainty,  and  the  related  concept  of  util¬ 
ity  have  long  been  subject  to  examination  (see, 
for  example,  [12]  [35]),  but  it  is  not  the  in¬ 
tent  of  this  paper  to  review  the  extensive 
writings  in  this  field.  The  brief  comments  in 
this  section  are  intended  to  provide  some  gen¬ 
eral  sense  of  the  use  of  the  term,  Co  refer¬ 
ence  selected  exang>les  of  its  use  in  the  engi¬ 
neering  literature,  to  note  the  sequential 
characteristic  of  the  process  of  reducing  un¬ 
certainty,  and  to  reference  its  standing  as  a 
problem,  and  to  identify  characteristic  solu¬ 
tions,  in  defense  procurement. 

Uncertainty  is  used  here  in  its  common  sense, 
everyday  meaning  of  how  sure  one  is  about 
something.  It  require:,  the  identification  of 
(or  association  with)  a  specific  person  (or 
persons^ ,  and  the  term  "decision  maker"  is 
often  used  to  Identify  the  person.  Conven¬ 
tionally,  uncertainty  may  described  in  terms 
of  probability  ranging  from  0.0  to  1.0,  and 
this  may  be  with  respect  to  a  particular  re¬ 
lationship  between  one  estimate  ar.d  the  object 
(referent)  being  estimated,  or  may  be  distri¬ 
buted  over  a  range  of  estimates.  Uncertainty 
may  be  described  as  one's  confidence  in  the 
(or  a  specified)  relationship  between  any  two 
events  (or  objects  or  states) . 

Uncertainty  has  been  the  focus  of  concern  in 
the  management  literature  [7:2,/]  [26]  [37] 
and,  particularly,  in  the  engineering  litera¬ 
ture.  For  example,  a  quick  search  of  recent 
issues  of  one  journal  discloses  a  variety  of 
articles  concerned  with  the  information  pro¬ 
cesses  used  to  reduce  uncertainty  [4]  (9] 

[15].  The  engineering  process  has  bsen  char¬ 
acterized  as  a  process  for  reducing  uncertain- 
ty  [14]  [19],  and  as  an  early  step  in  a  se¬ 
quential  process  of  reducing  uncertainty  which 
extends  through  development  to  production 
[24]  and  sales  [31]  and  use  [3:18,21]. 

The  problems  presented  in  the  procurement  pro¬ 
cess  are  reflected  in  the  wide  variety  of  so¬ 
lutions  proposed,  only  a  sangile  of  which  will 
be  referenced  here.  In  the  pre-uvard  stages, 
various  methods,  such  as  briefing  and  the 
preparation  of  elaborate  requests  for  pro¬ 
posals,  are  used  as  a  prelude  to  equally  elab¬ 
orate  judgmental  processes  for  choosing 'con¬ 
tractors.  Basic  choices  concerning  the  form 
of  contract  [10]  [111  [21:15-16],  use  of  par¬ 
allel  development  [1],  dividing  a  procurement 
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into  phases,  Incorporation  of  specifications, 
and  standards,  and  use  of  techniques  such  as 
design  to  cost  and  life  cycle  costing  [16] 
[36:251  all  reflect  approaches  to  dealing  with 
uncertainty.  During  the  life  of  the  contract, 
various  process  control  methods  are  used,  par¬ 
ticularly  with  -espect  to  management  and  cost 
control  [8]  [20]  [22]  [281;  and  testing  pro¬ 
vides  a  major  contribution  to  the  reduction  of 
uncertainty  [18).  Concern  with  uncertainty 
during  the  use  life  of  the  procured  product  is 
reflected  in  provisions  for  warranties  and 
guarantees,  and  programmatic  requirements  di¬ 
rected  to  reliability  and  maintainability 
[27 j.  Central  Co  most,  if  not  all,  of  these 
method-  is  the  intent  to  minimize  or  control 
the  risk  t  '»  or  both  parties  arising  out  of 
uncertainty,  including  the  preasslgnoent  of 
the  risk  to  one  of  the  parties  [29:737],  And 
a  concomitant  clement  is  often  an  increase  in 
the  adversary  character  of  the  relationship 
[25]. 


HIE  USEFULNESS  OF  UNCERTAINTY 

As  a  practical  matter,  uncertainty  is  often  a 
"good"  thing.  Most  sporting  events  and  games 
of  skill  (or  chance)  would  lose  their  interest 
to  participants  and  spectators  (at  least,  some) 
if  there  were  no  element  of  uncertainty.  On  a 
personal  bnsis,  it  is  likely  that  few  individ¬ 
uals  Would  want  to  know,  with  certainty,  the 
exact  tine  they  will  die,  or  know  exactly  what 
others  think  of  them.  Even  responsible  senior 
decision  makers  may  find  it  to  be  "good”  to  be 
uncertain,  to  be  better  off  if  they  didn't 
know,  e.g. .  Eisenhower  and  the  U-2,  and  more 
recent  presidential  cases. 

For  those  cages  where  uncertainty  la  not  de¬ 
sired,  it  is  iiqportant  to  distinguish  between 
those  cases  where  you  can't  do  anything  about 
It  (with  respect  to  current  decisions)  and 
those  where  you  can.  And  what  you  can  do  is  < 
function  of  identifying  the  particular  deci¬ 
sion  maker,  the  point  in  time  that  the  deci¬ 
sion  la  to  be  made  [5:2],  what  specific  type 
of  uncertainty  ia  involved,  and  how  he  is 
likely  to  respond  to  It.  For  example,  before 
award,  the  bidder  Is  cor  rued  with  the  un¬ 
certainty  that  he  will  .n  and  his  uncertainty 
In  the  relationship  betveen  his  proposal  terms 
and  Che  performance  he  will  have  to  provide; 
comparably,  the  government  will  be  concerned 
with  identifying  the  "best"  bidder  and  the 
same  uncertainty  between  proposal  terms  and 
performance.  The  contractor  doesn't  want  to 
lose  money  (or  reputation) ,  and  the  government 
doesn't  want  to  pay  more  than  it  has  to  (and 
should  be  equally  concerned,  In  most  cases, 
with  paying  less  than  the  performance  is 
worth)  f  2  5 : 59 ) - 


EXAXFI.F.S 


The  examples  to  be  presented  in  this  section 
were  chosen  to  illustrate  the  usefulness  of  an 
explicit  recognition  of  the  characteristics  of 
the  specific  uncertainty  presented  in  a  par¬ 
ticular  procurement  situation.  There  are,  of 
courac,  many  other  possible  illustrations,  and 
variations  on  those  presented.  It  should  also 
be  noted  that  the  accompanying  figures  are  in¬ 
tended  only  to  illustrate  the  particular  sit¬ 
uation  and  are  in  the  form  of  rough  sketches; 
all-  of  the  curves  are  intended  to  be  approxi¬ 
mations  to  a  normal  distribution.  In  the  in¬ 
terest  of  simplification,  a  minimum  number  of 
i. — •>  are  presented  in  an  example,  and  it 

should  be  n. _ ■’  that  the  scales  are  sometimes 

compressed. 

Shared  High  Uncertainty 

Particularly  in  the  early  stages  of  the  de¬ 
velopment  of  a  new  capability  both  the  govern¬ 
ment  and  prospective  bidders  share  a  high  de¬ 
gree  of  u.  -ertalnty  concerning  not  only  the 
coat  but  also  the  time  required  and  the  level 
of  performance  (achievable  and/or  required). 
Where  there  is  a  high  degree  of  uncertainty, 
it  is  likely  that  the  estimates  (of  cost, 
time,  or  performance)  made  by  different  de¬ 
cision  makers  (bidders)  may  overlap  consid¬ 
erably.  This  is  illustrated  In  Figure  l. 
Estimates  by  bidders  A,  B,  and  C,  while  dif¬ 
ferent,  overlap  to  a  considerable  extent;  and, 
if  the  government's  uncertainty  is  comparable, 
its  estimates  may  also  overlap,  unless  biased 
by  reasons  of  differences  in  Information 
available  or  other  requirements  Imposed  upon 
the  estimating  process.  If  each  bidder  were 
to  use  the  average  of  his  estimate,  there 
would  be  the  illustrated  separation.  However, 
the  high  uncertainty  diminishes  the  predictive 
value  of  the  average,  presenting  a  range  of 
reasonable  variations,  ’a  the  illustrated 
case,  bidder  A,  for  othe:  reasons,  chcoses  the 
low  ernd,  and  his  bid  price  is  lowest  even 
though  his  average  is  highest.  Because  these 
"other  reasons"  may  not  be  related  to  what  it 
will  cost  to  perform,  and,  further,  because 
the  differences  among  the  estimates  themselves 
may  not  be  related  to  differences  in  the  cost 
to  perform,  It  seems  clear  that  the  bid  prices 
may  be  of  little  use  in  determining  which  bid¬ 
der  can  produce  fjr  the  lowest  cost.  The  uoe 
of  cost-type  contracts  reflects  this  mutual 
uncertainty,  minimizing  the  risk  to  both 
government  and  contractor  where  the  price  is 
substantially  lower  or  higher  than  the  actual 
costs  Incurred;  and,  as  a  corollary,  where  the 
risk  is  lessened,  both  parties  can  concentrate 
on  reducing  uncertainty  with  respect  to  per¬ 
formance  (and  time),  and  cost  is  "controlled" 
by  other,  process  based  methods. 

Where  there  is,  in  fact,  u  high  degree  of 
shared  uncertainty,  It  would  appear  that  a 
frank  recognition  would  minimize  a  number  of 
inappropriate  behaviors.  First,  the  govern- 
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ment  should  concentrate  on  other  characteris¬ 
tics  of  the  bidders  (e,g.,  technical  compe¬ 
tence,  effectiveness  of  cost  management,  long¬ 
term  Interest  In  the  procurement)  and  give 
little  or  no  weight  to  "low  price."  Second, 
both  the  contractor  and  the  government  should 
give  high  priority  to  early  and  progressive 
reestimating  of  cost  (and  performance  and 
time) ,  and  the  budgeting  and  review  processes 
should  recognize  that  the  terms  "overrun” 
and  "slippage"  are  inappropriate. 


Uncertainty  Over  Time 

One  of  rhe  characteristics  of  most  estimates 
is  that  chey  increase  in  uncertainty  as  they 
are  extended  forward  in  time.  This  is  illus¬ 
trated  in  the  top  part  of  Figure  2.  As  was 
true  in  the  first  example,  this  is  a  type  of 
uncertainty  which  we  can  do  little  about  di¬ 
rectly  except  to  recognize  it.  If  a  procure¬ 
ment  covers  an  extended  period  of  time,  both 
the  bidders  and  the  government  are  forced  to 
combine  relatively  good  estimates  for  near 
future  activities  with  progressively  poorer 
estimates  of  future  activities.  The  conven¬ 
tional  solution  is  to  divide  Lhe  procurement 
into  successive  phases. 

By  dividing  che  procurement  into  phases,  It  is 
now  possible  to  estimate  che  second  phase  at 
t2  (see  Figure  2,  bottom  part),  taking  advan¬ 
tage  of  the  reduction  In  uncertainty  resulting 
from  the  activities  in  the  first  phase,  ad¬ 
vances  in  the  state-of-the-art  elsewhere,  re¬ 
ductions  in  uncertainty  with  respect  to  the 
specification  of  requirements  and  of  related 
systems  and  components,  and  the  Increased 
familiarity,  knowledge,  and  experience  of  both 
contractor  and  government  with  respect  to  the 
program  f30:32]. 

It  seems  clear  that,  with  this  type  of  uncer¬ 
tainty,  the  estimates  at  t,  with  respect  to 
later  phases  should  be  frankly  recognized  es 
high  uncertainty,  as  was  true  in  the  first 
illustration  {6:57]. 


High  and  Low  Uncertainty 


In  some  cases  a  procurement  will  combine  an 
activity  or  task  which  is  of  high  uncertainty 
with  cnother  activity  of  low  uncertainty.  The 
bidder  who  is  forced  to  aggregate  these  two 
activities  is  faced  with  a  relatively  high 
uncertainty  estimate,  and  the  result  is  that 
estimates  of  different  bidders  tend  to  overlap 
(see  Figure  3,  left  hand  side).  This  may  oc¬ 
cur  in  building  construction  where  .-u.il  con¬ 
ditions  and  weather  present  high  uncertainty 
while  structural  costs  present  much  less  un¬ 
certainty.  Similarly,  on  procurements  with 
elements  in  the  far  future,  e.g.,  Ufa  cycle 
costing  of  energy  using  devices  where  future 
rates  are  uncertain,  production  costa  stay  be 


relatively  certain  compared  with  thosa  ele¬ 
ments  in  the  future. 

Where  the  high  uncertainty  can  be  factored 
out,  bidders  may  be  able  to  limit  their  cost 
estimates  to  the  low  uncertainty  part  with  the 
result  that  real  differences  in  bid  price  will 
appear  (aee  Figure  3,  right  hand  side). 

In  the  case  of  life  cycle  costs  for  energy 
using  devices,  usage  levels  and  rotes  can  be 
specified  for  bidding  purposes;  in  this  case, 
uncertainty  is  reduced  for  the  bidders,  with 
the  government  absorbing  the  un-.ortainty. 
Similarly,  separate  provisions  may  be  made  for 
soil  conditions,  weather,  inflation,  and  other 
conditions  not  under  the  control  of  the 
parties. 

There  is  a  special  case  where  the  uncertainty 
with  respect  to  a  specific  element  is  so  high 
that  it  may  not  be  possible  to  accomplish  at 
all.  If  the  element  is  necessary,  and  If  it 
can  be  worked  on  out  of  sequence,  the  govern¬ 
ment  should  require  that  the  contractor  work 
on  it  first.  Thus,  if  the  clement  turns  out 
to  be  impossible  to  accomplish,  the  government 
can  save  the  cost  of  developing  the  other 
elements. 


Differences  in  Uncertainty 


Bidders 


In  some  cases  one  bidder  will  have  consider¬ 
ably  less  uncertainty  tnan  other  bidders; 
this  may  be  because  he  wss  tha  original  de¬ 
velopment  or  production  contractor,  or  he  may 
have  more  background  and  experience  in  the 
area.  This  Is  Illustrated  in  Figure  4,  left 
hand  side.  Bidders  A  and  C  are  In  the  same 
position  ss  the  bidders  In  the  first  example; 
If  they  bid  low  and  win,  they  may  be  faced 
with  either  losing  money  or  cutting  corners  or 
trying  to  get  changes.  If  they  bid  high,  they 
will  lose,  and  bidder  B  stay  be  able  to  get  e 
windfall. 

In  developing  second  sources,  the  importance 
of  timely  delivery  of  documentation  drawings, 
bills  of  materials,  etc.)  Is  obviou: ;  the 
availability  of  a  relatively  complete  and 
accurate  description  of  the  product  reduces 
the  uncertainty  for  the  other  bidders,  and  the 
government  is  more  likely  to  receive  bids  re¬ 
flecting  real  differences  In  core  among  the 
bidders  (sse  Figure  4,  right  hand  side). 

Where  the  differences  among  the  bidders  are 
due  to  one  bidder  having  more  background  and 
experience,  the  government  may  decrease  the 
uncertainty  for  other  bidders  by  providing  ac¬ 
cess  to  documents,  reports,  and  other  refer¬ 
ences,  and  provide  early  brleflnga  [23]. 


Uncartalnty  Between  Covernmant  and  Bidders 


In  tome  if  not  all  esses  It  is  to  the  Interest 
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of  the  government  to  reduce  its  uncertainty 
concerning  the  capabilities  of  bidders  in  or¬ 
der  to  be  able  to  select  the  "best"  bidder. 
And,  at  least  in  the  case  of  those  bidders  who 
believe  they  are  the  "best,"  it  is  in  the  in¬ 
terest  ot  C'c  bidder  to  reduce  the  govern¬ 
ment's  uncertainty.  While  there  are  other 
sources  of  information  which  may  be  used  by 
the  government,  one  of  the  main  forms  is  the 
information  provided  by  the  bidders  in  their 
proposals.  It  Is  with  respect  to  this  process 
that  the  uncertainty  discussed  here  appears. 

If  the  bidders  have  a  high  degree  of  uncer¬ 
tainty  about  the  information  the  government 
needs,  they  nay  have  to  guess  os  to  what  to 
provide.  ■’ '  the  result  that  they  may  either 
provide  c  o  wrong  Information  or  have  to  over 
respond  to  "cover  all  bases."  This  is  illus¬ 
trated  in  Figure  5  by  bidders  A  ar.d  C.  Sim¬ 
ilarly,  a  bidder  with  a  low  degree  of  uncer¬ 
tainty,  but  who  is  wrong,  may  provide  the 
wrong  Information  (bidder  B,  Figure  5).  As  a 
result,  the  government  may  have  insufficient 
information  (and  a  continuing  high  uncer¬ 
tainty)  with  respect  to  the  bidders’  capabil¬ 
ities,  or  may  have  so  much  information  “hat  it 
is  difficult  to  sort  it  out. 

As  wa3  true  in  the  previous  example,  the  gov¬ 
ernment  may  reduce  the  uncertainty  among  the 
bidders  by  providing  information  (based  upon 
its  own  certainty  as  to  what  it  wants)  to  the 
bidders  during  the  bidding  process  (17].  This 
may  take  many  forms  Including  a  full  disclo¬ 
sure  of  all  of  the  characteristics  (factors) 
tc  be  evaluated,  what  kinds  of  information 
will  be  helpful ,  how  the  evaluation  will  be 
conducted  ind  by  whom,  and  how  to  organize 
and  offer  coly  present  information  In  the 
proposals. 


Making  Many  Small  Estimates 

In  the  previous  example,  it  was  suggested  that 
the  government  provide  information  to  the  bid¬ 
ders  based  upon  its  own  certainty  as  to  what 
it  wants .  In  some  cases ,  the  complexity  or 
uncertainty  of  the  program  may  make  in  diffi¬ 
cult  or  ictposaiblc  fo  :he  government  to  a- 
chieve  a  high  dogrer  .  certainty  as  to  the 
information  it  wan.s  ,J2].  Ho  single  factor, 
such  as  price  in  a  production  procurement  or  a 
brilliant  technical  solution  in  a  research 
contract,  appears  to  adequately  describe  the 
desired  capability  [2],  If  the  program  des¬ 
cription  and  the  set  of  requirements  are  ex- 
tenalve,  the  bidders  may  respond  in  a  variety 
of  forms;  and  Che  combination  of  variety  and 
volume  may  make  the  evaluation  process  un¬ 
manageable  and  the  results  uncertain  (Figure 
6,  leff  hand  aidcl. 

As  van  suggested  in  two  of  the  previous  ex¬ 
amples,  one  way  to  deal  with  uncertainty  lo  to 
divide  up  tho  estimate.  In  this  case,  divid¬ 


ing  by  time  or  by  differences  in  uncertainty 
may  not  be  possible;  If  not,  divide  up  the  es¬ 
timate  into  a  set  of  smaller,  specific  esti¬ 
mates,  i.e.,  factor  the  problem.  For  each  es¬ 
timate,  describe  the  specific  information  de¬ 
sired,  and  treat  as  in  the  previous  example 
(131  [33],  Ey  dealing  with  smaller  problems, 
it  is  likely  that  each  estimate  will  be  less 
uncertain,  differential  weighting  can  be  used 
Co  reflect  different  contributions  of  the  es¬ 
timates,  extreme  estimates  with  respect  to 
different  bidders  can  be  identified,  and  dif¬ 
ferences  among  bidders  may  become  more  certain 
'■'-ure  6.  right  hand  side). 


SUMMARY 

Uncertainty  has  been  described  as  not  only  a 
problem  in  the  procurement  process  but  also, 
when  identified  and  analysed,  as  a  useful 
basis  for  developing  solutions  which  minimize 
its  effect.  To  aid  in  this  process,  and  to 
supplement  verbal  and  quantitative  models,  the 
use  of  graphical  models  is  described. 
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ABSTRACT 

TECHNOLOGICAL  CHANGE  AND  PROCUREMENT  STRATEGY 
Professor  Arlyn  J.  Melcher,  Kent  State  University 


INTRODUCTION 


An  important  aspect  of  procurement  strategy  is 
the  degree  that  specifications  should  be  posed 
in  terns  of  what  product/service  is  required, 
or  the  performance  desired.  On  the  one  hand, 
precise  specifications  may  be  formulated  on  the 
nalur?  oF  the  oroduct/servlce.  In  this  case, 
the  contrc'-i.or  s  provided  little  or  no  discre¬ 
tion  in  varying  from  the  specifications.  The 
contract  is  awarded  to  the  one  who  can  meet  the 
specifications  at  lowest  costs  and  no  innova¬ 
tion  is  permitted ,  The  evaluation— decision 
process  is  relatively  simple.  On  the  other 
hand,  specification  may  be  in  terms  of  ends  and 
performance  that  are  desired  with  the  specifi- 
cationo  of  means  only  broadly  stated  or  unde¬ 
fined.  In  this  case,  the  contractor  proposes  a 
product/eervice  that  will  meet  the  reqic.-ed 
ends  cloacae.  This  strategy  provides  the  con¬ 
tractor  broad  discretion  and  incentive  to 
innovate.  Hie  evaluation  process  is  complex 
and  coat  is  only  one  of  the  considerations  in 
awarding  the  contract,  and  difficult  to  fix  on 
a  firm  basis.  The  relationships  with  the  con¬ 
tractor  are  fundamentally  affected  and  the 
nature  of  the  supervision  of  the  procurement  is 
conditioned  by  different  contractual  strategies. 

The  optima]  strategy  for  procurement  depends 
upon  a  number  of  factors,  but  two  of  the  more 
important  are  the  degree  that  the  item  is 
ordered  on  a  repetitive  basis  and  the  rate  of 
technological  change.  The  rate  of  technologi¬ 
cal  change,  continuity  of  purchase  and  procure¬ 
ment  stiategy  can  be  viewed  as  a  continuum  of 
alternatives. 
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The  combination  of  rate  of  technological  change 
and  continuity  of  purchase  determine,  in  part, 
the  procurement  strategy  that  coma*  closest  to 
optimally  meeting  governmental  needs. 
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The  continuity  of  purchases  determines  the 
degree  that  adjustments  can  be  made  over  time 
in  procurement  strategy.  In  the  case  of 
repetitive  purchases,  experience  can  be  used"  as" 
an  input  and  modifications  made  over  time  if 
resulting  performance  is  inadequate.  The  other 
extreme  of  a  single  contract  for  a  major  system 
sharply  increases  the  risk  to  the  government. 

The  contract  may  be  for  a  large  system  such  as 
an  uranium  processing  plant  structure,  a  group 
of  bombers,  submarines  or  other  equipment  that 
is  potentially  rapidly  obsclated,  or  fills 
probable  needs  for  long  periods  of  time.  In 
any  case,  a  single  comnltment  is  made  that 
locks  the  buyer  into  a  long-'. erm  situation;  if 
mistakes  are  made;  remedies  are  possible — if  at 
all— only  by  enormous  costs.  An  obsolete  de¬ 
fense  subsystem,  for  example,  can  be  scrapped 
and  replaced,  but  at  a  high  cost  to  the  govern¬ 
ment  and  loss  of  credibility  of  all  involved. 

While  the  rate  of  technological  change  in 
product/service  is  a  major  determinant  of  pro¬ 
curement  strategy,  it  has  been  one  of  the  most 
elusive  concepts  for  the  procurement  officer  to 
practically  identify  and  systematically  eval- 
ate  in  the  procurement  decision.  This  is 
partly  bccauue  of  the  difficulty  of  arriving  at 
n  general  concept  that  is  broadly  applicable 
and  can  be  operationally  measured. 

This  paper  develops  a  broad  concept  of  techno¬ 
logical  etiange,  indicates  the  process  of 
measuring  rate  of  change  and  develops  the 
implications  the  rates  of  change  have  for  pro¬ 
curement  policy.  A  act  cF  oropositiona  are 
offered  for  research  and  testing.  The  useful¬ 
ness  of  the  concepts  are  illustrated  by  profil¬ 
ing  the  technological  change  in  the  computer 
industry,  and  developing  the  implications  that 
the  continuity  of  purchase  of  computers  and  the 
rote  of  technologies!  change  have  for 
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procurement  strategy  on  computers. 


SIGNIFICANCE 


Any  buyer  such  as  the  government  must  try  to 
balance  off  two  goals  In  Its  acquisition  of 
major  systems.  On  the  one  hand,  one  central 
concern  Is  to  buy  the  best  technology  at  a 
point  In  time,  A  second  concern  Is  to  minimize 
cost  overruns  on  major  systems,  Air  Force, 
for  instance,  operates  under  a  general  policy 
directive  (0MB  Circular  No.  A-109;  that 
establishes  a  complex  decision-review  process 
for  reducing  risks  of  buying  obsolete  techno¬ 
logy  and  incurring  cost  overruns.  It  requires 
a  continuing  analysis  of  interface  of  mission 
capabilities,  technological  opportunities, 
priorities,  and  resources,  the  effect  of  this 
process  is  to  support  exploration  of  alterna¬ 
tives  on  the  best  technology  available  at  a 
point  in  time  within  the  constraints  imposed 
and  to  delay  commitment  for  production  until 
performance  characteristics  are  clearly  demon¬ 
strated. 

At  the  same  time,  the  governmental  agencies  are 
responsible  and  encouraged  to  update  their 
mission  capabilities  when  technological  oppor¬ 
tunities  occur.  New  technological  developments 
that  potentially  Increase  agency  capabilities 
are  to  be  translated  into  mission  need  state¬ 
ments.  This  statement  is  r.ot  to  be  expressed 
in  terms  of  particular  equipment  or  technology, 
but  in  other  terms  such  as  performance  charact¬ 
eristics.  This  needs  statement  is  then  for¬ 
warded  for  higher  level  review  and  potential 
budget  support,  This  policy  supports  updatlrg 
and  innovation  on  the  part  of  agencies. 

Both  processes  require  a  judgement  and  predic¬ 
tion  on  the  race  of  technological  change. 

Where  technological  change  rapidly  occurs,  the 
exploration  of  capabilities  of  alternative 
systems  is  meaningful  for  only  a  short  period 
of  time;  the  choice  among  alternatives  may  be 
limited  to  equipment  which  is  rapidly  obsoleted, 
While  the  acquisition  process  supports  buying 
the  best  available  technology  at  a  point  in 
time  and  reduces  the  potential  for  cost  over¬ 
runs,  it  gives  secondary  attention  to  the  rate 
of  technological  change  and  its  implications, 

The  needs  assessment  process  also  rests  upon  a 
a  judgement  of  rate  of  technological  change, 

It  requires  recognition  of  opportunities  and 
posing  performance  standards  in  terms  of  what  is 
potentially  rellzable  within  the  time-resource 
frame  of  agency.  Clarification  of  the  concept 
and  measurement  of  technological  change  is 
central  to  improvement  in  acquisition  process 
and  determination  of  optimal  acquisition 
strategy. 


THE  MAVERICK  AGM-65A,  A  SUCCESSFUL  TOTAL  PACKAGE  PROCUREMENT 
J.  F.  Drake,  Corporate  Director,  Advanced  Program  Plana,  Hughes  Aircraft  Company 


INTRODUCTION  cost,  schedule,  and  performance  data.  The 

paper  concludes  with  lessons  learned. 

This  is  a  case  history  of  a  successful  total 

package  procurement  program,  the  Air  Force's  MAVERICK  WEAPON  SYSTEM  PROGRAM 

Maverick  AGM-65A.  The  program  was  Initiated 
when  many.  If  not  all,  total  package  programs 


were  encountering  major  problems.  As  a  result, 
the  Contract  Definition  Phase  (CDP)  was 
•  extended.  Intensive  face  to  face  negotiations 

on  all  aspects  of  the  contract  were  conducted, 
new  contract  terms  and  conditions  were  added, 
and  every  effort  was  made  to  anticipate  con¬ 
tingencies  and  loop  holes  and  to  design  "the 
perfect  contract"  from  both  the  government  and 
contractor's  viewpoints.  The  resulting  con¬ 
tract  was  tough,  but  well  understood  by  both 
parties.  The  fact  that  It  stood  the  teat  of 
time,  was  successful,  and  only  one  dispute 
went  to  the  Contract  Board  of  Appeals,  Is  a 
tribute  to  the  negotiators  and  the  people  who 
executed  the  subsequent  program. 

The  RFP  for  the  Contract  Definition  Phase 
(CDP)  was  Issued  in  July  1966  and  development 
of  the  Total  Package  Procurement  (TPP)  was  ini¬ 
tiated  in  July  1968.  Test  firings  were  com- 
pleted  on  or  ahead  of  schedule,  with  a  success 
rate  of  91  percent  versus  a  requirement  of 
80  percent.  All  other  major  performance  param¬ 
eters  were  met  or  exceeded.  Initial  Opera¬ 
tional  Capability  (IOC)  took  place  after 
4-1/2  years  with  a  combat  squadron  in  Southeast 
Asia.  Production  deliveries  of  the  17,000  mis¬ 
siles,  launchers,  and  associated  support  equip¬ 
ment  included  in  the  TPP  were  completed  7-1/4 
years  after  initiation  of  full  scale  develop¬ 
ment.  Success  rates  in  training  and  combat  to 
date  are  92.2  percent  and  88  percent,  respec¬ 
tively.  The  total  program  was  completed  at 
5.1  percent  over  the  target  price. 

Among  indications  of  the  program's  success  were 
the  attainment  by  Hughes  of  all  maximum  positive 
performance  Incentives,  the  program  receipt  of 
the  prestigious  Daedalian  Award  and  the  attain¬ 
ment  of  a  total  of  four  stars  by  three  former 
Air  Force  Maverick  SPO  Directors. 

The  Maverick  program  is  of  particular  Interest 
.  not  only  because  of  its  success  as  a  Total 

Package  Procurement  Contract  (TPPC)  but  also 
because  of  the  short  time  span  required  for 
its  execution.  This  paper  briefly  describes 
the  weapon  system,  the  program  milestones,  the 
environment  during  the  competition  and  its 
effects  on  the  contract  terms  and  conditions 
and  duration  of  the  CDP  program  performance, 
actions  taken  by  Hughes  to  accomodate  total 
package  procurement,  technical  and  business 
risks  perceived  during  CDP  (plus  those  not  per- 
celved)  and  contractual  versus  actuals  for 


The  Maverick  is  a  launch  and  leave,  hit  to  kill 
television  guided  missile  designed  and  built  by 
Hughes  Aircraft  Company.  Its  operatio..al  con¬ 
cepts  and  capabilities  are  illustrated  in  Fig¬ 
ure  1.  Figure  2  summarizes  the  characteristics 
of  the  AGM-65A  and  the  principal  ancillary  gear 
developed  under  the  program.  (Its  application 
to  the  F-lil  was  Included  in  the  CDP  but  was  sub¬ 
sequently  deleted  early  during  the  development 
phase.) 

The  Maverick  missile  configuration  is  shown  in 
Figure  3.  All  of  the  guidance  functions  are 
located  in  the  guidance  section  making  Maverick 
the  first  U.  S.  modular  guided  missile.  The 
forward  firing  shaped  charge  fires  through  a 
hole  in  the  guidance  system,  then  through  the 
seeker.  The  warhead  is  the  largest  of  its 
type  in  any  operational  missile  and  is 
extremely  effective  against  small  hard  targets 
such  as  the  ones  illustrated  in  Figure  1.  The 
first  warhead  firing  is  dei'.cted  in  Figure  4 
and  demonstrates  the  lethality  of  Maverick 
against  armored  targets.  The  missile  impacted 
the  turret  of  the  M47  tank.  The  forward  firing 
shaped  charge  then  penetrated  the  five-inch 
turret  armor,  the  11-1/4-inch  thick  gun  breech, 
interior  tank  structure,  and  exited  the  bottom 
of  the  tank  providing  a  "K"  kill.  All  hatches 
were  blown  and  the  tank  was  completely  gutted 
by  fire. 

The  missile  is  rail  launched  from  either  single 
or  three  rail  launchers.  The  launchers  are 
carried  on  existing  aircraft  store  stations 
and  were  integrated  with  the  F-4  and  A-7  air¬ 
craft  without  aircraft  structural  or  mechani¬ 
cal  modifications  and  with  only  minimal  wiring 
changes. 

The  key  milestones  for  the  Maverick  Weapon  Sys¬ 
tem  program  are  shown  in  Figure  5.  The  date 
for  the  Statement  of  Operational  Requirement 
(SOR)  is  approximate  since  at  the  date  shown 
a  range  of  missile  sizes  from  the  Hornet 
(»1G0  lb)  up  to  the  Condor  were  being  con¬ 
sidered.  The  RFP  was  Issued  with  a  200  pound 
warhead  requirement  and  the  CDP  finally  con¬ 
sidered  both  211  pound  and  400  pound  warheads 
prior  to  the  selection  of  the  current  warhead 
size. 

The  CDP  was  stretched  about  a  year.  From 
start  of  DDT6E  to  IOC  wa3  little  over  4-1/2 
years  and  to  completion  of  17,000  missiles  and 
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MAVERICK  -  OPERATIONAL  CONCEPTS  AND  CAPABILIT' ES 


Associated  ciuipnent  was  7-1/A  years.  The 
latter  included  an  Air  Force  exercised  413  dav 
option  for  delay  in  initiation  of  production 
that  was  permitted  by  the  contract.  Although 
the  delay  seemed  unfortunate  at  the  time  — 
program  extensions  sometimes  become  permanent 
postponements  —  in  retrospect  the  delay  gave 
us  an  opportunity  to  better  consolidate  the 
design. 

The  Category  1  (CAT  I)  tests  depicted  in  Fig¬ 
ure  5  were  contractor  conducted  flight  tents 
while  the  Category  II  (r  *  II)  testa  were  con¬ 
ducted  by  the  Air  Forc 

EFFECTS  OF  THE  POLITICAL  ENVIRONMENT 

The  political  environment  during  contract  defi¬ 
nition  significantly  influenced  the  resulting 
contract.  The  concepts  of  CDP  and  TPP  vr.re 
"in,"  but  the  latter  waa  otarting  to  have 
problems.  The  government  reacted  bv  tighten¬ 
ing  the  tern3  and  conditions  and  establishing 
new  gates.  Efforts  to  control  cost  were 
rjf leered  in  steeper  share  pstterns,  lowe’- 
callings,  and  fixed  price  type  contracts.  In 
fl'Mltlcn.  unce-talntles  in  the  economy  were 


becoming  apparent  —  including  inflation, 
negative  balance  of  payments,  and  weakening  of 
the  government's  will  to  maintain  the  wage 
guidelines.  The.  public  attitude  toward  the 
wnr  in  Vietnam  added  to  the  conflict  between 
defense  spending  and  social  program. 

These  political  factors  had  a  profound  effect 
on  the  Maverick  total  package  contract.  The 
CDP  was  stretched  almost  a  year  to  permit  the 
Air  Force  to  write  "the  perfect  contract,"  or 
so  it  seemed.  Hughes,  of  course,  wanted  that 
perfect  contract  too.  The  salutary  effect  was 
to  permit  extensive  face  to  face  negotiations 
between  the  comp e t ing  contractors  and  the  SPO. 
It  was  enervating,  but  the  resulting  eon’uni- 
cation  led  to  a  much  better  contract  that  was 
thoroughly  understood  by  all  parties.  (Such 
was  not  the  case  on  the  SRAM  and  (he  C-5.) 

These  negotiations  also  permitted  the  govern¬ 
ment  to  better  assess  the  capabilities,  the 
integiity,  forthrightness,  and  capabilities  of 
the  competing  contractors  and  their  kev 
personnel. 

The  share  patterns  were  steepened  f-  -iA/JO 
used  on  previous  TPPs  to  70/30  and  the  celling 
was  dropped  to  125  percent  of  target  cost.  The 
original  RFP  options  (3)  for  production  were 
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changed  to  permit  the  government  to  buy  each  of 
the  second  and  third  options  In  five  Incre¬ 
ments.  These  options  gave  the  government  flex¬ 
ibility  in  adjusting  to  the  vagaries  of  fiscal 
funding  but  created  major  pricing  problems  for 
the  contractors  and  their  subcontractors.  The 
government  ultimately  exercised  these  incre¬ 
mental  options  on  a  number  of  the  procurements. 

Four  "Milestone  Requirements"  or  "Fly  Before 
Buy"  criteria  were  imposed,  although  these 
acquisition  buzzwords  hadn't  yet  been  Invented: 

1)  21  successful  target  simulation  tests 
prior  to  CAT  I  flight  test 

2)  3  spec  launches  at  envelope  extremes  prior 
to  CAT  II 

3)  5  successful  launches  prior  to  production 
go-ahead 

4)  CAT  II  conducted  by  AF  to  spec  criteria. 

In  addition,  a  success  record  of  35  out  of  40 
in  CAT  II  testa  would  win  a  S3M  incentive; 
whereas  a  29/40  record  would  require  a  $1M 
penalty;  and  less  than  29/40  would  require  a 


redesign  by  Hughes  and  a  repeat  of  the  CAT  II 
tests  without  adjustment  of  target  cost  or 
celling. 

If  the  sillestone  requirements  weren't  passed 
on  schedule,  then  the  contractor  had  to  pro¬ 
ceed  until  they  were  passed.  In  the  meantime, 
the  government's  obligation  on  subsequent  mile¬ 
stones  or  procurement  schedules  were  slipped 
accordingly.  Needless  to  say,  this  Innovation 
attracted  our  att.ntlon,  as  did  the  CAT  It 
Incentives.  Prior  history  gave  no  hope  of  win¬ 
ning  the  positive  Incentives,  but  plenty  of 
reason  to  expect  either  a  significant  nsgaclve 
Incentive  or  be  forced  to  redesign  and  start 
CAT  II  over.  The  result  was  that  we  devoted  a 
lot  of _ time  negotiating  Section  4  of  the  spec 
relative  to  CAT  II  test  conditions.  Hughes 
also  negotiated  a  clause  In  the  contract  for 
a  "Unique  Reliability  Test  Program"  (URT). 

This  was  analogous  to  the  TAAF  (Test,  Analyze, 
and  Fix)  concepts  later  conceived  by  NAVA1R 
and  now  being  Included  in  Navy  programs. 

One  of  the  major  advantages  of  TPP  from  the 
contractor's  viewpoint  is  that  once  having 
defined  the  contract  in  CD,  there  is  freedom 
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with  a  plan  created  by  Coat  Schedule  Planning 
and  Control  (CSPC).  Expenditures  were  about 
$3-4M/month;  and  since  the  program  was  completed 
on  schedule.  It  was  also  on  budget. 

There  was  a  lot  of  reporting.  The  best  com¬ 
munications  were  dally  telephone  calls  and  a 
weekly  report  on  status.  In  addition,  the 
APPRO  was  Invited  to  attend  v.ie  weekly  Hughes 
staff  meetings.  Those  meetings  were  always 
csndld,  so  there  ware  some  Indelicate  Hughes 
comments  on  occasion.  The  APPRO  wrote  weakly 
progress  reports  to  the  SPO  based  largely  on 
these  meetings,  but  did  not  repeat  any  of  the 
off-the-record  comments. 

Our  dsslgn  philosophy  encompassed  the 
following: 

e  design  for  production  by  all  parties  from 
the  start  of  CDP  through  development 

a  cost  bogles  and  a  responsible  engineer  fbr 
each  major  subsystem  were  established  dur¬ 
ing  CDP  and  were  monitored  during  DDTit' 

e  wall  known  technology  was  utilized  unless  a 
more  Inventive  need  was  found  to  be 
mandatory 

e  risk  areas  determined  early  In  CDP  were 
subjected  to  critical  Investigation  and 
test  with  Hughes  money  prior  to  DDTAE. 

The  Unique  Reliability  Test  Program  (URf)  pro¬ 
gram  mentioned  previously  vts  Important  in 
avoiding  the  dip  in  reliability  between  CAT  I, 


to  proceed  with  the  development  with  minimum 
outside  review.  Thus,  Hughes  controlled  CAT  I,, 
with  the  Air  Force  monitoring  for  compliance 
with  the  Milestone  Requirements  in  addition  to 
PDR,  CDR,  PCA  and  FACI.  This  Is  a  big  plus 
when  your  key  managers  can  work  towards  meeting 
the  contract  requirements  In  lieu  of  spending 
a  significant'  amount  of  their  time  preparing 
for  monthly,  bi-mocthly,  or  quarterly  reviews.' 

A  good  Value  Engineering  (VE)  clause  should  be 
lncluded'rin  any  contract.  The  Maverick  clause 
was  unique  at  the  time  In  that  there  were  no 
Instant  savings  to  the  contractor.  No  change 
In  target  or  celling  price  due  to  approval  of 
a  Value  Engineering  Change  Proposal  (VECP)  was 
made.  Cost  sharing  was  In  accordance  with  the 
contract  cost  share  pattern  and  was  based  on 
total  contract  performance. 

Another  unique  clause  provided  for  an  opera¬ 
tional  firing  Incentive.  Success  or  failure 
was  determined  by  counting  the  hits  versus  the 
misses.  The  Air  Force  was  judge  and  jury. 


MANAGING  A  TOTAL  PACKAGE  PROCUREMENT 
CONTRACT  (TPPC) 

l 

.  Key  managers  of  the  colocated  vertical  organi¬ 
zation  participated  In  the  CDP  and  development 
with  gradual  phase-out  after  the  Initial  pro¬ 
duction  deliveries.  Cost  management  was  based 
.  on  holding  the  program  schedule  end  performance 
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CAT  II  and  production.  The  CAT  I  flight  test 
progrum  was  laid  out  to  provide  early  determi¬ 
nation  of  problem- areas  (i.e.,  worst  case  test 
early  in  test  program)  in  order  to  permit 
early  corrective  action  without  stretching 
CAT  I.  PolitlcaUconsideration  associated 
with  falluren  in  flight  test  normally  mitigate 
against  this  approach. 

Financial  risk  was  spread  by  careful  selection 
of  proven  subcontractors  for  major  subsystems. 
Each, major  subcontractor  was  offered  our 
economic  escalation  clause. 


RISKS 


All  things  considered,  there  was  a  good 
assessment  of  the  technical  risks  during  the 
COP.  As  a  result,  Hughes  initiated  tests 
and/or  established  contractual  provisions  such 
as'tlie  URT,  VTE;  clauses,  etc. 

Durti.g  COP.,  Hughes  initiated  contracts  with 
three  aircraft  companies  (McDonnell,  LTV,  and 
General  Dynamics)-  for  wind  tunnel  tests  of  the 
multiple  rail  launcher;  and  negotiated  inter¬ 
face  specs  and  interface  working  agreements  to 
solve  what  otherwise  Would  have  been  a  formid¬ 
able  problems  in  timing,  schedule  and,  hence, 
coat . 

The  warhead  penetration  problem,  due  to  the 
close  proximity  of  the  guidance  unit  while  the 
warhead  shaped  charge  was  forming,  was  formid¬ 
able.  Strangely,  the  initial  warhead  concept  per¬ 
formed  properly  in  COP,  then  gave  sporadic 
result  s  in  D’VT&E;  This  problem  wos  compounded 
at  ou:  initial  subcontractor  by  a  10/1  reduce 
tlon  in  his  sales  due  to  the  phase  down  of  the 
Vietnam  war.  He  finally  terminated  the  con¬ 
tract  and  went  to  another  subcontractor. 

The  Crocker,  with  a  requirement  for  handling 
any  tactical  target  under  varying  contrast, 
attack  angle, lighting  conditions,  size,  etc., 
was  a  difficult  development  but  more  manage¬ 
able  than  anticipated  ir.  DDTAE.  Testa  con¬ 
ducted  during  CDP  helped  shape  the  spec  for 
CAT  II. 

The  fallout  of  unkno.-n  -  lake  was  not  too  bad 
considering  the  magnitude  of  the  program. 

The  Safe  Arii  and'  Fuze  (SAF)  problem  could  have 
been  found  during  the  CDP  by  better  engineer¬ 
ing  analysis.  The  vidicon  problems. were  state- 
of-the-art  and  procesa  control.  Vidicon  'tem¬ 
perature  range,  for  example,  hadn't  been 
explored  before.  Making  batteries  is  an  art  in 
design  —  that  also  is  easily -lost  in  the 
manufacturing  process.  A  rocket  low  tempera¬ 
ture  problem  war.  caused  by  ovar-speclflcatlon 


by  .the  government.  It  was  startling  to  find 
this) problem,  since  ve  had  produced  40;000 
Falcon  missiles  using  the  same  propellant. 
Seals  for  high  pressure  hydraulic  systems  at 
low  .temperatures  were  state-of-the-art.  Bet¬ 
ter  engineering  in  CDP  should  have  recognized 
the  latter  problem. 

Technical  or  value  engineering  aolutlons  were 
found  for  all  of  the  above  without  significant 
compromise  to  tha  operational  requirements. 

The  major  business  risk  perceived  in  the  CDP 
•ms  bankruptcy  due  to  lack  of  a  proven  produc¬ 
tion  oesig"  He  tried  to  minimize  this  threat 
by  spreading  the  risk  by  extensive  use  of 
major  subcontractors.  Business  risk  encoun¬ 
tered  during  the  contract  with  suppliers  was 
far  greater  than  we  anticipated.  The  ’Mr  ver¬ 
sus  .Non-War  business  environment  was  noc 
anticipated.  The  change  in  sales,  hence 
operating  base,  was  a  critical  and  sometimes 
a  fatal  problem  to  our  suppliers.  The  number 
of  Chapter  11  losses  was  stunning.  Part  of 
the  problem  is  tbe  small  business  syndrome. 
Because  of  this  risk,  on  two  occasions  large 
multi-division  companies  were  selected.  The 
results  Were  not  that  different  in  the  end 
game.  A  good  solution  to  this  issue  is  not 
apparent. 


SCHEDULE  ANlt  COST  PERFORMANCE 


Thus  far,  reasonable  coverage  has  been  given 
to  the  doackg  round  environment,  effects  on  the 
contract,  and  the  way  Hughes  approached  the 
problems  and  risks.  Koch  of  the  dialogue 
sounds  like  a  prelude  to  disaster. 

To  the  contrary,  as  shown  In  Figure  6,  the 
schedule  was  largely  met  or  beaten  (/). 

Behind  .schedule  performance  (x)  occurred 
rarely.  The  overall  schedule  was  met  to. 
within  1,1  percent.  This  performance  was 
achieved  by  hari  work,  dedicated  people,  good 
management,  and  minimal  externa),  distraction. 
As  an  example  of  the  laf.ter,  we  didn't  have  to 
propose  and  negotiate  a  new  contract  every 
year  (i.e.,  stabilized  environment).  Accept¬ 
ance  of  good  value  engineering* proposals  by 
the  Air  Force  also  contributed  significantly 
to  the  programs  schedi le  performance. 

The  most  difficult  program  milestone  was  la 
holding  the  schedule  for  the  first  flight. 
Overtime  was  extenst-ely  used-in  the  solution 
of  numerous  and  difficult  problems.  Subse¬ 
quently,  a  more  reasonable  pace  was  possible. 

Another  difficult  p.votabl-  event  was  the 
transition  from  s  low-delivery  rat- 
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FIGURE  6 


SCHEDULE  PERFORMANCE 


developmental  facility  to  the  high-rate  pro¬ 
duction  facility  in  the  middle  of  the  CAT  I 
flight  test  program.  The  change,  plus  lncreaa- 
lng  the  rate  from  one  or  two  a  month  to  eight 
a  month  while  maintaining  reliability  was  a 
tough  job  but  was  easentlal  to  the  future  suc¬ 
cess  of  the  CAT  II  flight  teat  program. 

The  success  rate  in  CAT  I  permitted  us  to 
reduce  the  firing  program  by  about  20  percent 
and  ir.  CAT  II  .the  nearly  perfect  firing 
record  of  27/28  led  to  its  termination  with  a  ' 
30  percent  savings  in  hardware  for  other  uaes. 

The  CAT  I  and  II  flight  test  programs  and 
ground  tests  of  the  warhead  showed  thet  the 
Maverick  AGH-65A  equalled  or  exceeded  all  the 
major  requirements.  The  mission  success  rate 
was  13/16  in  CAT  I,  27/28  in  CAT  II  for  an 
overall  rate  of  91  percent  versus  the  80  per¬ 
cent  required.  The  mean  radial  error  from 
target  gecsetrle  centroid  via  3.4  feet  versus 
6.S  feet.  (A* miss  is  a  failure;  only  hits  are 
successes. ) 

Carrying  three  missiles  per  assigned  airframe 
hardpolnt  was  achieved  on  both  the  A-7  and  F-4 
aircraft.  Warhead  penetration  was  substan¬ 
tially  better  than  the  requirements. 

The  Maverick  Launch  Stamury  given  in  Figure  7 
shows  that  the  success  rate  has  held  up  well 
after  CAT  I  and  II,  including  an  impressive 
88  percent  in  combat  and  92  percent  in  training 
and  demonstration  firings. 

The  cost  performance  for  Maverick  Figure  8  was 
just  as  impressive  as  the  schedule  and  technical 
•performance.  The  total  program  was  within  5.1 
percent  ovir  target  cost.  Program  continuity 
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wss  a  major  factor  contributing  to  this  suc¬ 
cess.  The  original  target  cost  Increased  from 
$323. 2M  to  8418.6M,  of  which  $78. 7M  was  due  to 
economic  escalation  and  $16. 7M  for  scope  changes. 
No  economic  escalation  was  provided  during  the 
first  two  yesrs  of  the  contract  and  a  1  percent 
dead  band  was  provided  around  the  normal  pro¬ 
jected  escalation  with  no  adjustment. 

Maximum  performance  incentives  of  $3H  and  $5M 
were  received  for  the  CAT  II  and  operational 
incentives,  respectively. 

The  Maverick  program  could  not  have  been 
accomplished  vlthout  successful  application  of 
the  Value  Engineering  clause.  Of  143  VE 
change  proposals  submitted,  90  were  approved, 
See  Figure  9.  No  significant  compromises  in 
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operational  capability  vere  made.  In  fact, 
the  per romance  is  substantially  better  than 
required  in  many  critical  areas.  Value  Engi¬ 
neering  savings  in  development  and  production 
total  $29. 2M,  with  an  ■'■Mitional  savings  of 
$10. 7M  anticipated  ir.  ,.e  cost  of  ownership. 

Art  interesting  aspc’.t  •£  the  latter  is  that 
storage  experience  nuccese  rate  shows  that  the 
missile  can  be  stored  for  tvpjyear*  with  suc¬ 
cessful  checkouts  running  97.3  percent. 

Hughes  and  the  Maverick  SPO  received  the: 1971 
Aeronautical -Systems  Dlvisionj  (ASI))  Value  Engi¬ 
neering  (VE)  award.  Rigid  adherence  to  the 
specifications  and  contract  and  rejection  of 
value  engineering  changes  were  major  contribu¬ 
tors-  to  the  C-5  overrun  (See  the  report  to  Sec¬ 
retary  of  the  Air  Force  Seanano  on  the  0-5 
overrun) . 


MANPOWER 


Figure  10  shows  the  total  program  manpower  ver¬ 
sus*  time  for  the  Maverick  program  from  initia¬ 
tion  of  the  CDP  through  the  initial  phaaes  of 
the  third  option.  Several  significant  points 
should  be  made: 


a  manpower  during  CDP  peaked  at  about  300, 
then  dropped  to  about  40  during  negotiation 

a  subsequent  to  start  of  DDT&F. ,  there  vere  no 
interruptions  for  decisions  —  program  man¬ 
power  was  maintained  as  required  to  get  the 
Job  done 

a  the  manpower  in  production* did  not  radically 
increase  going  from  the  1st  to  2nd  to  3rd 
options  even  ss  the  peak  missile  production 
rates  in  the  options  went  from  about  275  to 
550  to  850/per  month 

a  also,  observe  the  substantial  reduction  in 
the  percent  of  support  fo¥  management  and 
engineering  from  17.4  to  7.6  in  going  from 
the  1st  to  3rd  option 

*  Long  Lend  Time  money  for  the  -2nd  and  3rd 
options  was  included  in  option  1,  and  addi¬ 
tional  LLT  money  for  option  3  was  Included 
in  option  2. 

!_ 

Program  and  fiscal  continuity .permitted  the 
above-to  happen  with -the  happy  reaults  previ¬ 
ously-described.  It  is  interesting  to  note  that 
if  the  Air  Force  had  ; 't  hsdjHughes  tied  to  a 
TPPC,  the  AF  would  have  stabilised  at  the  1st 
option  production  rate  vi**'  a  cost  increase  of 
25-30  percent  without  consideration  of  Infla¬ 
tion.  ProScan  continuity  and  a  nearly  optimum 
production  rate  paid  off. 


Considerable  acress  and  effort  were  necessary 
to  meet  the  Initial  flight  date.  The  reason 
for  the  difficulty  was  inadequate  funding  to 
continue  CUP  initiated  production  design  and 
program  planning  during  the  negotiation  phase. 
As  a  result,  cur  design  team  dispersed  and  was 
either  lost  to  other  programs  or  had  to  start 
with  inadequate  program  planning  or  technical 
definition.  A  few  OM  added  to  the  CDP  for 
continued  design  end  planning,  small  relative 
to  total  program  dollars,  would  have  avoided 
the  problem  of  meeting  that  important  first 
flight  test  milestone. 


CONCLUSIONS 


A  number  of  lessons  can  be  learned  from  the 
success  of  the  Maverick  program  which  are 
equally  applicable  to  Industry  and  the 
government . 

s  Program  continuity  provides  major  payoffa. 

•  Sequential  decision  making  without  funding 
and  manpower  continuity  is  an  assured  way 
of  increasing  cost  and  guaranteeing 
overruns. 

«  A  Cully  integrated  service  SPO  including 
management,  engineering,  contracts,  finance, 
operations,  and  support,  etc.  permits  deci¬ 
sive,  timely  programmatic  decisions. 


•  Modest  expenditures  at  the  beginning  of  a 
program  to  define  and  investigate  potential 
problems  will  prevent  later  schedule  slip¬ 
page  and  major  expenditures. 

•  Careful  selection  of  known  technology  appro¬ 
priate  to  the  real  need  and  application  in 
lieu  of  high  risk  technology  is  a  major  key 
to  predictable  performance,  schedule,  and 
cost, 

•  A  production  design,  backed  by  system  anal¬ 
ysis,  simulation  and  critical  subsystem  test¬ 
ing,  in  conjunction  with  a  reasonably 
d,-i..i'ed  CSPC  progrem  plan  and  extensive 
face  to  face  negotiations  provides  the 
basis  for  good  source  selection  without  the 
cost  in  time  and  money  for  lull-3Cnle  sys¬ 
tem  fly  offs. 

•  A  method,  such  as  the  Maverick  V£  program, 
for  the  expeditious  treatment  by  the  govern¬ 
ment  and  the  contractor  of  unnecessary  and 
costly  contractual  and  technical  require¬ 
ments  i-  essential. 

•  The  selection  of  optimum  production  rates 
yields  large  unit  cost  savings, 

•  Finally,  sound  engineering,  good  people,  and 
strong  management  with  a  contract  thoroughly 
defining  responsibility  and  authority  plus  a 
little  luck  can  achieve  extremely  impressive 
results. 
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INTRODUCTION 

In  recent  years,  shortages,  inflation,  and  rapid 
advances  in  technologies  causing  product  obsoles¬ 
cence  and  tremendous  cost  decreases  --  such  as 
in  integrated  circuits  --  have  had  pronounced 
effects  on  organizational  buying  strategy.  This 
paper  examines  several  key  issues  which  will 
shape  organizational  buying  in  advanced  technol¬ 
ogy  organizations  over  the  next  decade. 

The  Environment  of  Strategic  Issues 

Companies  with  advanced  technologies*  both 
in  products  and  in  production  (assembly/process) 
methods  tend  to  have  problems  which  are  accent¬ 
uated  by,  if  not  characteristic  of,  the  advanced 
technology  environment.  These  problems  impact 
ypon  the  entire  spectrum  of  management,  including 
production,  finance,  marketing,  engineering  AND 
industrial  procurement.  This  paper  deals  with 
organizational  buying  problems,  in  both  private 
and  public  organizations,  and  considers  the 
issues  relating  indirectly  to  the  procurement 
function  through  other  functions  in  the 
organization. 

Organizational  buying  processes,  especially, 
the  strategic  issues  involved,  have  been  seen 
as  of  limited  strategic  importance  until  recently 
in  most  comoanies.  A  number  of  observers  of 
strategic  planning,  including  Ansoff  (1),  have 
categorized  organizational  buying  issues  as 
"administrative/operatlonsl"  rather  than  strategic. 
Consequently,  one  of  the  important  strategic 
issues  is  the  organizational  context  and  role 
which  the  procurement  function  has  within  the 
structure  and  operation  of  advanced  technology 
companies. 

External  to  the  firm,  key  Issues  include  the 
identification  of  and  access  to  technology  and 
the  organizational  dependency  upon  technology 
within  the  supply  channel.  Management  of  this 
dependency  inoludes  Influencing  the  mixes  of 
research,  development,  and  production  of  products 
and  production  processes  of  key  suppliers.  One 
way  to  do  this  is  to  contract  for  these  services 
and  activities,  which  is  costly  to  the  buyer. 

An  alternative  way  is  to  influence  them  Indirectly. 
Of  particular  focus  is  technology  utilization  and 
development. 

Identification  and  management  of  supply 
relationships  is  of  key  importance  in  advanced 
technology  industries,  since  there  is  usually 
a  considerable  amount  of  exchange  of  technical 
information,  financing  of  tooling,  and  access  to 
and  use  of  information  and. production  data.  Pro¬ 
blems  Involve  management  of  Investments,  financing 
and  various  risk  sharing  arrangements.  In  such  a 
•State-of-the-art. 


relationship,  procurment  personnal  should  play 
a  key  role  in  making  interactions  with  internal 
efforts  within  supply  companies.  However,  this 
philosophy  is  not  shared  by  all.  Recently  a  top 
procurement  executive  with  an  aerospace  firm 
indicated  to  the  author  that  relationships  with 
suppliers  should  be  kept  at  "arms  length"  to 
avoid  any  implications  which  might  result  if 
suggested  actions  were  taken  and  results  were 
poor.  He  Indicated  that  companies  which  take 
a  principally  Influential  stance  in  management 
decisions  and  processes  in  supply  organizations 
run  tremendous  risks  of  Involvement  beyond  what 
was  bargained  for. 

Organizational  Context  of  Procurement 

One  of  the  key  aspects  of  change  is  that 
of  the  organizational  context  of  the  procurement 
function  —both  in  the  system  of  functions  and 
the  system  of  structure.  The  system  of  funct¬ 
ions  --procurement  process  —deals  with  how 
strategic  issues  become  included  and  managed, 
whereas  the  system  of  structure  relates  to  the 
organizational  level  and  working  relationship- 
boards  and  committees— which  procurement  occupies. 
Farmer  noted  that  both  functionally  and  struct¬ 
urally  procurement  has  been  in  an  administrative 
mode  —and  still  is  for  the  most  part  —  In  most 
companies(2).  Ammer  (3)  indicated  the  role 
of  procurement  relative  to  overall  risk  taking 
decisions  in  management: 

To  general  management,  risk  in  purchasing 
should  be  avoided,  because  failure  will 
cause  more  important  activities  to  Incur 
losses.  The  reward  from  taking  risk  in 
procurement  may  be  overlooked.  Thus, 
managements  are  willing  to  risk  a  loss  of 
$10  in  marketing  providing  the  odds  favor 
their  making  $100,  but  may  reject  essent¬ 
ially  the  same  risk-reward  relationship 
when  a  purchasing  decision  is  involved. 

This  has  a  major  impact  both  upon  the  organi¬ 
zation  and  upon  those  who  are  buying  from  the 
organization.  In  the  latter  case,  suppliers 
who  treat  their  own  procurement  function  in 
such  a  mode  may  be  missing  key  Issues  and 
opportunities  relating  to  the  procurement  funct¬ 
ion.  Consequently,  it  may  be  a  key  role  of 
personnel  in  purchasing  not  only  to  influence 
their  own  position  in  their  organizations,  tut 
also  those  of  the  purchasing  function  in  their 
supplier  organizations. 

The  author  completed  research  not  long 
ago  with  the  Raytheon  company  wherein  the  pur¬ 
chasing  function  was  not  managed  in  a  strategic 
mode  in  the  Microwave  and  Power  Tube  Operation. 
Since  Raytheon  was  selling  sole  source  to  its 
captive  --Amana  Refrigeration  —strategic  Issues 


within  the  marketplace  were  not  examined  or  made 
part  of  strategic  purchasing  planning.  Tremend¬ 
ous  increases  in  tne  market  for  microwave  ovens 
coupled  with  drastic  price  decreases  in  components 
from  Far  Eastern  imports  left  MPTO  in  a  position 
where  it  could  not  even  approach  an  ability  to 
compete  with  foreign  sources  of  microwave  tubes 
in  cost  and  quality  as  well  asproduction  quantity. 
This  lead  to  a  decision  made  in  1977  to  cease 
supplying  Amana  and  a  fold-down  of. MPTO  operat¬ 
ions  (4). 

Typically,  source  relationships  in  industry 
as  vfell  as  within  the  internal  environment  of 
the  ’"irm  focus  on  short-term  supply  assurance, 
prices,  delivery,  scheduling,  and  other  oper¬ 
ational  areas  with  <•  limited  "big  picture"  focus. 
When  strategic  issues  become  recognized,  they  1 
are  either  dealt  with  by  other  functions  in  the 
company  or  are  left  to  chance  solution  --hoping 
they  will  go  away. 

The  procurement  function  is  both  shaped  and 
provides  shaping  to  the  state-of-the-art  envir¬ 
onment.  Within  a  climate  of  technological  change, 
where  results  are  uncertain,  there  are  consid¬ 
erable  risks  in  decisions.  One  key  response 
which  has  occurred  at  Raytheon  is  the  hC'izontal, 
rather  than  vertical,  organization  of  the  funct¬ 
ion.  That  is,  buyers  tend  to  specialize  in 
specific  commoditiss/components  and  learn  the 
markets  for  these  items.  This  type  of  organiz¬ 
ation  has  lead  to  Raytheon's  Materials  Strategy 
Council  (5).  The  company  uses  several  company- 
wide  contracts  for  common  materials  with  buyers 
specializing  in  semiconductors,  for  example, 
buying  for  the  whole  company.  The  Council  is 
a  group  of  buyers  in  a  comaon  commodith  not 
bought  under  a  comnon  contract,  but  who  meet 
monthly  (representing  their  own  planst  and 
divisions)  to  share  information  and  strategy. 

Another  key  issue  influencing  procurement 
was  identified  long  ago  by  former  AFSC  (U.S. 

Air  Force)  Commander,  Bernard  Schriever  (6): 

The  pacing  factor  in  acquiring  technolog¬ 
ically-based  modern  aerospace  systems  is 

management,  not  science  and  technology. 

The  ability  to  develop  and  implement  effective 
management  systems  for  '310115  acquisition  is 
a  top  priority  in  the  rospace  Industry.  Other 
more  recent  acqknowlad-  aments  of  this  are 
represented  organizationally  in  the  formulation 
of  the  Office  cf  Federal  Procurement  Policy  in 
the  Office  of  Management  and  Budget,  and  the 
Federal  Procurement  Institute,  both  of  which  are 
charged  wich  major  organizational  roles.  Within 
the  Air  force  organizational  changes  have  occur¬ 
red  within  AFSC  in  expanding  the  procurement 
office  to  include  "manufacturing"  as  well  as 
procuremsnt.  This  office  has  key  Interest  in 
mnnngeinent  of  manufacturing  technologies  within 
the  industry-base.  Finally,  the  Air  Force  Bus¬ 
iness  Research  Management  Center  has  been  charged 
with  responsibility  for  researching  procurement 
problems  and  management  in  order  to  improve  the 
process  of  aerospace  buying. 
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Key  (studies  within  the  U.S.  Government  include 
he  OFPP  pamphlets  and  directives  which  have 
been  published  In.  recent  years  (7),  the  Bell 
Report  (8),  the  AFSC  conference  proceedings 
(9),  the  Standord  Research  Institute  report  (10), 
and  the  more  recent  "Profits  76"  study  (11). 

Technological  Access  and  Transfer 

In  addition  to  organizational  changes, 
issues  dealing  with  technology  access  and 
transfer  are  also  emerging  with  increasing 
s'tratetic  significance.  The  process  of  tech¬ 
nology  aco.ii'sition,  not  merely  materials  and 
hardware  buying,  is  an  emerging  part  of  strate¬ 
gic  procurement.  Three  important  Issues  relating 
to  the  technology  base  to  whicn  :  company  has 
access  are  (1)  gaining  access  to  new  3nd  rapidly 
changing  technologies,  (2)  providing  incentives 
both  internally  and  externally  for  technological 
development  and  change,  and  (3)  sharing  the  risks 
associated  with  technological  change.  Just  as 
production  decisions  involve  "make  or  buy"  so 
do  technological  decisions  —do  we  develop  the 
technology  in-house  or  contract  for  it?  This 
question  is  becoming  more  and  more  a  part  of 
strategic  procurement  management. 

A  major  Issues  is  recognizing  the  extent 
of  dependency  which  an  organization  has  upon 
its  suppliers  with  respect  technological  access. 
For  - example  a  procurement  manager  might  be 
quite  constrained  in  negotiation  with  a  company 
upon  whom  his  organization  is  dependent  for 
major  technology  change  and  severely  limited 
in  alternative  options. 

Incentives  for  technological  change  include 
both  organizational,  financial,  and  marketing 
Issues.  Often  incentives  are  based  upon  proj¬ 
ected  market  potentials  for  new  products  and 
upon  the  development  of  good  marketing  strategics 
for  exploiting  new  technologies  in  order  to  make 
justifiable  the  large  capital  outlays  whicm  may 
be  Involved.  Market  forecasts  can  be  "shakey" 
because  of  the  potential  obsolescence  which  the 
high  technology  environment  provides  for  itself. 
Consequently,  the  very  market  opportunity  which 
makes  possible  a  new  product  can  also  spell  its 
future  in  quite  negative  terms. 

Technological  access  and  transfer  involves 
both  products  and  production  technologies.  Get¬ 
ting  suppliers  to  make  needed  capital  contni tmonts 
to  modernize  production  facilities  can  be  a 
major  procurement  problem.  The  author  recently 
researched  Sears  in  the  area  of  new  product 
development  wherein  the  company  had  some  major 
difficulties  in  getting  sources  to  invest  in 
new  product  design  changes  because  of  the  fear 
that  product  life  cycles  '."wild  obsolete  the 
new  products  before  tooling  could  amortized. 
Innovation  in  the  marketplace  can  spell  difficul¬ 
ties  for  procurement  managers  aimed  at  gaining 
Innovation  among  suppliers. 

Typical  among  the  various  problems  of  tech- 
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nology  transfer,  in  addition  to  technology  incent¬ 
ive,  are  various  methods  in  supply  agreenents, 
such  as  (1)  coproduction  agreements,  (2}  teaming 
arrangements,  (3)  licensing  arrangements,  (4)  buy¬ 
ing  out  entire  plants  and  companies,  (5)  contract¬ 
ing  for  training  in  high-technology  areas,  and 
(6)  financial  support  of  various  kinds.  One  key 
problem  is  that  when  technology  is  shared,  it 
can  be  modified  by  the  recipient  and  It  gradually 
loses  its  identity  and  proprietary  nature. 

Frisbee  (14)  noted  that  U.S.  control  was  minimal 
over  the  export  of  indigenous  technology  through 
its  allies  wxcept  through  voluntary  cooperation, 
and  that  the  Soviets  have  bought  from  the  West 
nearly  1000  complete  manufacturing  plants  ranging 
from  automotive  products  to  chemical,  electronics 
and  metallurgical  production.  The  Department  of 
Defense  is  in  the  process  of  refining,  simplifying, 
and  expanding  its  machinery  and  procedures  for 
analyzing  incipient  dangers  in  the  export  of 
specific  Items  of  U.S.  technology. 

Management  of  R&D  and  Product  Mixes 

To  the  extent  that  a  company  is  integrated 
backward  it  becomes  less  dependent  upon  external 
production  and  technology  in  competing  for  key 
resources.  However,  too  much  internal  control 
can  limit  acquisition  and  access  to  the  variery 
of  competing  sources.  The  content  and  pace  of 
the  research-mix  and  the  development-mix  of 
suppliers  and  potential  suppliers  is  a  key  issue 
in  strategic  procurement  planning.  Traditionally 
procurement  managers  have  taken  a  passive  role 
in  this  regard  settling  for  whatever  suppliers 
come  up  with  —with  the  exception  of  R&D  contracts. 
Purchasing  personnel  play  a  very  little  role  in 
influencing  supplier  marketing  decisions.  This- 
stems  largely  from  -he  lacking  entrepreneurial 
role  which  most  procurement  managers  see  for 
themselves  and  in  assumed  prerogatives  that 
marketing  takes  the  initiative  in  product  devel¬ 
opment.  However,  procurement  personnel  can  occupy 
a  strategic  "boundary  spanning"  role  in  managing 
the  outside  forces  affecting  the  supply  market¬ 
place  (14). 

Strategic  management  of  product  mixes  Includes 
providing  incentives  and  neglttatlng  even  the 
diversification  of  potential  suppliers  into  a 
line  of  effort  and  new  technologies  and  products 
within  the  "demand  perspective"  of  the  buying 
organization.  This  can  Influence  the  technical 
directions  as  well  as  the  "down  the  road"  acquis¬ 
ition  of  output  and  can  result  in  major  product 
mix  changes  available  to  the  buyer.  The  opportun¬ 
ity  for  influence  is  broad,  ranging  from  the 
acquisition  of  technology  to  how  the  supplier 
deploys  and  uses  that  technology  within  his  own 
organization  as  well  as  with  respect  to  the 
selection  of  his.  supplier  and  customer  bases. 

An  important  issue  is  the  management  of 
expectations.  This  includes  the  development  of  a 
"market"  for  technology  within  the  buying  organ¬ 
ization  without  commitment  to  single  source  or 
"must  buy"  Implications.  However  there  must  be 


an  expectation  that  if  the  results  of  the  supplier 
are  sufficient  and  his  offering  is  competitive, 
there  exists  sufficient  cash  flow  to  justify  his 
capital  outlays.  Consequently,  procurement 
managers  must  be  good  marketers,  perhaps  knowing 
good  marketing  strategy  for  their  suppliers  —even 
suggesting  it  to  them.  Consequently,  a  key  issue 
in  the  role  of  a  strategic  procurement  manager 
is  management  of  the  supply  and  demand  within 
the  supplier/marketer  channel. 

Such  an  entrepreneurial  role  can  have 
anti-trust  implications.  Purchasers  must  be 
aware  of  just  how  far  they  can  go  without  causing 
a  significant  restraint  of  trade  and  collusion. 

So  far  laws  have  been  interpreted  quite  freely 
in  many  instances,  especially  where  Government 
Interests  favor  teaming  arrangements  between 
prime  and  subcontractors. 

Figure  1  shows  a  typical  model  of  supply 
and  marketing  operations  within  a  channel: 
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This  shows  a  three-tiered  supply  and  marketing 
system.  Supplier  A  makes  some  acquisitions* 
such  as  raw  materials,  and  these  must  be 
coordinated  internally  within  A  and  with  the 
purchasing  plans  of  0.  The  first  case  demands 
an  intracompany  planning  and  forecasting  system, 
while  the  latter  Is  channel  oriented  planning 
and  forecasting.  The  same  is  true  for  B  with 
respect  to  buyer  C.  Each  organization  has 
options  outside  of  the  system  for  marketing  and 
for  purchasing,  an  assumption  that  is  not  always 
true. 
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Where  supplies  of  materials  or  technologies 
exceed  within  system  demand,  outside  marketing 
may  occur.  Conversely  where  demand  exceeds  supply, 
outside  buying  can  occur.  When  technologies  are 
involved,  instead  of  products,  this  outside 
sharing  can  be  detrimental  to  the  system  and 
reduce  system-wide  effectiveness  as  a  competitive 
unit. 

Technological  decisions  in  supplier  organ¬ 
izations  include  decisions  relating  to  technology 
applied  to  such  areas  as  design  to  cost,  long- 
range  forecasting  of  supply  needs  and  the  role 
of  technology  in  product  mixes.  Whenefforts  are 
geared  toward  matching  technical  feasibility  with 
narket  opP'-tu"ity,  a  viable  competitive  system 
unit  is  bti.n. 

Quinn  and  Cavanaugh  (15)  raised  the  issue  of 
procurement  playing  a  role  in  influencing  whether 
and  how  much  research  suppliers  should  do,  what 
portion  goes  to  basic  versus  applied  research, 
what  technology  content  and  objectives  are  sought, 
and  the  level  of  expenditures  allocated.  In  most 
situations  if  this  is  done  at  all  it  is  done 
very  indirectly  and  merely  by  encouragement. 

Each  of  these  areas  can  have  a  major  impact  upon 
"down-stream"  costs  and  the  competitive  profile 
which  the  supplier  will  have.  Relevant  costs 
can  include  process  costs,  investment  costs, 
costs  associated  with  product  performance,  down¬ 
time,  and  life  cycle  costs.  Gaining  "up-front" 
effort  can  become  a  key  opportunity  for  the  buying 
organization  if  the  procurement  manager  plays  such 
an  entrepreueurially  strategic  role. 

Inherent  in  this  role  is  the  buyer's  respon¬ 
sibility  to  forecast  changes,  directly  and  in¬ 
directly,  in  technologies  and  the  forces  shaping 
technologies  (such  as  cost  reduction  in  the 
semiconductor  industry).  Procurement  managers 
can  play  a  key  information  system  role  within 
and  between  organizations  if  they  are  focusing 
upon  such  issues.  Such  forecasting  becomes  an 
important  decision-making  tool  where  up-front 
investments  are  made  and  down-side  risks  must 
be  analyzed.  Strategic  supply  impact  studies, 
identification  of  emerging  technologies,  resource 
management  plans,  and  strategic  resource  needs 
studies  can  all  play  an  'nportant  role  in  this 
type  of  analysis.  Mor  ayoptic  buyers  get  engros¬ 
sed  in  price  hagglin.  a  .i  expediting  that  causes 
them  to  miss  strategic  issues. 

Strategic  Planning  Issues 


seen  as  dynamic  and  progressive  one  day  can  be 
considered  too  much  that  way  later  on  when  he 
wishes  customers  to  expand  the  breadth  and  depth 
of  their  buying.  On  the  other  hand,  a  supplier 
t'hat  has  spent  considerable  sums  in  tooling  can 
balk  at  efforts  to  produce  new  products  when  his 
present  tools  are  not  yet  amortized.  Consequently, 
supplier  selection  and  evaluation  criteria  need 
t’o  take  innovativeness  into  consideration  as  well 
ns  the  extent  and  rapidity  with  which  it  changes 
over  time.  When  considerable  coolaborative 
dealing  is  needed,  as  is  often  the  case  in  high 
technology  industries,  this  can  cause  conflict 
whicn  is  counterproductive  to  the  technological 
environment  itself. 

It  becomes  important  that  procurement 
managers  profile  the  strategies  of  their  own 
companies,  of  their  current  and  potential  suppliers, 
and  competitors  in  order  to  have  the  needed  infor¬ 
mation  to  make  good  strategic  decisions.  Such 
profiling  is  usually  limited  to  short-term  issues 
such  as  price,  capacity,  delivery  time,  and  so 
forth.  Audits  of  supply  markets  and  individual 
suppliers  in  areas  of  costs  and  technical  lead¬ 
ership  change  become  critically  important. 

Sales  market  forecasting  has  been  developed 
as  a  science  for  a  number  of  companies,  but  supply 
market  forecasting  is  even  lacking  in  conceptual 
models  beyond  mere  conmodity  price  forecasting. 
Supply  market  forecasts  need  to  Include  not  only 
materials  availability,  but  also  technological 
forecasts  and  changes  in  the  entire  marketing 
activities  of  suppliers  and  supply  markets. 
Understanding  market  characteristics  and  the 
forces  behind  those  characteristics  is  a  key 
element  of  strategic  procurement.  Roman  (16) 
distinguished  between  commercial  and  government 
markets  in  a  number  of  criteria.  His  model  is 
modified  in  Figure  2. 

One  key  operational  issue  is  understanding 
and  responding  to  product/institutional  life 
cycles  of  suppliers.  Although  the  concept  of 
life  cycles  was  initially  developed  to  include 
sales  growth  over  time,  there  are  significant 
changes  which  occur  over  the  cycle  which 
influence  procurement  plans  of  buying  companies. 
Among  these  are: 

(1)  Changes  in  competitive  strategies  of 
suppliers,  including  changed  positioning,  market 
share  targets,  price/cost  data,  and  quality. 


(2)  Changes  in  demand  for  resources  as  more 
and  more  marketers  become  involved  in  selling  the 
product  and  more  and  more  buyers  compete  for  sales. 


The  environment  of  Internal  and  external 
technological  change  provides  considerable  oppor¬ 
tunity  for  conflict  to  occur  among  the  supply  and 
marketing  channel  members.  Part  of  the  role  of 
procurement  Is  to  identify  and  manage  this  conflict 
Organizations  in  the  channel  relate  over  a  wide 
range  of  issues  and  activities,  and  prerogatives 
can  be  held  where  functional  responsibilities  can 
become  sources  of  irritation  in  such  areas  as 
financing  innovation,  compatibil Ity  of  capabilities,  Investment/Finance/Risk  Issues 
and  cost/price  analyses.  A  suppl ier  which  is 
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(3)  Changes  in  product  profitability  over 
time,  causing  changes  in  organizational  goals  and 
strategies. 

(A)  Changes  In  markets  and  supply/sales 
logistics  factors. 
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Market  Characteristic 
Procurement  Method: 

Facilities  and  Capital : 

Urgency: 

Underwriting  of  risk: 

Profit  oolicies: 

Basic  research: 

Applied  research: 

Personnel  shifts: 

Lead  times: 

Product  life  cycles: 

Controls: 

Direction  and  thrust: 

Certainty  of  future: 

Market  condition: 

Cost  orientation: 

Project  selection: 

Competitive  orientation: 
Operating  control : 


Conwercial  Markets 
Systems  approach 
Marketer  provided 
Dependent  on  market  need 

Seldom  by  customer 
Market  forces 

Seldom  procured  by  customer 
Sometimes  contracted  for 
Infrequent 

Sometimes  long/market  tests 
Varies  by  demand 

Less  direct  Influence 

Market  directed 

Often  multi-year  contracts 

Salability 

Within  demand  valuation 
Return  on  investment 
Direct 

In  hands  of  supplier 


Government  Markets 
Components  approach 
Buyer  provided  (often) 

Dependent  on  mission,  high 
time  emphasis. 

Often  by  customer 
Customer  policy 
Often  procured  by  customer 
Often  con-racted  for 
More  frequent 
Usually  long 

Varies  by  funding  decisions, 
A  managed  decision. 

Often  direct  influence 

Technology  directed 
Decisions  by  governing  body 

Mission  need 
Budget  oriented 
Priorities  of  mission 
Indirect 

Regulation  oriented 


Figure  2:  Contrasting  characteristics  of  procurement/marketing  operations  with  respect  to  markets 
between  comnercial  and  government  buying  organizations. 

There  are  different  types  of  risks  as  well  over  the  past  several  years  have  run  into  over- 

as  different  amounts  of  these  types  of  risks  assoc-  runs  as  -uch  as  1.8  times  average  for  time  and 
iated  with  procurement  of  advanced  technology  items.  2-3  times  in  cost.  These  are  end  results  of 
Types  of  risk  Include:  risks  in  the  above  areas. 


(1)  Technical  risk  —  Can  the  project  be  done? 

(2)  Time  risk  —  Can  it  be  done  by  need  date? 

(3)  Cost  risk  —  Can  it  be  done  in  the  budget? 

(4)  Obsolescence  risk  —  when  delivered  will 

it  be.  too  old? 

(5)  Capital  recovery  risk  --  will  the  return 

on  capital  needed  be  realized? 

(6)  Management  prerogatives  risk  —  is  mana¬ 

gement  capable  of  handling  the  project? 

(7)  Contingencies  risk  —What  will  happen 

that  isn't  seen  today? 

(8)  Market  development  risk  — Wil 1  the  market 

still  want  it  when  It  is  available? 

(9)  Competitive  advantage  risk  —  Will  comp¬ 

etitors  who  want  until  we  commit  have 

a  lead  with  a  better  product? 

Technical  risk  is  associated  with  the  state-of 
-the  art  and  is  influenced  both  by  the  distance 
from  that  state  and  the  relative  change  velocity 
of  the  state.  Thus  risk  assessment  in  a  technical 
sense  must  address  these  questions.  Recent 
research  has  indicated  that  Government  contracts 


Risks  are  accentuated  by  the  nature  of  the 
procurement  —and,  consequently,  upon  the  buyer's 
ability  or  inability  to  command  and  manage  risk 
variables.  Inherent  in  the  buy  decision  is  the 
paying  of  a  profit  to  the  supplier  to  manage  the 
project,  and  consequently,  some  buying  philoso¬ 
phies  take  the  point  that  since  the  supplier  is 
is  being  paid  to  manage,  buyers  should  not  take 
an  aggressive  contract  management  role.  Such 
a  philosophy  Is  like  telling  a  foreman  he  is 
being  paid  to  manage  a  shift  and  not  having 
management  checks  to  see  that  he  Indeed  does 
that. 

Responses  to  risk  vary,  and  the  following 
are  some  approaches  used.  Discounted  cash  flow 
analysis  regarding  proposed  capital  outlays 
has  become  Increasingly  more  important  in  proc¬ 
urement  management.  Contracts  —often  referred 
to  as  "supply  agreements  or  definitive  agreements" 
can  vary  in  the  means  for  sharing  risks.  Possib¬ 
ilities  include  redetermination  clauses  for  risk 
factors,  data  rights,  unpriced  options,  tailored 
incentives,  sharing  of  costs,  and  escalation 
clauses,  to  name  a  few. 

A  significant  investment  problem  recently 
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addressed  by  the  U.S.  Government  is  that  of  risk 
of  obsolescence  in  facilities  in  the  industry 
base.  The  problem  has  been  tagged  "assurance 
of  industrial  preparedness,"  as  an  extension  of 
the  concept  of  "military  preparedness."  This 
indicates  that  a  key  element  in  defense  strategy 
goes  beyond  the  military  system  into  the  industry 
base.  Research  has  indicated  that  there  are 
signs  of  certain  factors  in  the  industrial  base 
having  neither  the  capacity  nor  the  desire  to 
respond  to  defense  surge  requirements.  The 
reduced  capability  of  industry  to  respond  will 
have  progressively  serious  implications  for  the 
U.S  forces.  Similar  problems  often  exist  for 
mass  marketers  --such  as  the  example  of  Raytheon— 
when  demand  surges  occur  and  market  shares  change. 

A  remedy  used  in  conmercial  industry  is  multi¬ 
year  contracting  to  provide  for  capital  recovery 
over  time.  However,  in  Government  procurements , 
the  buy  is  budgeted  on  a  year  to  year  basis.  Both 
Boeing  and  McDonnell -Douglas  provide  classic 
examples  of  considerable  investment  risk  taken  in 
an  environment  often  lacking  in  even  letters  of 
intent  (17).  Where  a  one-year  contract  occurs, 
or  when  an  entire  program  can  be  "scrapped"  by 
a  Government  decision  —such  as  B-1—  timi/invest- 
ment  risk  management  is  difficult.  Evans  com¬ 
mented  (18): 

Firms  that  fail  to  replace  obsolescence  and 
inefficient  production  are  going  to  feel  the 
results...  we  are  on  an  avant-garde  in 
technological  innovation  of  products,  yet 
(are)  still  slipping  in  manufacturing  obsol¬ 
escence. 

Other  solutions  are  debated,  including  term¬ 
ination  liability  for  buyers,  guarangeed  amort¬ 
ization,  interest  credits  for  financing  charges, 
increasing  allowable  profits,  and  various  sharing 
arrangements.  When  heavy  "front  end"  investments 
are  involved,  such  as  in  the  manufacture  of  the 
Boeing  747  aircraft,  it  is  important  to  get 
such  provisions  as  termination  liability  and  risk¬ 
sharing  by  customers.  Often  this  is  needed  to 
obtain  financing  for  the  manufacturer. 

CONCLUSIONS 

The  procurement  fur-tion  will  become  more 
and  more  strategically  .iportant  to  companies 
over  the  next  decade,  «  d  this  is  particularly 
true  to  high  technology  companies.  In  such 
companies  the  various  perplexing  issues  dfscus- 
sed  above  will  provide  a  major  stimulus  toward 
a  strategically-based  procurement  function. 

Within  the  next  decade,  considerable  change 
and  progress  will  occur  in  the  following  areas 
of  procurement: 

(1)  Changes  in  the  organizational  context 
and  role  of  the  function. 

(2)  Better  strategic  Identification  and  man¬ 
agement  of  technology  access,  dependency,  transfer, 
and  incentives  in  supply  relationships. 


(3) A  larger  role  —perhaps  even  an  entrepren¬ 
eurial  one  --for  procurement  managers  with  focus 
on, influencing  marketing  operations  of  suppliers, 
such  as  research  and  development  and  product 
mixes. 

(4)  Management  incentives  and  programs  for 
developing  technological  changes  in  production 
methods  and  processes  used  by  suppliers  to  create 
better  cost  efficiencies. 

(5)  Better  Identification  and  management  of 
supply  channel  conflict. 

(6)  Improvements  in  procurement  information 
system:,  for  early  detection  and  forecasting  of 
changes  in  technology  and  other  strategic  Issues. 

(7)  Better  coordination  of  procurement 
strategy  with  other  corporate  strategies. 

(8)  Improved  methods  of  investment  and 
finance  risk  sharing. 

The  time  to  start  preparing  for  this  role 
is  now,  and  companies  and  other  organizations 
must  recognize  that  the  frontiers  of  industrial 
advance  rest  more  and  more  on  managing  the 
acquisition  of  resources  —material  and  technical  — 
or  else  the  "future  shock"  that  is  at  the  doors 
may  "huff  and  puff  and  blow  the  house  down"  for 
laggards  who  have  built  their  procurement  homes 
of  strategically  unsound  materials. 
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ACQUISITION  PLANNING  TOR  THE  NAVSTAR  G1.0RAI.  POSITIONING  SYSTEM  JOINT  PROGRAH 

CAPTAIN  BARRY  M.  ZILIN 

UNITED  STATES  AIR  FORCE  SPACE  AND  MISSILE  SYSTEMS  ORGANIZATION 


Planning  for  a  weapon  system  acquisition  is  a 
complicated  challenge.  Since  there  are  many 
disciplines  associated  with  acquisition, 
operation,  maintenance  and  support,  current 
regulations  strongly  suggest  Including  repre¬ 
sentatives  from  each  of  these  disciplines  in 
the  planning  process.  The  regulations  do  not, 
however,  take  full  advantage  of  the  experience, 
skill  and  expertise  of  industry,  a  major  part¬ 
ner  in  a  weapon  system's  life  cycle.  In 
order  to  draw  upon  this  vast  reservoir  of 
experience,  Air  Force  Systems  Command  uses 
draft  RFPs  and  often  extends  proposal  times  to 
allow  for  contractor  comment  on  our  require¬ 
ments.  Unfortunately,  it  seems  that  for  one 
reason  or  another,  contractors  contributions 
are  frequently  cosmetic.  Perhaps  fear  of 
giving  away  their  approach  to  the  competition 
is  a  contributor.  However,  an  equally  signif¬ 
icant  factor  is  Industry's  general  disbelief 
that  Program  Offices  want  comments.  "Not 
invented  here,"  though  few  will  admit  it, 
haunts  us  all. 

The  NAVSTAR  Global  Positioning  System  Joint 
Program  Office  (JPO)  and  the  SAMSO  Deputy  for 
Procurement  and  Manufacturing  recently  conduc¬ 
ted  a  Business  Strategy  Panel  (BSP)  in  which 
acquisition  strategies  were  developed  for 
Full-Scale  Engineering  Development.  Program 
Office  and  procurement  personnel  went  through 
the  normal  planning,  trades  and  analyses  prior' 
to  the  BSP,  except  for  one  interesting  twist. 
They  obtained  business  inputs  from  industry 
before  finalizing  their  acquisition  strategy. 

The  process  went  like  this.  First,  a  Govern¬ 
ment  planning  group  developed  several  alter¬ 
native  strategies.  However,  instead  of 
completing  an  analysis  of  the  alternatives  and 
reconmendlng  one  to  the  BSP,  they  allowed  time 
to  query  industry.  Prime  sources  were  sought 
and  briefed  on  the  Government's  requirements 
and  its  current  thoughts  on  acquisition  strat¬ 
egies.  Program  budgets  were  discussed  and 
each  potential  procurement  was  scoped  for  cost. 
Then,  industry  was  given  an  opportunity  to 
return  to  brief  the  planning  group  on  the 
strategy  that  would  increase  the  potential  for 
achieving  program  goals  within  cost,  on 
schedule,  and  with  the  least  risk  to  both 
parties. 

The  ground  rules  established  this  to  be  a 
business  discussion  -  not  a  technical  briefing 
or  marketing  pitch.  Industry  was  given  the 
fiscal  and  schedule  constraints  of  the  program 
and  was  told  to  challenge  requirements  that 
were  unachievable.  They  were  also  given  a 
written  list  of  questions  to  use  as  a  "straw- 
man"  in  developing  their  own  strategy,  if  they 


perceived  that  none  of  the  Government's  alter¬ 
natives  were  optimum.  The  Government  then 
requested  that  corporate  business  management 
either  present  the  briefing  or  participate  in 
strategy  development. 

How  did  all  this  work?  We  think  the  results 
were  phenomenal.  Nine  of  the  eleven  original 
companies  involved,  briefed  us.  The  briefings 
evolved  into  open  discussions  with  small  but 
equal  representation  on  both  sides.  The 
senior  members  of  the  planning  group  repre¬ 
sented  the  Government  and  many  companies 
brought  vice  presidents  to  represent  them. 

The  Government  planners  did  not  enter  the 
briefings  with  a  general  consensus  and  it  was 
evident  industry  did  not  either.  This  stim¬ 
ulated  an  excellent  open  exchange  of  ideas. 
What  did  we  get  out  of  all  this?  Almost  all 
companies  took  the  opportunity  to  present 
their  strategy,  and  although  each  company's 
strategy  was  understandably  favorable  toward 
its  own  strengths,  we  all  benefited  and 
achieved  a  great  deal  of  insight  into  each 
other's  thought  processes. 

As  each  briefing  progressed,  it  became  readily 
apparent  that  the  Government  knew  a  lot  less 
about  lndustrys'  desires  than  we  thought  we 
did.  (Only  once  did  the  Government  team  guess 
what  a  company  would  suggest  for  a  business 
strategy) .  Our  analysis  of  lndustrys'  brief¬ 
ings,  overlaid  on  our  acquisition  planning  led 
us  to  an  acquisition  strategy  that  is  not 
optimum  -  but  iii ‘the  best  available,  consid¬ 
ering  real  world  constraints.  Industry  now 
knows  what  types  of  contracts  and  incentives 
we  are  contemplating,  how  much  money  is 
available  for  the  total  acquisition,  what  we 
want  to  achieve  with  our  funds  and  that 
we  want  maximum  competition  for  a  reallscic, 
achievable  program.  This  should  encourage 
draft  RFF  consents  and  discourage  buy-ins. 

Would  we  recommend  continuing  this  approach? 
You  Bet!  It  makes  good  business  sense. 


PROCUREMENT  STRATEGY  FOR  SATELLITE  AND  SPACE  SYSTEMS  ACQUISITION 


Vito  Pagono 

Air  Command  and  Staff  College 


ABSTRACT 


Procurement  of  Satellite  and  Space  Systems  Is 
funded  In  the  same  way  as  other  systems  are  pro¬ 
cured,  by  full  funding.  Although  this  method 
is  required  by  Congressional,  DOD  arid  Air  Force 
guidelines  and  regulations.  It  is  riot  tailored 
to  the  peculiar  characteristics  of  space  systems 
acquisition,  .  igh  technology  and  low  voltme  pro¬ 
duction. 


The  objective  of  this  study  is  to  describe  the 
environment  within  which  space  systems  acquisi¬ 
tion  takes  place  arid  to  emphasize  how  the  tradi¬ 
tional  weapons  systems  acquisition  process  is 
applied.  The  study  defines  managerial  and 
technical  impediments  which  are  engendered  using 
full  funding  within  the  systems  acquisition  pro¬ 
cess.  Innovations  to  the  existing  systems  acqui¬ 
sition  strategy  are  proposed  and  conclusion 
emphasize  the  need  to  convince  Air  Force,  00D 
and  Congressional  authorities  that  space  systems 
acquisition  effectiveness  could  be  enhanced  if 
current  guidelines  are  modified. 
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DESIGN  TO  LIFE  CYCLE  COST  IN  THE  AMST  PROGRAM 


Captain  Jerry  A.  McEwen 

Aeronautical  Systems  Division,  Wright-Pattcrson  AFB,  Ohio 


INTRODUCTION 


You  need  some  economic  advice.  Your  company's 
old  fleet  of  short-haul ,  specialized  delivery 
trucks  have  given  good  service  for  over  20 
years  but  most  are  now  worn  out.  What's 
worse ,  the  company  has  developed  a  whole  new 
product  line  to  meet  some  stiff  competiticn 
and  the  new  equipment  simply  won!t  fit  in  the 
old,  narrow  body  trucks.  Even  with  smaller 
items,  the  old  trucks  couldn't. make  deliveries 
directly  to  the  construction  sites  where  the 
equipment  was  needed.  Some  of  your  more 
daring  drivers  have  tried  to  in  the  past  and 
thus  have  contributed  to  the  list  of  worn 
out  and  broken  trucks. 

So  the  company  president  has  directed  you,  the 
chief  of  purchasing,  to  buy  a  new  fleet  of 
trucks  with  wider  bodies  and  the  ability  to 
get  in  and  out  of  rough  construction  sites 
with  heavy  leads.  As  a  smart  manager,  you're 
trying  to  buy  a  fleet  of  trucks  that  will  do 
the  job  for  the  least  money.  You've  already 
had  several  meetings  with  both  th’e  fleet 
manager  and  the  company  president, .and  you 
have  negotiated  from  them  a  set  of  minimum 
essential  requirements  for  the  new  trucks. 

You  have  found  two  reputable  truck  manufac¬ 
turers  who  have  designed  new  prototype  models  . 
that  look  very  promising.  With  a  few  design 
changes,  ei tlier  truck  model  appears  to  meet 
your  minimum  essential  requirements.  You're 
ready  to  solicit  bids,  select  the  one  which 
meets  your  requirements  at  the  least  cost, 
and  get  on  with  the  job. 

WHAT  COSTS?  -  Are  you  really  ready?  What 
"costs"  should  you  consider  in  the  selection? 
The  company's  chief  of  maintenance  has  givem 
plenty  of  advice  on  this  question.  He  says 
that  maintenance  cost3  are  growing  by  leaps 
and  bounds.  Labor  costs,  fuel  costs,  and  the 
cost  of  parts  have  skyrocketed.  He  wants  you 
to  give  strong  consideration  to  the  cost  of 
operating  and  supporting  the  trucks  over  their 
expected  lifetime.  Another  meeting  with  the 
company  president  confirms  that  your  selection 
should  be  based  on  the  total  cost  of  buying 
the  new  trucks  and  the  cost  of  operating  and 
supporting  them  over  a  20  year  period. 

With  help  from  the  chief  of  maintenance  and 
the  two  manufacturers  (who  are  suddenly  very 
Interested  in  operating  and  support  costs)  you 
begin  to  get  your  act  together.  You  find 
great  quantities  of  historical  data  on  oper¬ 
ating  and  support  costs  for  truck  fleets. 

You  even  find  several  groups  who  are  actively 


predicting  these  types  of  costs.  Several 
coordinated  analyses  later,  you  have  a  cost 
prediction  technique  that  all  agree  will 
allow  you  to  select  a  truck  with  the  lowest 
predicted  life  cycle  cost.  You're  also 
beginning  to  find  ways  to  cut  down  some  of 
your  "minimum"  requirements  and  improve  the 
design  to  lower  the  total  cost.  How  you're 
even  getting  smart  enough  to  ask  the 
questions. 

HOW  CAN  YOU  BE  SURE?  -  How  can  you  be  sure  he 
will  develop  and  build  the  trucks  to  meet  a 
predicted  total  lifetime  cost?  As  you  ponder 
this  question,  the  vice-president  for 
accounting  speaks  up.  He  says  it's  great  to 
select  the  best  truck  based  on  total  cost, 
but  after  that  you'd  better  Just  worry  about 
the  production  cost.  He  wants  you  to  give 
the  contractor  a  production  cost  goal  a  few 
percent  below  his  bid  price  and  put  in  some 
incentives  and  controls  to  have  him  design 
the  truck  to  this  goal.  He  says  you  can't 
really  predict  life  cycle  costs,  and  with  the 
limited  budget  next  year  you'd  better  just 
make  sure  you  can  buy  the  truck  at  the  bid 
price.  Just  to  make  sure,  he  asked  the 
company  president  to  make  ycur  Christmas 
bonus  next  year  contingent  on  meeting  the 
production  cost  goal.  Now  you  know  you  need 
some  advice.  But  let's  get  back  to  real 
life.  This  little  story  is  analagous  to  a 
situation  now  being  faced  in  the  Air  Force 
by  the  Program  Director  of  the  AHST  SFO 
(that's  the  Advanced  Medium  STOL  (Short 
Take-Off  and  Landing)  Transport  System 
Program  Office)  at  Wright-Patterson  AFB, 

Ohio. 


THE  AMST  PROGRAM 


The  AMST  is  a  medium  size  jet  transport  air¬ 
craft  with  a  wide  body  for  outsize  cargo.  It 
incorporates  simple  but  effective  powered 
lift  technology  and  heavy  duty  brakes  to 
enable  it  to  take-off  and  land  with  heavy 
loads  on  short  runways.  It's  rugged  landing 
gear  and  high  flotation  tires  permit  the  AMST 
to  operate  repeatedly  out  of  short,  unim¬ 
proved  dirt  strips  where  the  action  is.  The 
high  lift  technology  also  helps  the  pilot  to 
rapidly  climb  and  descend  in  tight  circles 
over  the  airfield  to  escape  anti-aircraft 
fire  from'  iny  nearby  enemy  gunners.  The 
AMST's  wide  body  is  designed  to  carry  all  of 
the  Army's  new  outsize  firepower  equipment  and 
heavy  armor,  even  the  58  ton  Main  Battle  Tank. 
Another  wide  body  benefit  is  the  ability  to 
carry  both  troops  and  supplies  or  equipment 
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in  the  sane  load,  with  the  troops  sitting  in 
side-mounted  seats  alongside  the  cargo. 

Ali'LIFT  MODERNIZATION  -  The  purpose  of  the 
AMS?  is  to  modernise  the  Air  Force's  current 
tactical  airlift  capability,  which  is  rapidly 
being  depleted  and  is  deficient  in  a  number  of 
areas.  STGL  uircraft  such  as  the  C-7  and 
C-123  are  virtually  gone  from  the  active 
fleet;  the  few  serviceable  combat  aircraft 
remaining  have  been  transferred  to  the  Air 
National  Guard  and  the  Reserve  Force.  The 
active  force'3  C-130,  a  tactical  airlift  work¬ 
horse  for  over  20  years,  js  deficient  in  its 
abilitj  to  operate  safely  and  routinely  from 
short,  austero  j>  -ids.  It's  turbo-prop 
engine  is  .1.  icier,  but  gives  it  a  relatively 
slow  speed.  With  an  inadequate  payload  and  a 
narrow  body  design,  the  C-130  cannot  carry  a 
large  percentage  of  the  Army's  modern  vehi¬ 
cles,  not  even  the  M. I CV  (Mechanized  Infantry 
Combat  ’.’chicle),  the  primary  combat  vehicle 
Of  the  Army's  Mechanized  Infantry  Battalion. 

The  Air  Force  is  also  facing  a  large-scale 
replacement  cf  the  C-130  fleet  due  to  service 
life  exhaustion.  The  AMST  provides  the  option 
to  modernize  this  aging  and  depleted  force 
with  a  single  aircraft  which  enn  operate  out 
of  short,  austere  C-7  and  C-123  type  airfields 
and  carry  over  twice  the  payload  of  the  C-130. 

THE  AMST  PROGRAM  -  The  AMST  Program  is  now 
ready  to  proceed  from  a  prototype  advanced 
development  phase  into  engineering  development 
and  subsequent  production.  The  prototype 
program  was  the  result  of  a  formal  source 
selection  competition  open  to  all  U.S.  air¬ 
craft  manufacturers.  From  the  five  companies 
who  par  icipated,  Boeing  and  McDonnell -Douglas 
were  selected  to  build  and  flight,  test  two 
prototype  aircraft.  The  Boeing  YC-id  and  the 
Douglas  YC-15  have  each  completed  successful 
prototype  flight  test  programs,  and  the  two 
companies  are  now  competing  for  the  follow-on 
developnent/production  program. 

Transition  to  Engineering  Development.  A 
transition  phase  between  prototype  and 
engineering  development  led  to  several  program 
refinements.  To  hold  dowr  costs,  Army  and 
Air  Force  requirements  wt  .  scrubbed  down  to  a 
list  of  ''minimum  essentia,  requirements"  agreed 
to  by  the  Military  Airlift  Command  in  their 
Required  Operational  Capability  (ROC) 
docunent.  Limited  development  funding  called 
for  a  unique  approach.  The  austere  "Minimum 
Engineering  Development  (MED)  Program"  will 
ir.cludo  further  dcvclopmont/operotional  flight 
testing  using  the  prototype  aircraft,  modified 
to  the  production  design,  with  0  limited 
veri  flr.otlun  tent,  on  production  aircraft, 
concentration  on  l»w  production  coot,  which 
wnu  it  major  factor  in  nlzlng  the  nlrcraft,  has 
be.ii.  expanded  tn  include  enphnsln  on  lower 
Ir.tnl  1 1 1  e  cycle  c,.ui.ii .  ft  number  of  study 
i-ff.u-tu  were  conducted  In  suc.li  areas  as  life 
.-yrle  I-.  .1  ,,  ilrui go  definition,  and  Integrated 


Logistics  Support.  The  transition  phase 
included  the  development  of  management  plans 
to  guide  the  contractor's  development/ 
production  effort,  and  the  contracting 
approach  to  blend  these  efforts  together. 

The  AMST- Contracting  Approach.  The  AMST 
contracting  approach  emphasizes  life  cycle 
costs  and  includes  three  separate  contracts 
aimed  toward  minimum  total  cost.  The  MED 
contract  will  provide  design,  development, 
and  testing  of  the  aircraft  and  related 
:-iuinnent.  The  contract  requires  the  use  of 
existing  cur->- -cia) ly  certified  engines  which 
will  be  leased  by  the  contractor  for  the 
prototype  test  phase.  The  ccr.*ract  includes 
an  award  fee  to  motivate  the  contractor  to 
follow  his  plans  and  to  minimize  downstream 
costs •  The  MED  contract  calls  for  three 
priced  production  options  for  up  to  60  air¬ 
craft  cjt  of  a  planned  buy  of  277.  The 
aircraft  contractor  will  Gupply  the  engines 
for  the  Hi  st  three  production  options,  after 
which  the  Government  will  provide  the  engines 
as  GFAE.  This  portion  of  the  contract 
includes  a  large  performance  fee  based 
primarily  on  the  results  of  two  30  day  Opera¬ 
tional  Readiness  Evaluations  (OREs).  During 
these  evaluations.  Air  Force  crews  and 
maintenance  personnel  will  accomplish  a 
predetermined  set  of  operational  missions 
under  simulated  operational  conditions.  The 
OREs  will  measure  key  elements  of  operating 
and  support  (O&S)  costs  such  as  aircraft 
maintenance  manpower,  aircraft  reliability, 
material  usage,  and  fuel  consumption.  The 
first  ORE  will  occur  after  delivery  of  the 
seventh  production  aircraft.  The  second  will 
be  accomplished  on  a  complete  operational 
squadron  approximately  two  years  after  the 
IOC  (Initial  Operational  Capability)  date. 

A  separate  spares  contract  will  be  negotiated 
in  parallel  with  the  basic  MED/Production 
contract.  The  terms  and  conditions  cover 
pricing  procedures  for  the  acquisition  of 
initial  and  replenishment  spares  concurrent 
with  and  at  the  same  cost  as  the  production 
installs. 

An  Interim  Contractor  Support  (ICS)  contract 
wili  also  be  negotiated  in  parallel  with  the 
basic  contract.  The  contract  will  provide  up 
to  three  years  of  contractor  support  for 
spares  and  depot  level  maintenance  until  the 
USAF  obtains  this  organic  capability.  Special 
negative  pricing  incentives  are  included  to 
motivate  the  contractor  to  support  on  early 
organic  capability. 

These  and  other  provisions  1-  the  AMST 
contracting  approach  are  intended  to  enphanize 
life  cycle  coot  end  result  in  a  weapon  system 
with  the  minimum  cost  over  its  expected  life¬ 
time.  Life  cycle  cost  will  be  an  important 
consideration  in  the  selection  of  a  winning 
cwiitractor.  Some  major  trades  huve  already 


occurred  based  on  reduced  life  cycle  cost. 
Others  are  expected  to  occur  as  the  design  is 
solidified  during  the  MED  and  Production 
program. 

THE  DESIGN  TO  LIFE  CYCLE  COST  CONCEPT 


BACKGROUND  -  A  Department  of  Defense  Directive 
(DODD  5000.28)  requires  that  major  defense 
systems  acquisition  programs  apply  a  "Design 
to  Cost"  concept  using  the  Joint  Design  to 
Cost  Guide  (AKLCP/AFSCP  800-19).  The  intent 
of  this«-direction  is  clearly  focused  on  life 
cycle  cost.  The  directives  specify  that  life 
cycle  cost  goals  be  established  "to  which  the 
system  will  be  designed  and  its  cost 
controlled,"  and  that,  "practical  tradeoffs 
between  system  capability,  cost,  and  schedules 
must  be  continually  examined  to  insure  that 
the  system  developed  will  have  the  lowest  life 
cycle  cost  consistent  with  schedule  and 
performance  requirements." 

The  application  of  this  concept  begins  to 
digress  from  its  stated  purpose.  While  recog¬ 
nizing  the  need  to  control  total  life  cycle 
cost,  the  directives  specify  that  the  initial 
"difficult  but  achievable"  Design  to  Cost 
goal  "shall  be  established  in  the  form  of 
Average  Unit  Flyaway  cost."  The  stated 
reason  for  limiting  the  goal  to  production 
cost  is  "because  of  the  ability  to  more 
accurately  estimate  production  costs  and  the 
supportive  production  cost  data  base  avail¬ 
able."  Changes  to  a  Design  to  Cost  goal  must 
be  approved  by  the  Secretary  of  Defense  and 
are  generally  approved  "only  for  major  changes 
. where  a  significant  demonstrable  reduc¬ 
tion  in  life  cycle  costs  can  be  achieved,  or 
for  program  changes  beyond  the  control  of  the 
program  manager."  In  practice,  D0D  has  set 
very  difficult  goals,  usually  below  tha 
official  program  estimate,  and  changes  to  * 
these  goals  have  been  hard  to  come  by,  even 
for  the  good  reasons  stated  above.  For  these 
and  other  reasons,  almost  every  major  aircraft 
acquisition  program  has  failed  to  meet  its 
Design  to  Cost  goal,  as  Illustrated  in  Figure 
I  for  two  of  the  major  Design  to  Cost 
programs . 

DESIGN  TO  LIFE  CYCLE  COST  OBJECTIVES  -  The 
AMST  program  manager  proposes  to  use  a  "Design 
to  Life  Cycle  Cost  (DTLCC)"  concept  in  his 
management  of  the,  AMST  Program.  This  concept 
' ~  designed  to  embrace  the  full  Intent  of  DODD 
b000.28  and  to  avoid  the  pitfalls  of  the 
current  application  of  "Design  to  Cost."  The 
objective  of  DTLCC  is  "to  minimize  tt.e  total 
cost  to  the  Government  of  development,  produc¬ 
tion,  support,  and  operation  of  the  AMST 
system  within  defined  constraints  of  budget, 
performance  and  schedule." 


FIGURE  1 

WHY  HAVE  PH0CRAMS  NOT  MET  THE  III  DTC  COAL? 


Reason 

program 

A 

PROGRAM 

B 

Goals  Unreasonably  l.ow 

X 

X 

Requirements  Changes 

X 

X 

I.CC  Trades 

X 

X 

Schedule  Changes 

X 

X 

Unforeseen  Problems 

Lack  of  Contractual  Incentives 

X 

X 

Source:  Interviews  with  Program  Office 
personnel . 


The  DTLCC  concept  includes  the  following 
Kubobjectives: 

1.  Life  cycle  cost  shall  be  considered  equal 
to  performance/technical  requirements  and 
schedule  throughout  the  design,  development, 
and  production  of  the  AMST. 

2.  Development  and  production  costs  shall  be 
balanced  against  the  costs  of  deploying, 
supporting  and  operating  the  system.  Where 
significant  outyear  savings  are  possible, 
additional  investment  costs  will  be  pursued. 

3.  System  performance  requirements,  design/ 
production  requirements,  and  concepts  for 
operation,  employment  and  maintenance  will  be 
continually  reviewed  and  updated  to  insure 
that  the  minimum  life  cycle  cost  design  is 
achieved  for  the  projected  airlift  needs. 

4.  Contractual  provisions  shall  be  provided 
to  task  and  motivate  the  contractor  to  imple¬ 
ment  a  meaningful  DTLCC  program  wi thin  the 
contractor's  organization. 

5.  DTLCC  awareness  by  botli  Government  and 
contractor  personnel  shall  be  achieved  by 
continual  management  emphasis  at  the  corpor¬ 
ate  level ,  exchange  of  ideas  on  current 
problems,  designer  visits  to  depot  and 
operational  units,  etc. 

THE  DTLCC  GOAL  -  Tile  DTI.CC  plan  represents, 
in  effect,  a  contract  between  the  Air  Force 
odd  the  Department  of  Defense  to  develop  the 
AMST  aircraft  to  a  single)  total  life  cycle 
cost  goal.  This  goal  is  expressed  as  the  sum 
of  the  following  four  cost  elements  normalized 


to  an  individual  aircraft  and  expressed  in 
constant  Fiscal  Year  1977  dollars:  Minimum 
Engineering  Development  Cost,  Weapon  System 
Cost,  Ocher  Support  Coots,  and  Operating  4 
Support  Costs. 

The  DTLCC  plan  defines  each  of  the  four  cost 
elements  to  include  both  contract  and  in-house 
Government  costs.  *"">  '•eat.  for  e-  id 

defined  as  all  program  costs  funded  by  the 
3G00  appropriation,  excluding  sunk  costs  prior 
to  Fiscal  Year  (FY)  77.  The  plan  further 
defines  the  in<  ,uded  and  excluded  effort  in 
the  MED  progr-  ur.d  the  baseline  aircraft 
configuration  and  performance.  Annexes  to  the 
plan  break  down  each  cost  element  into 
detailed  subelements;  and  provide  a  complete 
list  of  the  definitions,  assumptions,  ground 
rules,  and  me-.hods  of  calculating  and  estima¬ 
ting  the  cost  of  each  subelement.  The  moans 
of  tracing  and  reporting  the  current  status 
vs  the  hti.CC  goal  and  the  cost  elements  is 
included,  of  course.  A  synopsis  of  the 
cost  c..ements  is  shown  in  Figure  2. 


The  DTI.CC  program  not  only  provides  visibility 
and  control  of  total  life  cycle  cost,  but  the 
single  DTI.CC  goal  in  intended  to  provide  the 
program  manager  with  the  necessary  flexibility 
to  achieve  this  goal.  The  plan  provides  a  set 
of  conditions  and  procedures  to  adjust  the  MED 
and  Weapon  System  Cost  elements  in  exchange 
for  significant  life  cycle  cost  savings.  The 
program  manager  will  have  the  authority  to 
trade  costs  among  the  four  elements  within 
established  budget  constraints  and  funding 
limitations.  Potential  cost  trades  which 
exceed  the  budget  flexibility  of  the  program 
manager  will  be  brought  to  the  attention  of 
the  Air  Staff  and  DOD  for  resolution.  Adjust¬ 
ment  of  the  life  cycle  cost  goal  will  normally 
be  requested  for  changes  in  program  direction 
such  as  funding  profiles,  buy  quantities, 
schedules,  design  requirements,  and  other 
factors  which  are  beyond  the  program  manager’s 
control . 


FIGURE  2 


AMST  LIFE  CYCLE  COST  GOAL  AND  SUBELEMENTS 


MED  COST 


WEAPON  SYSTEM  COST  (WSC) 


MED  Contract 


ECO  Allowance 


Aircraft  (Total  Buy) 

Support  Equipment  (Peculiar) 


Other  Government  Costs 


Training  Equipment 


GFE  4  Other  Government  Costs 


OTHEfl  SUPPORT  COSTS  (OSC) 


04S  COST  (20  YEARS) 


Initial  Spares 


Spare  Engines 


Base  Maintenance 


Interim  Contractor  Support 


Depot  Maintenance 


Facilities  Modification 


Personnel  4  Training 


■Type  I  Training 


Replenishment  Spares 


Initial  Common  Support  Equipment 


Class  IV  Modifications 


LCC  GOAL  = 


MED  +  VSC+OSC  +04S 


'w 


APPLICATION  OF  DTLCC  IN  THF.  AMST  CONTRACT 


The  AMST  program  manager  will  exercise 
aggressive  cost,  schedule  and  technical 
control  of  the  AMST  Program  through  five 
management  centers,  each  headed  by  a  project 
manager.  The  management  centers  are: 

Structures  Systems,  Flight  Systems,  rower 
Systems,  Mission  Systems,  and  Flight  Test. 

The  project  managers  will  receive  subgoals 
from  each  of  the  four  DTLCC  cost  elements. 

The  program  manager  will  control  the  integra¬ 
tion  of  common  cost  elements  across  the 
management  centers,  Integration  of  life  cycle 
cost  consciousness  at  all  levels  of  Air  Force 
arid  contractor  management  is  a  primary  program 
consideration.  Contract  requirements  include 
the  following  provisions  for  DTLCC: 

INTERNAL  CONTROL  -  The  total  contract  DTLCC 
goal  and  its  four  cost  elements  will  be  estab¬ 
lished  by  the  Government  based  on  costs 
proposed  by  the  contractor  during  competition. 
The  contract  DTLCC  goals  do  not  include  the 
Air  Force  program  managers1  in-house  program 
costs  nor  his  management  reserve  for  potential 
contract  changes,  The  contractor  is  required 
to  suballocate  the  four  cost  goals  throughout 
the  contract  Work  Breakdown  Structure  (WBS)  to 
subsystem/component  levels  at  which  the  impact 
of  discrete  design  changes  on  the  four  cost 
goals  may  be  identified.  Controls  and  incen¬ 
tives  in  the  contractors1  management  structure 
are  provided  to  require  designers  and 
managers  at  each  level  to  consider  life  cycle 
costs  in  key  management  decisions,  in  all 
Engineering  Change  Proposals  (ECPs),  and  in 
all  design  trade  studies. 

LIFE  CYCLE  COST  TRADE  STUDIES  -  The  contractor 
is  required  to  continually  review  the  program 
for  "cost  drivers."  Candidates  for  cost 
reduction  are  subjected  to  a  continuous  trade 
study  effort  to  minimize  total  life  cycle 
costs  through  such  actions  as  design  simplifi¬ 
cations,  producibility  changes, .and 
reliability /maintainability  improvements.  The 
contractor's  project  management  structure  pro¬ 
vides  teams  of  specialists  from  each  functional 
discipline  who  systematically  review  each 
trade  study  candidate  for  significant  life 
cycle  cost  reductions.  The  reviews  also  point 
out  Government  requirements  and  policies  which 
contribute  to  higher  costs.  The  contractor 
implements  those  design  changes  which  are 
within  his  budget  flexibility.  Changes  to 
cost  goals  which  are  "out  of  scope"  are 
submitted  to  the  Air  Force  program  manager  for 
a  decision. 

STATUS  ASSESSMENT  AND  REPORTING  -  The  contract 
specifies  the  methodology  and  models  to  set 
cost  goals  and  to  track  the  life  cycle  cost 
status  of  the  four  cost  elements  and  each 
subai location.  The  contractor  is  required  to 
continuously  track  and  to  periodically  report 


the  detailed  life  cycle  cost  status.  He  Is 
also  required  to  document,  track,  and  report 
all  design  changes  made  to  roduce  life  cycio 
costs.  Development  and  production  costs  must 
be  reconciled  with  the  contractor's  validated 
accounting  system  (Cost/Schedule  Control 
System).  Government  teams  periodically  visit 
the  contractor  to  review  and  validate  his 
entire  DTLCC  management  system.  The  contrac¬ 
tor  provides  special  reviews  to  support  Air 
Force  program  validation  milestones  with  the 
Department  of  Defense. 

INTEGRATION  -  Design  to  Life  Cycle  Cost 
consciousness  has  been  woven  into  almost 
every  aspect  of  the  program.  The  contrac¬ 
tor's  internal  management  structure,  along 
with  the  Air  Force  program  office,  is 
specifically  geared  to  provide  appropriate 
information  and  incentives  for  each  organiza¬ 
tional  level  to  consider  cost  on  an  equal 
basis  with  technical  requirements  and 
schedule.  The  program  office  ha6  developed 
a  computerized  model  to  estimate  production 
costs.  In  minutes  it  can  provide  a  detailed 
cost  estimate  of  proposed  changes  to  the 
aircraft  or  the  program  schedule.  An 
essential  asset  to  DTLCC  is  an  OSS  cost  model 
which  was  developed  by  the  program  office 
with  the  assistance  of  the  using  and 
supporting  commands. 


OPERATING  AND  SUPPORT  COST  FORECASTING 


The  ability  to  accurately  forecast  Operating 
and  Support  (O&S)  costs  is  the  key  feature 
which  permits  the  evolution  from  "Design  to 
Cost"  to  "Design  to  Life  Cycle  Cost." 

Previous  attempts  at  O&S  coat  forecasting 
have  used  parametric  models  which  were  insen¬ 
sitive  to  design  changes.  Other  models,  such 
as  the  Logistics  Support  Cost  (LSC)  model, 
use  statistical  techniques  to  forecast 
support  costB  for  individual  aircraft 
components.  The  LSC  model  has  proven  quite 
useful  in  identifying  component  support 
costs,  but  fails  to  account  for  interactions 
as  the  components  are  integrated  into  a 
complete  aircraft  system. 

Air  Force  regulations  (AFR  173-10)  specify 
use  of  the  Cost  Analysis  Cost  Estimating 
(CACE)  model  for  analysis  of  O&S  costs.  The 
CACE  model  is  basically  an  accounting  struc¬ 
ture  which  combines  a  multitude  of  system 
level-  maintenance  inputs,  rates,  and  average 
costs  to  sum  up  the  annual  operating  and 
support  coot  for  a  squadron  of  aircraft.  The 
regulation  contains  input  values  which  are 
regularly  updated  for  inventory  aircraft 
based  on  historical,  budgeted  costs.  For 
acquisition  aircraft,  most  program  offices 
contractually  apply  the  LSC  model  and,  using 
Its  component  level  costs,  attempt  to  trans¬ 
late  this  data  to  the  system  level  inputs  of 
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the  CACE  model..  As  actual  costs  become  avail¬ 
able,  significant  differences  are  often  found 
for  which  correlation  is  difficult  or 
impossible. 


THE  AM3T  OAS  COST  METHODOLOGY  -  The  AMST 
program  office  has  developed  a  unique  approach 
to  OAS  costing.  This  approach  adapts  the 
basic  accounting  structure  of  the  CACE  model 
and  uses  a  variety  of  means  to  calculate  the 
input  values.  The  AMST  CACE  model  inputs  are 
categorized  into  three  areas:  Air  Force 
Standard  ’...puts,  Program  Standard  Inputs,  and 
Design  fensitive  Inputs.  A  summary  of  the 
inputs  <nd  a  sample  output  run  are  shown  In 
Tables  1  and  ?.  respectively. 


per  aircraft  are  stated  in  the  MAC  ROC  and 
approved  by  USAF  Headquarters.  To  digress 
for  a  moment,  the  Air  Force  calculates  OAS 
cost  based  on  peacetime  operations.  Elements 
such  as  maintenance  manning  and  spares  stock¬ 
piles,  however,  are  based  on  planning  factors 
for  wartime  operations.  For  example,  the 
AMST  CACE  model  output  is  based  on  a  standard 
Air  Force  equation  which  uses  such  inputs  as 
maintenance  manhours  per  flying  hour,  wartime 
utilization  rates,  and  wartime  efficiency 
factors  to  compute  maintenance  manpower  and 
its  associated  costs. 


Air  Force  Standard  Inputs.  Input  values  such 
as  pay  rates,  fuel  cost  per  gallon,  and 
training  costs  are  taken  directly  from  AFR 
173-10.  These  values  are  based  on  Air  Force 
wide  statistical  averages  and  are  updated 
regularly. 


Design  Sensitive  Inputs.  The  heart  of  the 
AMST  CACE  model  is  the  manner  In  which  It 
computes  the  design  sensitive  inputs.  Such 
values  as  depot  maintenance  coat,  replenish¬ 
ment  spares,  and  maintenance  manhours  per 
flying  hour  are  computed  from  a  "botloms-up" 
engineering  analysis.  A  detailed  work  unit 
code  listing  breaks  theBe  items  and  tasks 
down  to  a  level  where  the  work  can  be  scoped 


TABI.E  1 

AMST  CACE  MODEL  INPUTS 


Air  Force  Standard  Input3 


Unit  of  Measurement 


Pay  A  Allowance  Cost 
PCS  Cost 

Medical  Support  Cost 
Training  Cost 
Personnel  Acquisition  Cost 
Personnel  Turnover  Rates 
Vehicular  Equipment  Cost 
Fuel  Cost 

Class  IV  Aircraft  Modification  Cost 


$/Manyear 

$/Manyear 

$/Manyear 

S/Graduate 

$/Man 

Percent  Per  Year 
{/Manyear 
$ /Gal ion 

$/Unit  Flyaway  Cost 


Source 
AFR  173-10 


Program  Standard  Inputs 


Assigned  Aircraft 

Peacetime  Aircraft  Utilization  Rate 
Wartime  Aircraft  Utilization  Rate 
Crew  Ratio 
BOS/RPM  (MAC) 


Aircraft/Squadron 
Flying  Hours/Year/Aircraft 
Flying  Hours/Year/Aircraft 
Crews/Aircraft 
$/Manyear 


MAC  ROC 


AFR  173-10 


Design  Sensitive  Inputs 


Unit  Flyaway  Cost 
Aviation  Fuel  Consumption  Rate 
Maintenance  Manhours  Fer  Flying  Hour 
Base  Material  (Variable  Co3t) 

Base  Material  (Fixed  Cost) 

Depot  Maintenance  (Variable  Cost) 
Depot  Maintenance  (Fixed  Cost) 
Replacement  Support  Equipment 
Crew  Composition 


{/Aircrafl 
Gallons/Flight  Hour 
MMH/Flight  Hour 
$/Flight  Hour 
$/Aircraft/Year 
{/Flight  Hour 
.  {/Aircraft/Year 
$/AIrcraft/Yenr 
Typi 


Production  Cost 

Model 

Model 

AFR  173-10 

AFR  173-10 

Model 

Model 

AFR  173-10 

Aircraft  Specification 


Source:  AMST  OAS  Cost  Estimating  Handbook,  15  September  1977. 


Ppouram  Hi  nnrim'd  tncbUi.  Input,  values  such  ns 
nrogi  nmmml  flying  hours  und  crown  unsigned 


or  compared  to  historical  data.  As  actual 
data  becomes  available,  it  is  accumulated  and 
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TABLE  ? 


\ 


AMST  CACE  MODE I.  OUTPUT 
(SAMPLE  ILLUSTRATION) 


ANNUAL  SOUADHON  OPERATIONS  A  SUPPORT  COST 


Recurring  Investment  4  Miscellaneous  Logistics 


Common  AGE  (Including  Spares) 

$ 

XXX  XXX  XX 

Aviation  Fuel 

X 

XXX  XXX  XX 

Aircraft  Maintenance,  Base  Level  (Material  Only) 

X 

XXX  XXX  XX 

Aircraft  Maintenance,  Depot  Level 

X 

XXX  XXX  XX 

Modification,  Class  IV  (Including  Initial  Spares) 

XXX  XXX  XX 

Munitions,  Training 

0 

Replenishment  Spares 

XXX  XXX  XX 

Vehicular  Equipment 

XX  XXX  XX 

Subtotal 

X 

XXX  XXX  XX 

Pay  4  Allowances 

Military  Pay  and  Allowances 

X 

XXX  XXX  XX 

Civilian  Pay  and  Allowances 

XXX  XXX  XX 

Subtotal 

X 

XXX  XXX  XX 

MFP  -  BOS/RPM  Support  Of 

PPS  Manpower 

XXX  XXX  XX 

BOS/RPM  Manpower 

XX  XXX  XX 

Subtotal 

XXX  XXX  XX 

Medical  (MFP  VIII)  Support  Of 

Medical  Officers 

XX  XXX  XX 

Medical  Airmen 

XXX  XXX  XX 

Subtotal 

XXX  XXX  XX 

Personnel  Support 

Permanent  Change  of  Station  -  Officers 

XXX  XXX  XX 

Permanent  Change  of  Station  -  Airmen 

XXX  XXX  XX 

Subtotal 

XXX  XXX  XX 

Pipeline  Costs 

Officer  Acquisition  -  Pilots 

XXX  XXX  XX 

Officer  Acquisition  -  Nonpilot  Aircrew 

XX  XXX  XX 

Officer  Acquisition  -  Nonaircrew 

XX  XXX  XX 

Airmen  Acquisition 

XXX  XXX  XX 

Officer  Training  -  Pilots 

XXX  XXX  XX 

Officer  Training  -  Other  Aircrew 

XX  XXX  XX 

Officer  Training  -  Nonaircrew 

X  XXX  XX 

Airmen  Training  -  Base  Level  Aircraft  Maintenance 

XXX  XXX  XX 

Airmen  Training  -  Other 

XX  XXX  XX 

Subtotal 

X 

XXX  XXX  XX 

TOTAL  ANNUAL  COST  ESTIMATE 

$XX  XXX  XXX  XX 

summed  through  this  same  structure,  making 
comparisons  simple. 

Aviation  fuel  gets  special  attention.  A  de¬ 
tailed  set  of  mission  profiles  were  developed 
in  cooperation  with  the  Military  Airlift 
Command.  The  aircraft  is  analytically  "flown" 
through  these  profiles  to  determine  statis¬ 
tical  composite  fuel  consumption  rate.  The 
model  shows  excellent  correlation  to  data  on 
existing  aircraft.  An  added  benefit  is  the 


capability  to  point  out  the  sensitivity  of 
fuel  costs  to  planned  operational  and  train¬ 
ing  concepts. 

Other  inputs  such  os  base  material  and 
replacement  support  equipment  coots  are 
presently  scaled  to  similar  aircraft  oper¬ 
ating  in  a  comparable  environment.  Continued 
effort  is  planned  to  develop  design  sensitive 
methodologies  for  these  values. 


( 


CONTRACTUAL  APPLICATION  OF  TUF.  CACE  MODEL  - 
The  AHST  contract  requires  application  of  both 
the  basic  CACE  model  and  a  fleet  CACE  model  to 
compute  OAS  costs.  The  fleet  model  is  an 
extension  of  the  basic  model  which  considers 
such  factors  as  force  buildup  and  phaseout, 
squadron  location,  and  spares  provisioning 
schedules  to  compute  20  year  OAS  cost  for  the 
total  AHST  fleet.  Roth  models  are  controlled 
by  the  program  office.  Adjustments  to  t.he 
baseline  estimate  are  based  or,  contractor 
design  changes  which  do  not  affect  the  basic 
assumptions  and  gioundrules  in  the  model. 

The  conit  actor  is  also  required  to  use  the 
L3C  model  •  rest.  logistics  suppoi  t  cost  in 
trade  studies  ai  the  component  level. 


CONCLUSION 


The  AHST  Resign  to  Life  Cycle  Cost  concept 
should  help  to  alleviate  the  "eleventh  hour" 
surge  of  introducing  logistics  considers'  ions 
Jnte  in  the  program.  It  is  basically  a  sound 
economic  concept  in  that  it  attempts  to  focus 
design  decisions  on  the  difference  in  total 
tost  of  I  he  alternatives. 

The  ANSI  Design  to  Life  Cycle  Cost  program  has 
been  endorsed  by  both  Air  Force  Systems 
Command  and  Air  Force  Logistics  Command  as  a 
"significant  slop  forward  in  implementing  tiie 
oMtcco'.s  of  DOD  Directive  5000.28."  Certain¬ 
ly,  it  achieves  a  focus  on  life  cycle  costs 
unattainable  with  previous  techniques. 
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MULTIPURPOSE  PREDICTIVE  ESTIMATING  TECHNIQUE 
(MuPPET)  POR  ASSESSMENT  OP  ADVANCED  SYSTEMS 


Frederick  H.  Gralow,  Boeing  Aerospace  Company 
D.  Kent  Hindes,  Boeing  Aerospace  Company 


INTRODUCTION 


This  paper  describes  a  new  method  for  assessing 
the  potential  effectiveness  and  cost  of  advanced 
concepts.  The  methodology  is  intended  for  very 
early  pre-program  or  program  application  when 
conventional  data  is  scarce  or  lacking. 

During -the  mission  need  analysis  and  concept 
formulation  phases  of  new  programs,  typical 
available  data  and  information  are  vague, 
Incomplete,  and  largely  qualitative.  This  is 
especially  true  if  advanced  technology  options 
are  viable  candidates  to  meet  mission  needs. 

This  type  and  quality  of  data  defies  Inclusion 
in  "traditional"  determinant,  statistical,  and / 
or  stochastic  models.  In  spite  of  this  dilemma, 
system  evaluators  must  make  decisions  about 
technological  and  cost  constraints,  and  rank 
the  comparative  worth  of  competing  options. 

This  problem  has  been  recognized  for  some  time. 
In  1973,  Boeing  implemented  a  search  for  exist¬ 
ing  analytical  tools  appropriate  for  very  early 
evaluation  of  the  cost/effectlveness  of  compet¬ 
ing  system  options.  One  hundred  sixty  documents 
and  fourteen  computer  programs  pertaining  to 
life  cycle  cost  and  system  effectiveness  were 
reviewed.  Results  of  this  study  indicated  that 
as  of  the  end  of  1973,  a  practical  method  of 
determining  life  cycle  cost  early  in  a  program's 
life  cycle  did  not  exist.  Information  pertain¬ 
ing  to  system  worth  was  almost  non-existent. 
Since  that  time  much  work  has  been  done  in  the 
cost/effectiveness  area,  but  as  yet,  a  standard 
technique  for  determining  system  worth  during 
the  early  stages  of  a  program  has  not  been 
commonly  accepted  and  used. 

High  level  policy  directives  to  develop  early 
analyses  have  not  been  lacking.  In  February 
1976,  William  P.  Clements,  Jr.,  then  Deputy 
Secretary  of  Defense,  issued  a  memo  to  the 
Secretaries  of  the  military  department  (1)  which 
directed  the  departments  to  focus  now  on  reduc¬ 
ing  the  outyear  operations  and  support  costs  of 
new  systems  under  development.  In  April  1976, 
the  Office  of  Management  and  Budget  Issued 
Circular  No.  A-109  (2)  which  gave  all  government 
agencies  policy  direction  on  the  acquisition  of 
major  systems.  This  Circular  called  for  a  pre¬ 
program  phase  during  which  a  specific  mission 
need  would  be  established  and  defined  prior  to 
commitment  to  a  specific  system  concept  to  ful¬ 
fill  Che  mission.  This  phase  would  be  followed 
by  a  major  decision  point  at  which  time  enough 
analysis  must  be  dona  to  establish  technological 
and  life  cycle  cost  constraints  on  mission 
accomplishment.  Also,  A-109  requires  a  thorough 


analysis  and  evaluation  of  all  feasible  alter¬ 
native  systems  during  the  following  system 
concept  phase.  These  directives  set  a  critical 
requirement  for  the  development  of  viable  tools 
to  accomplish  the  necessary  analyses  and  eval¬ 
uations. 

Missions  which  can  be  accomplished  by  evolu¬ 
tionary  outgrowths  of  existing  technology  can 
usually  be  assessed  by  conventional  parametric 
estimating  techniques  which  extrapolate  from 
an  existing  historical  data  base.  When  new 
revolutionary  technology  is  involved,  however, 
an  unconventional  estimating  technique  must  be 
developed  which  can  accept  preliminary,  incom¬ 
plete  data;  normalize  them  to  a  common  basis 
and  credibly  predict  expected  costs  and  effect¬ 
iveness.  Boeing  has  developed  such  a  methodol¬ 
ogy  In  the  Multi-Purpose  Predictive  Estimating 
Technique  (MuPPET). 


MuPPET  MODEL  DEVELOPMENT 


The  model  was  developed  in  its  initial  manual 
form  in  late  1973,  and  was  used  to  assess  the 
expected  impact  of  revolutionary  technology  on 
the  operational  availability  of  avionics  in  the 
1980-2000  rime  frame.  Results  from  this  Initial 
application  were  encouraging  and  the  model  was 
refined  and  computerized  in  1975.  It  was  next 
used  to  assess  the  life  cycle  cost  implications 
of  a  fiber  optic  avionic  data  transfer  system. 
Exhibit  1  traces  this  development  process. 


Exhibit  1 
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The  results  obtained  from  these  two  experimental 
applications  have  led  to  the  conclusion  that 
the  model  is  a  useful,  credible,  and  compara¬ 
tively  low-cost  tool  for  assessing  and  relating 
the  various  cost  and  effectiveness  parameters 
associated  with  the  introduction  of  new  tech¬ 
nology. 


MODEL  METHODOLOGY 


MuPPET  is  a  tool  for  predicting  and  comparing 
the  cost  and  effectiveness  of  alternate  solu¬ 
tions  for  acquiring  a  required  mission  capabil¬ 
ity.  The  tool  was  developed  specifically  for 
use  very  early  in  a  program's  life  cycle  when 
very  little  is  historically  known  about  the 
hardware  system  that  will  result. 

The  process  focuses  on  one  major  cost/effectlve- 
ness  decision  variable  at  a  time  (such  as  life 
cycle  cost  or  system  performance)  and  predicts 
the  Impact  of  the  new  required  capability  on 
this  variable.  The  process  is  implemented  by 
first  identifying  the  elements  of  the  required 
mission  and  the  relevant  functional  issues  of 
the  decision  variable  of  interest  (for  example, 
life  cycle  cost) .  Then  the  Impact  of  proposed 
mission  solut^onfs)  on  the  decision  variable  is 
estimated  within  the  context  of  each  of  these 
relevant  decision  issues.  The  impact  estimate 
for  each  proposed  solution  is  quantified  as  an 
expected  departure  from  the  value  of  the 
decision  variable  which  results  from  a  "baseline" 
solution.  The  baseline  must  contain  sufficient 
historical  data  to  determine  the  corresponding 
value  of  the  decision  variable,  and  may  be  any 
known  system  which  performs  a  somewhat  similar 
nlSBion  to  the  new  required  mission. 

The  process  utilizes  highly  structured  and  dis¬ 
ciplined  mission  solution/decision  issue/ 
decision-variable  definitions  and  mathematical 
transforms  to  normalize  and  correlate  uncertain, 
disjoint,  and  scarce  input  information.  The 
resultant  computer-aided  model  may  be  character¬ 
ized  as  a  three-dimensional  estimating  matrix 
ns  shown  in  Exhibit  2  where  the  three  mutually 
perpendicular  axes  are: 

(1)  The  functional  actj  Ities  or  issues  rele¬ 
vant  to  the  decision  variable  required  to 
implement  the  mission  (the  relevance  tree). 

(2)  The  features  of  the  system  solution  being 
considered  (the  solution  definition  tree). 

(3)  The  constituent  variables  of  an  objective 
function  of  Interest  such  os  life  cycle 
cost  (the  criteria  set). 

Utilizing  whatover  input  information  is  available, 
lucremuntal  comparative  Impact  estimates  are 
nude  for  each  declolon  cell  of  the  matrix  formed 
by  the  intersections  of  the  elements  on  the  throe 
axes.  Internal  weighting  and  data  transform 


processes  within  the  model  normalize  and  aggre¬ 
gate  the  incremental  input  estimates  into  an 
overall  assessment  of  the  impact  of  the  pro¬ 
posed  system  option  on  the  decision  variable  of 
interest,  e.g.,  life  cycle  co6t,  as  compared  to 
the  known  baseline.  The  elemental  input  esti¬ 
mates  and  subsequent  transforms  leading  ro  this 
output  assessment  are  traceable  and  defendable 
back  through  the  model. 
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Exhibit  2 


To  visualize  this  estimating  process,  refer  to 
Exhibits  3  and  4.  Exhibit  3  portrays  the  model 
matrix  sliced  along  the  criteria  set  axis. 

Each  plane  thus  formed  represents  the  baseline 
value  of  each  constituent  variable  (criterion) 
of  the  decision  variable  objective  function. 

The  total  baseline  value  of  each  criterion  is 
composed  of  -incremental  values  proportionately 
allocated  to  each  mission-solution  element/ 
decision  issue  combination.  These  are  repre¬ 
sented  in  the  exhibit  by  the  intersections  on 
the  plane.  The  positive  and  negative  vectors 
leading  from  these  Intersections  represent  the 
estimated  Impacts  on  the  incremental  baseline 
values  resulting  from  the  various  mission- 
solution  element/decision  issue  combinations. 
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A  ring  around  an  interaection  represents  a 
"uo-impact"  estimate  for  that  combination  (note 
that  the  impacts  portrayed  in  Exhibit  3  are 
examples  only  and  have  no  relationship  to  a 
real  problem) . 

Exhibit  A  portrays  the  manner  in  which  these 
elemental  impact  vectors  are  summed  to  an 
aggregate  impact  on  each  baseline  criterion 
value.  The  last  step  of  this  estimation  pro¬ 
cess  is  to  compute  the  predicted  value  of  the 
decision  variable  for  the  particular  system 
solution  under  investigation.  This  is  done  by 
evaluating  the  decision  variable's  objective 
function  using  the  impacted  values  of  the 
constituent  variables  (criteria)  computed  above. 
This  objective  function  may  be  any  mathematical 
construct  which  appropriately  defines  the  deci¬ 
sion  variable  in  terms  of  the  constituent 
variables  used  as  estimating  criteria  within 
the  model. 
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Exhibit  4 


EXAMPLE  APPLICATION 


To  illustrate  the  applicability  of  the  MuPPET 
process,  a  suggested  phase  zero  life  cycle  cost 
scoping  process  for  a  possible  future  mission 
is  presented.  The  example  mission  chosen  for 
this  paper  is  the  "Neutralization  of  Hostile 
Action  in  the  Near  Space  Environment".  This 
mission  requirement  is  an  example  only  and  is 
not  Intended  to  reflect  ah  actual  DoD  mission, 

It  was  chosen  to  illustrate  a  typical  advanced 
technology  mission.  The  analysis  procedure 
presented  is  based  on  a  mission  solution  defini¬ 
tion  in  terms  of  its  functional  elements  and  is 
applicable  to  phase  zero  activity  leading  to 
the  "Milestone  0"  decision  as  required  by  0MB 
Circular  A-109  (2).  Note  that  one  of  the  most 
powerful  features  of  the  MuPPET  process  is  its 
usefulness  as  an  estimating  tool  for  the  highly 
aggregated  problem  structures  encountered  in 
the  "executive  decision  environment"  of  phase 
zero  as  well  as  for  highly  decomposed,  detailed 
problems  and  solutions  in  the  "engineering 
decision  environment"  of  the  system  concept 
phase.  The  seme  baalc  model  of  the  problem  can 


he  used  throughout  both  phases.  This  is 
possible  because  the  technique  develops  problem 
and  solution  definitions  through  a  top-down, 
successive  decomposition  approach  ns  n  program 
progresses  from  preliminary  top  level  decision 
requirements  to  lower  level  ayetem  dasign 
dscislon  requirements .  The  life  cycle  cost 
(LCC)  assessment  process  for  our  mission 
requlrament  example  would  proceed  as  follows: 

(1)  Define  the  mission,  "Neutralization  of 
Hostile  Action  in  the  Near  Space  Environ¬ 
ment",  in  terms  of  its  functional  capa¬ 
bility  elements.  These  are  the  "Mission 
Element  Needs"  of  the  Mission  Element 
Need  Statement  (MENS)  and  when  related 
in  a  cstegorlal  structure  form  becomes 
the  "Solution  Definition  Tree"  of  the 
MuPPET  LCC  model.  Exhibit  5  illustrates 
this  mission  element  structure.  The  third 
level  elements  on  the  tree  form  the  solu¬ 
tion  element  axis  of  the  three-dimensional 
estimating  matrix  discussed  in  the  previous 
section.  Note  that  these  mission  solution 
elements  formulated  during  phase  zero  are 
the  take-off  points  foT  formulating  de¬ 
tailed  aystem  concept  solution  alterna¬ 
tives  during  the  system  concept  phase. 
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Identify  the  relevant  life  cycle  cost 
issues  pertaining  to  the  general  mission 
requirement.  Order  these  issues  in  a 
cntegorinl  structure  to  form  the  "LCC 
Relevance  Tree"  of  the  MuPPET  model. 

Exhibit  6  illustrates  this  tree  decomposed 
to  the  third  relevance  level.  These  LCC 
issues  can  be  further  decomposed  through 
successively  deeper  relevance  levels,  and 
would  be  for  a  detailed  analysis  of  a  can¬ 
didate  system  design.  For  preliminary 
high  level  decisions  such  as  "Milestone  0", 
however,  two  or  three  levels  of  decomposi¬ 
tion  will  usually  suffice.  For  our 
example,  the  third  level  issues  shown  in 
Evhjhit-  fi  form  the  relevant  issue  axis  of 
the  ncdei *s  three-dimensional  estimating 
matrix. 
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elements  on  the  LCC  issues  are  estimated 
in  terras  of  these  constituent  variables. 
Total  life  cycle  cost  for  acquiring  and 
maintaining  the  required  mission  capability 
is  then  predicted  by  evaluating  the  LCC 
objective  function  using  the  aggregated 
Impacted  values  of  these  constituent  vari¬ 
ables.  As  with  solution  definition  and 
relevant  issue  identification,  the  basic 
objective  function  variable  set  can  be 
decomposed  to  lower  levels  of  sub-variables 
as  the  need  arises  for  more  finely  detailed 
evaluations  of  candidate  system  designs 
during  later  program  phases. 
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Exhibit  7 


Code  the  3-dlmenslonal  estimating  matrix 
representing  the  elements  of  the  required 
mis 8 ion  (from  1),  the  relevant  LCC  issues 
(from  2)  and  the  LCC  evaluation  criteria 
(from  3)  into  the  existing  computerized 
matrix  structure  of  the  general  MuPPET 
model.  Tills  matrix,  along  with  the  pre¬ 
programed  data  processing  packages  of  the 
model,  constitute  the  basic  computerized 
MuPPET- model  to  be  used  to  evaluate  life 
cycle  cost  of  the  example  mission  capa¬ 
bility.  Exhibit  8  illustrates  the  example 
matrix. 


(3)  Develop  an  LCC  objective  function  pertain¬ 
ing  to  the  general  mission  requirement. 
Villa  objective  function  defines  the  deci- 
gliui  variable  uf  interest  (life  cycle  cost) 
Ip  terns  at  a  set  of  constituent  variables 
and  their  mathematical  relationships. 
P.xhiblt  7  Illustrates  the  development  of 
the  LCC  objective  function  for  our  example. 
The  constituent  variables  of  this  equation 
are  the  control  criteria  of  the  MuPPET 
model  and  as  such  form  the  third  axis  of 
the  three-dimensional  estimating  matrix* 

Aa  portrayed  In  Exhibit  3  of  the  previous 
ncctinn,  the  Impacts  of  the  solution 
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EXAMPLE  MODEL  MATRIX 

Exhibit  8 


.  -A*?,  s 


r-nti^i-  «i 


i 


Note  that  as  the  program  progresses  into 
the  system  concept  phase  and  alternate 
mission  system  candidates  are  defined  and 
evaluated  In  the  model,  only  the  solution 
definition  axis  of  the  basic  estimating 
matrix  changes  from  concept  to  concept. 

The  relevant  ICC  issues  an.!  objective  func¬ 
tion  variables  are  generic  in  nature  and 
are  Independent  of  the  alternate  systems' 
characteristics.  The  LCC  issues  and  objec¬ 
tive  function  variables  may,  however,  be 
decomposed  to  lower  levels  of  detail  as 
the  need  for  more  accurate  estimates  arises. 
This  increasing  accuracy  is  achieved  by 
decomposing  the  required  higher  level 
Impact  decisions  into  many  small  lower 
level  decisions  so  that  the  focus  of  each 
Individual  decision  is  narrowed  relative 
to  the  decision  data  base  available.  Also, 
a  decision  error  at  a  lov  elemental  level 
will  inject  less  error  into  the  overall 
estimate  than  an  error  at  a  more  highly 
aggregated  decision  level. 

(5)  Develop  baseline  LCC  values  for  each  cell 
of  the  matrix  and  load  Into  the  model. 

The  baseline  values  for  our  example  would 
be  derived  from  known  data  on  existing 
mission  capability  elements  which  are 
similar  to  or  can  be  correlated  with  the 
required  mission  capabilities. 

(6)  Develop  appropriate  relative  weightings  for 
each  criterion/issue  combination  and  load 
Into  the  model.  These  weight  values  are 
derived  through  a  highly  structured  process 
within  the  MuPPET  methodology  and  portray 
the  strength  of  the  relationships  between 
Individual  LCC  criterion  and  decision  Issues. 

(7)  Estimate  the  Incremental  LCC  Impact  of  each 
matrix  cell  by  estimating  the  departure 
from  Its  baseline  value  caused  by  the  likely 
characteristics  of  the  solution  element 
under  consideration.  These  Incremental 
Impacts  are  quantified  and  loaded  into  the 
model  through  a  formal  estimating  and 
normalizing  process  within  the  MuPPET 
methodology  to  assure  consistency  and 
traceability  of  Inputs. 

(8)  Exercise  the  model  to  obtain  an  aggregate 
output  estimate  of  the  likely  life  cycle 
cost  consequences  of  acquiring  and  maintain¬ 
ing  the  capability  to  "Neutralize  Hostile 
Action  In  the  Near  Space  Environment". 

The  foregoing  eight-step  procedure  illustrates 
the  end-to-end  process  that  would  be  required 
to  apply  the  MuPPET  methodology  for  life  cycle 
cost  assessment  of  our  example  mission  need  In 
preparation  for  a  "Milestone  0"  decision.  The 
seme  basic  process  could  be  utilized  to  provide 
estimates  for  other  decision  variables  requlrsd 
by  this  milestone. 


SUMMARY  AND  RECOMMENDATIONS 


The  foregoing  discussion  of  the  development 
and  suggested  application  of  the  MuPPET  process 
is  Intended  to  give  the  reader  a  preliminary 
tn<  ri'diH't  Inn  the  potential  and  general 
structure  of  the  methodology.  An  iu-duptli 
treatment  of  the  heuristic,  mathematical  and 
computer  processes  involved  is  not  within  the 
scope  of  this  paper  and  has  been  avoided. 
Interested  readers  who  would  like  to  investi¬ 
gate  our  technique  in  greater  depth  are  encour¬ 
aged  to  obtain  the  documents  listed  In  refer¬ 
ences  3  through  6  or  contact  the  authora. 

We  believe  that  the  tool  can  be  a  useful  aid 
in  establishing  the  likely  magnitudes  of 
various  decision  variables  and  in  performing 
trade-offs  during  phase  zero  activity.  How¬ 
ever,  to  establish  the  usefulness  and  accuracy 
of  the  tool  In  a  non-experlmental  situation. 

It  Is  recommended  that  the  model  be  tested  and 
validated  by  application  to  some  existing 
"evolutionary"  procurement  vhere  its  results 
may  be  compared  to  conventional  cost/effect- 
lvenees  tracking  tools  already  In  use. 
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A  MULTI-STAGE  ANALYSIS  OF  DESIGN-TO-COST 

Paul  R.  Kleindorfer 
University  of  Pennsylvania 

l 
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ABSTRACT  stage.  Under  simplifying  assumptions  on  the 

nature  of  the  random  elements  and  the  structure 
of 'follow-on  rewards,  the  Nash  point  to  this 
An  important  motivation  for  implementing  flnan-  game  can  be  determined  and  questions  of  the 
cial  incentives  in  systems  acquisition  is  the  type  raised  above  can  be  examined.  Some 

growing  cost  of  major  systems  and  the  ongoing  illustrative  mmerical  results  are  given  and 

and  anticipated  decline  of  real  dollars  avail-  a  discussion  of  empirical  data  further  clarifies 

able  for  design,  development,  and  production  of  the  possibilities  of  the  framework  presented, 
these  systems.  The  purpose  of  this  research  is 
to  examine  the  optimal  structuring  of  internal  |  ! 

financial  incenti.->s,  such  as  Design-to-Cost, 
as  a  vehicle  for  cost  control;  A  review  of  the 
theoretical  literature  on  incentives  and  deci¬ 
sion  processes  underlying  this  issue  reveals 
the  somewhat  surprising  result  that  only  very 
simple  two-level,  static  analyses  of  contractual 
and  internal  incentives  have  been  undertaken  to 
date.  This  paper  generalizes  previous  research 
and  develops  a  theoretical  framework  for  provid¬ 
ing  insights  into  the  following  (as  yet  rather 
incompletely  addressed)  issues: 

a.  How  long  should  competitive  parallel  <  i 

development  (if  it  is  used  at  all)  proceed  '  ! 

before  awarding  a  single-source  contract  for  I 

further  development  and  production? 

b.  What  are  the  effects  of  perceived  multi¬ 
stage  rewards  (e.g.,  follow-on  contracts)  on 
contractor  behavior,  on  DOD  and  responsible 
Service  behavior? 

c.  What  are  the  effects  of  a  multi-level 
determination  of  contract  parameters?  (For 
example,  in  Design-to-Cost,  the  overall  project 
budget  is  negotiated  with  Congress,  performance 
levels  are  set  by  DOO-Service,  and  cost  alloca¬ 
tion  and  contract  coordination  is  the  responsibil¬ 
ity  of  a  Project  Management  Staff). 

d.  How  do  risk  and  contingent  contract  re¬ 
negotiation  enter  in  an  optimal  contract  design? 

Basically,  the  framework  developed  envisages  .  t 

development  and  a  producti  stage  to  the  system 
life  cycle,  where  it  is  assied  that  development  i 

contracts  are  cost-plus  and  production  contracts 
are  (negotiated)  general  incentive  contracts.  A 
number,  say  "n,"  of  contractors  is  assumed  to 
take  part  in  parallel  development  activities,  ; 

the  outcome  of  which  is  a  prototype  system  having  ■ 

certain  performance  characteristics  which  depend 
(stochastically)  on  the  effort  expended  by  con¬ 
tractors  during  the  development  stage.  The  firm 
with  the  best  design  is  then  allowed  to  bid  on  a 
production  contract,  which  is  assuned  negotiated 
(as  a  Pareto  point  depending  on  relative  govem- 
ment/contractor  bargaining  power)  as  a  general 
incentives  contract.  The  ”n"  preselected  firms 
are  assumed  to  play  a  multi-stage  game  in  deter¬ 
mining  their  level  of  effort  in  the  development 
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A  STRATEGY  FOR  STIMULATING  ENERGY  CONSERVATION  BY  DEFENSE  CONTRACTORS 


Charles  H.  Alford,  Major  Uilliam  C.  Rosenthal,  Captain  James  Nation 
Headquarters  Aeronautical  Systems  Division  (ASD) 

Air  Force  Systems  Command  (AFSC) 

Hright-Patterson  Air  Force  Base,  Ohio  45433 


BACKGROUND  ENERGY  CONSERVATION  IN  AIR  FORCE- OWNED  PLANTS 


The  energy  Issue  has  become  "energized"  by  num¬ 
erous  individuals  and  agencies  within  the  fed¬ 
eral  bureaucracy---to  the  extent  that  every 
manager  at  every  level,  in  and  out  of  the 
government,  is  under  pressure  to  make  a  program 
out  of  energy.  This  is  in  some  ways  unfortu¬ 
nate,  because  it  can  screen  some  important 
realities  which  are  necessary  to  deal  effect¬ 
ively  with  the  problem,  without  an  excessive 
amount  of  wasted  effort.  The  approach  outlined 
in  this  paper  was  based  on  the  premise  that 
"energy"  is  a  factor  of  production  and  an  eco¬ 
nomic  good.  As  an  economic  good,  it  is  rela¬ 
tively  scarce  and  relatively  costly.  The  prob¬ 
lem  that  we  are  dealing  with  is  that  the  cost 
is  increasing  significantly.  Shortages  may  de¬ 
velop  in  the  near  future  due  to  lack  of  elec- 
trir’l  generating  capacity  or  in  the  longer 
term  due  to  source  energy  depletion,  but  this 
is  really  beyond  the  horizon  of  the  defense 
contract  manager  and  beyond  his  control .  Con¬ 
tingency  planning  is  about  the  only  effective 
response  that  can  be  made. 

More  could  be  said,  but  the  premise  that  the 
rising  cost  of  energy  is  the  major  problem  in 
defense  procurement  can  be  held  evident.  Re¬ 
lated  to  this  premise  is  the  contention  that 
the  best  way  to  deal  with  the  problem  is  to 
rely  on  the  organization  and  talent  that  al¬ 
ready  deals  with  the  problem  of  escalating  costs 
of  factor  Inputs  used  by  a  given  enterprise. 

If  an  enterprise  conserves  energy,  it  saves 
money.  But,  if  energy  conservation  efforts  are 
in  themselves  too  costly,  the  only  benefit  is 
to  delay  for  a  brief  time  the  day  sometime  in 
the  future  when  the  necessary  energy  supply 
runs  out.  However,  instead  of  dealing  with 
energy  conservation  in  terms  of  generalities, 
the  approach  in  this  paper  is,  in  the  first 
part,  to  relate  experiences  of  the  authors  in 
developing  an  energy  conservation  initiative 
for  Air  Force  industrial  plants.  The  next  part 
describes  the  specific  techniques  developed  to 
analyze  building  energy  use  and  Identify  speci¬ 
fic  conservation  opportunities.  Next,  the  case 
for  use  of  computer  simulation  tools  for  build¬ 
ing  energy  analysis  is  presented.  The  conclud¬ 
ing  part  draws  on  the  authors'  experience  to 
date  and  proposes  a  strategy  for  fostering 
energy  conservation  among  defense  contractors. 


In  November  1976,  officials  in  the  Directorate 
of  Manufacturing  at  ASD  approved  an  initiative 
to  promote  energy  conservation  at  the  23govern- 
ment-owned/contractor-operated  (GOCO)  indus¬ 
trial  plants  managed  by  the  Directorate. 

The  primary  motivation  for  this  initiative  was 
experience  with  the  emergence  of  the  environ¬ 
mental  protection  program  about  3*s  years  earlier. 
The  initiative  was  attended  by  resolve  to  anti¬ 
cipate  or  at  least  keep  up  with  the  shower  of 
directives  that  seemed  inevitable,  instead  of 
reacting  to  events  and  decisions  attended  by 
compressed  time  schedules.  Subsequent  events 
have  demonstrated  the  prudence  of  the  decision 
to  get  prepared  early.  It  has  been  said  that 
the  technical  basis  for  decision-making  must 
come  from  the  level  of  an  organization  where 
the  knowledge  resides.  One  might  add  that  it 
usually  takes  more  time  for  the  knowledgeable 
people  to  obtain  and  organize  technical  data 
than  is  allotted  for  decision-making.  The  mes¬ 
sage  for  organizations  with  technical  responsi¬ 
bilities  is— anticipate  decisions  that  will 
have  to  be  made  and  invest  time  and  talent  to 
get  ready  to  support  that  decision-making. 

The  ASD  initiative  for  GOCO  plants  preceded  the 
issuance  of  Executive  Order  12003  (20  July  1977) 
by  several  months.  By  this  time,  an  organized 
effort  was  already  well  underway  for  the  Air 
Force  GOCO  industrial  plants.  Probably  because 
the  effort  was  able  to  unfold  without  external 
pressures  or  arbitrary  constraints,  all  of  the 
Issues  in  the  Executive  Order  (EO)  were  ad¬ 
dressed  and  specific  strategies  for  dealing 
with  these  issues  were  becoming  well  developed. 
The  real  payoff,  however,  was  the  leverage  that 
was  available  in  obtaining  the  resources  and 
management  and  industry  support  needed  to  sus¬ 
tain  the  effort. 

The  policy  basis  for  the  energy  conservation 
effort  for  the  GOCO  Industrial  plants  is  the 
above-mentioned  EO  12003.  The  Order  lays  out 
the  blueprint  for  energy  conservation  within 
the  federal  government.  The  mandate  in  the 
Order  impacts  two  areas:  (1)  fuel  economy  of 
motor  vehicle  fleets  and  (2)  energy  conservation 
in  federally-owned  or  leased  buildings.  Of 
course,  it  is  the  federal  building  directives, 
which  bear  on  GOCO  Industrial  plant  management. 
The  Order  requires,  as  part  of  a  ten-year  pro¬ 
gram,  an  energy  survey  of  all  federally-owned 
or  leased  buildings  of  5,000  square  feet  or  over. 
The  purpose  of  this  survey  and  subsequent  analy- 


sis  is  to  identify  cost  effective  measures,  in¬ 
cluding  capital  investment,  to  reduce  1975  en¬ 
ergy  consumption  in  office  buildings,  commer¬ 
cial  buildings,  and  warehouses  by  20%  by  1985. 
Although  the  202  goal  does  not  apply  to  all  in¬ 
dustrial  type  buildings,  conservation  is 
essential . 

The  23  Air  Force  GOCO  industrial  plants,  oper¬ 
ated  by  28  contractors,  support  a  variety  of 
manufacturing  operations  such  as,  aircraft, 
engines,  missiles,  electronics,  forgings  and 
extrusions,  and  various  system  components. 
Production  at  these  plants  is  not  limited  to 
Air  Farce  hardware.  Output  is  also  delivered 
to  Army,  Wavy,  DSA,  and  NASA  customers  or  their 
subcontractors.  Some  civilian  production  is 
also  permitted;  especially  in  the  area  of  pro¬ 
duction  of  aircraft  quality  forgings.  The  com¬ 
plex  of  GOCO  plants  consists  of  about  850 
buildings,  309  of  which  are  over  5,000  square 
feet  in  area.  Industrial -covered  floor  space 
amounts  to  about  32,000,000  square  feet.  Half 
of  this  plant  area  was  constructed  prior  to 
1946;  ninety  percent  was  constructed  prior  to 
1961. 

The  contractual  arrangements  governing  the  GOCO 
plants  are  of  significant  interest.  The  basic 
con-ractual  vehicle  is  the  facilities  contract. 
The  facilities  contract  establishes  terms  for 
use  of  the  facilities,  protection  of  the  facili¬ 
ties,  and  upkeep  of  the  facilities.  However, 
the  oniy  work  paid  for  under  the  facilities 
contract  is  work  involving  capital  improvements 
(such  as  expansion,  modernization,  or  capital 
type  rehaoil itation) .  The  contractor  writes 
the  checks  for  recurring  maintenance,  plant 
protection,  and  for  utilities  and  other  energy 
supplies.  Ihese  expense  items  become  elements 
of  overhead  which  are  allocated  to  all  con¬ 
tracts  in  the  plant  as  overhead.  It  is  clear, 
however,  that  whoever  makes  these  payments,  the 
customer  ultimately  pays  for  all  costs  of  manu¬ 
facturing  and  facilities  operations  when  deal¬ 
ing  with  any  going  concern.  Under  the  existing 
arrangements,  especially  where  the  government 
is  the  only  customer,  this  can  lead  to  circum¬ 
stances  that  make  the  need  for  energy  conserva¬ 
tion  in  defense  procurement  even  more  urgent. 
This  makes  reference  t  ne  fact  that  defense 
contractors'  costs  for  nergy  are  part  of  over¬ 
head.  This  means  that,  when  the  accounts  are 
all  settled  and  all  bills  are  paid,  the  cus¬ 
tomer  has  not  only  paid  the  acquisition  cost  of 
energy,  but  also  an  increment  of  profit  and 
corporate  general  and  administrative  expense. 
This,  of  course,  sweetens  the  pot  if  savings  in 
energy  costs  are  experienced.  It  also  adds  to 
the  penalty  if  the  challenge  of  energy  conser¬ 
vation  is  not  met. 

The  situation  at  the  outset  of  the  ASD  energy 
conservation  effort  found  the  GOCO  contractors 
nvikir.g  varying  amounts  of  progress  in  energy 
conservation.  Committees  had  been  established 
and  employee  programs  were  fairly  well  struc¬ 
tured-  The  so-called  wasto-not-want-not  mea¬ 


sures  had  been  undertaken.  A  few  plants  had 
installed  equipment  to  control  peak  electrical 
demand  to  keep  utility  demand  charges  down. 
There  was  little  evidence,  however,  of  any  ex¬ 
tensive  engineering  effort  to  identify  conser¬ 
vation  opportunities  in  any  rigorous  way. 
Building  retrofit  projects,  involving  capital 
investment,  were  seldom  identified.  Moreover, 
since  capital  investments  required  Air  Force 
funding  (which  was  not  available),  the  lack  of 
funding  action  discouraged  subsequent  proposal 
effort.  It  might  also  be  noted  that  projects 
that  were  submitted  were  often  based  on  impli¬ 
cit  ji'dqments  rather  than  comprehensive  en¬ 
gineering  analysis.  This  was  the  trend  that 
needed  to  be  reversed  to  respond  to  the  goals 
of  E0  12003. 

In  developing  an  energy  conservation  program 
for  the  GOCO  plants,  there  were  three  approach¬ 
es  considered.  One  alternative  was  to  out  to- 
nether  a  team  of  Qualified  specialists  to  make 
enerov  audits  for  all  the  GOCO  Dlar.ts  and 
identify  conservation  ooDortunities  for  con¬ 
tractor  action  and  Air  Force  fundinn.  This 
aoproach  showed  little  cromise  because  the  ex- 
oerts  needed  were  simolv  not  available.  If 
they  were,  it  seemed  clear  thet  they  would 
have  to  go  into  each  plant  t  relatively  few 
times,  obtain  necessary  data  by  “brute  force", 
then  develop  a  terminal  report  or  recommenda¬ 
tion.  There  appeared  To  be  no  prospect  of 
substantial,  continuing  energy  management  un¬ 
der  this  alternative. 

A  second  alternative  would  involve  retaining 
qualified  architect  engineering  firms  on  a 
consulting  basis  to  do  the  same  task.  This 
was  the  basic  approach  used  by  ASD  in  response 
to  environmental  regulation  impacting  the  GOCO 
plants.  Based  on  information  provided  by  the 
Department  of  Energy  (DOE)  sources,  energy 
surveys  by  consultants  would  be  expensive 
(154  to  254  per  square  foot).  Under  this  ap¬ 
proach  obtaining  funds  for  surveys  appeared  to 
be  a  difficult  proposition  and  much  time  would 
be  lost.  The  limitations  of  the  first  alter¬ 
native  were  also  evident. 

The  third  approach  recognized  that  the  basic 
information  about  a  facility  and  the  way  en¬ 
ergy  was  used  in  that  facilicy  would  come  from 
the  operating  contractor.  The  concept  was 
then  developed  of  inducing  the  operating  con¬ 
tractor  to  analyze  the  plant  and  its  operations 
ar.d  identify  energy  conservation  opportunities 
for  his  own  implementation  and  for  Air  Force 
capital  investment.  Expertise  not  available 
within  the  operating  contractor’s  staff  would 
be  retained  only  as  a  last  resort,  and  when¬ 
ever  possible,  in  connection  with  the  design 
of  specific  retrofit  projects  subsequent  to 
apprcyal  of  the  project  for  imple-wntation  via 
the  facilities  contract.  It  was  recognized 
under  this  approach  that  the  skillful  use  of 
talents  of  OoD  and  contractor  personnel  al¬ 
ready  on  the  job  in  facilities  management, 
p'ant  engineering,  financial  management,  and 
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other  areas,  could  result  In  a  pool  of  knowledge 
and  expertise  that  could  support  energy  manage¬ 
ment  on  a  continuing  basis.  The  major  task 
then  became  one  of  convincing  the  plant  opera¬ 
tor's  to  play  the  game  after  ASUhad  come  up  with 
a  game  plan  that  would  work.  Getting  the  plant 
operator  to  play  the  game  involved  three  fac¬ 
tors:  (1)  developing  a  feasible  program  stra¬ 
tegy,  (2)  developing  confidence  In  the  ability 
of  the  Air  Force  team  to  do  Its  part,  and  (3) 
establishing  credible  prospects  of  adequate 
funding.  The  job  of  getting  funds  support  In¬ 
volved  demonstrating  to  Air  Force  headquarters 
that  a  feasible  program  strategy  was  in  hand 
and  that  ASO  was  able  to  support  a  meaningful 
program.  It  is  not  the  purpose  of  this  paper 
to  retrace  the  steps  to  the  present  posture. 

The  present  posture  Is  that  ASO  has  been  pro¬ 
vided  FY  1978  funding  and  a  commitment  for  FY 
1979  funding  when  plans  anticipated  a  program 
for  FY  1980.  Also,  the  GOCO  plant  operators 
are  cooperating  In  the  program  as  herein  des¬ 
cribed.  The  purpose  of  this  paper  Is  to  Inform 
the  defense  community  about  the  feasible  pro¬ 
gram  strategy  that  has  been  adopted  for  the 
GOCO  plants  and  to  suggest  some  useful  applica¬ 
tions  of  the  strategy  to  defense  procurement  In 
general  . 


ASD  BUILDING  ENERGY  ANALYSIS  TECHNIQUES 


The  following  steps  comprise  the  ASD  approach 
to  identifying  energy  convervation opportunities 
(ECOs):  (1)  set  priorities  for  analysis  effort, 
(2)  define  the  way  energy  is  currently  being 
used-in  selected  buildings,  (3)  Identify  candi¬ 
date  ECOs,  (4)  analyze  Impact  of  each  ECO  on 
building  energy  use,  recognizing  priority  of 
retrofit  actions,  (5)  perform  an  economic 
analysis  of  candidate  ECOs,  and  (6)  implement 
LCO  program.  The  following  commentary  on  each 
of  these  steps  should  be  helpful. 


SETTING  PRIORITIES  FOR  ENERGY  ANALYSIS 


How  does  one  Identify  plants  and  buildings  which 
represent  the  best  opportunities?  The  ASD  team 
reviewed  numerous  schemes  for  establishing  en¬ 
ergy  conservation  programs  and  found  a  common 
thread  running  throughout  all  of  them.  In  each 
program,  a  facility  survey  of  some  kind  Is  made 
to  see  how  and  where  and  how  much  energy  Is  be¬ 
ing  used.  Opportunity  analysis  Is  then  per¬ 
formed,  focused  on  the  most  energy  Intensive 
areas.  Finally,  there  Is  an  economic  analysis 
to  set  priorities.  The  ASO  Initial  facility 
site  survey  and  building  selection  procedures 
are  based  on  the  methods  outlined  In  the  Depart¬ 
ment  of  Energy  Site  Energy  Handbook  (ERDA  76/ 
131)  and  8u11d1ng  Energy  Handbook  (ERDA  76/163). 
This  basis  was  selected  for  the  following  rea¬ 
sons:  A"\)  the  procedures  acknowledge  that  the 
Information  base  for  analysis  can  best  be  pro¬ 
vided  by  the  operator  of  a  facility,  not  by  a 


consultant,  (2)  the  procedures  In  the  Handbooks 
are  flexible  enough  to  dovetail  with  on-going 
contractor  energy  conservation  programs,  (’0 
the  opportunity  listings  In  the  Handbooks  are 
very  comprehensive  and  are  excellent  Idea  gen¬ 
erators,  (4)  forms  for  documenting  facility 
energy  data  In  an  organized  manner  are  furn¬ 
ished.  This  eliminates  a  very  large  adminis¬ 
trative  burden  on  the  plant  operator's  engin¬ 
eering  staff. 

Using  the  above  technique,  the  survey  of  energy 
consumption  at  each  plant  site  and  the  selec¬ 
tion  of  buildings  for  detailed  analysis  has 
presented  little  difficulty.  The  only  problem 
has  been  with  facilities  that  are  only  partly 
government-owned  and  separate  utility  metering 
is  not  provided.  Building  selection  on  the 
basis  of  square  footage  (5,000  square  feet  or 
over)  Is  the  logical  approach  in  most  plants. 
Exceptions  noted  involve  (1)  situations  where 
a  number  of  very  similar  buildings  Involve  a 
significant  combined  energy  use  and  (2)  one  or 
two  plants  where  energy  use  In  buildings  Is 
secondary  to  overall  site  energy  use.  In  these 
instances,  primary  reliance  will  be  on  the 
Site  Energy  Handbook  approach. 


DEFINING  CURRENT  BUILDING  ENERGY  USE 


The  Initial  premise  of  the  ASD  team  was  that 
it  Is  absolutely  essential  to  define  the  base¬ 
line  energy  use  conditions  in  a  selected  build¬ 
ing  before  the  effects  of  introducing  an  ECO 
in  the  building  can  be  accurately  computed. 

The  DOE  Building  Energy  Handbook  recognized 
this  fact  and  provided  the  forms  and  computa¬ 
tional  guidance  necessary  to  do  the  job.  In 
the  words  of  one  plant  operator,  "It's  all  in 
there."  However,  Increasing  familiarity  with 
the  amount  of  effort  Involved  led  to  increas¬ 
ing  doubts  that  plant  operators  could  afford 
to  devote  the  amount  of  engineering  time  needed 
to  perform  the  "number-crunching"  involved  in 
analyzing  the  baseline  condition  and  evaluat¬ 
ing  ECO  alternatives  using  manual  desktop 
methods.  It  was  obvious  that  a  powerful  tool 
was  needed.  The  need  to  use  the  computer  was  t 
evident  and  a  computer  program  was  needed  that 
could  define  the  baseline  energy  condition, 
test  energy  and  cost  Implications  of  alterna¬ 
tive  ECOs,  and  preserve  the  baseline  data  for 
future  use. 

A  program  was  found  to  suit  this  purpose — The 
Building  Loads  and  System  Thermodynamics  Pro¬ 
gram  (acronym  BLAST).  The  program  was  devel¬ 
oped  by  the  U.S.  Army  Construction  Engineering 
Research  Laboratory  (CERL)  In  response  to  a 
requirement  from  the  Air  Force  Civil  Engineer¬ 
ing  Center.  When  It  became  evident  that  this 
tool  would  do  the  job,  the  concept  of  using 
the  Building  Energy  Handbook  to  define  the  en¬ 
ergy  baseline  was  abandoned.  The  handbook 
will  now  be  used  to  help  the  plant  operator 
document  building  Information  needed  for  the 
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detailed  analysis  (Building  Questionnaire, 
Building  Energy  Handbook,  (Vol  II,  Chap  2,  Form 
2-2).  Armed  with  this  analysis  the  operator 
will  use  the  ECO  checklist  (Building  Energy 
Handbook,  Vol  II,  Chap  2,  Form  2-3)  to  identify 
potential  ECOs.  At  this  point,  instead  of  us¬ 
ing  the  manual  calculation  approaches  in  the 
handbook,  the  BLAST  computer  model  or  an  equiva¬ 
lent  model  is  employed.  The  BLAST  program  is 
currently  available  on  the  Control  Data  Corpor¬ 
ation  Cybernet  time  share  service  for  conmer- 
cial  or  GSA  contract  use.  The  program  has  been 
locally  evaluated  in  a  study  conducted  at  WPAFB 
and  found  to  be  very  effective.  The  GSA  appar¬ 
ently  shares  this  opinion  because  it  has  select¬ 
ed  tl.AST  for  use  in  energy  analysis  of  GSA 
buildings 

How  is  BLAST  used  to  define  the  way  energy  is 
used  in  a  building?  The  BLAST  program  esti¬ 
mates,  hour-by-hour  for  any  given  year,  the 
space  heating  and  cooling  requirements  of  a 
building,  performance  of  air  handling  systems, 
and  performance  of  central  heating  and  cooling 
plants.  This  estimate  is  based  on  extremely 
rigorous  and  detailed  algorithms  used  to  com¬ 
pute  building  thermodynamic  loads  and  system 
performance.  The  input  language  is  Englisli- 
like  rather  than  computer-like.  The  program 
contains  a  very  extensive  library  of  engineer¬ 
ing  standards  which  frees  the  user  from  the 
tedious  task  of  inputting  hundreds  of  numbers 
for  each  space  or  building.  In  layman's  terms, 
BLAST  is  used  to  create  an  "as  built"  model  of 
the  building  which  portrays  the  energy  use  pat¬ 
terns  of  a  building. 


IDENTIFYING  ECOs 


The  basic  process  of  identifying  ECOs  employs 
the  survey  checklist*  in  the  DOE  manuals,  .aug¬ 
mented  by  the  building  operator's  own  experi¬ 
ence  and  engineering  insight.  Opportunities, 
as  developed,  must  be  analyzed  in  terms  ofcapi- 
tal  cost,  operating  and  maintenance  (08M)  cost 
impact,  and  performance  characteristics.  The 
next  step  is  to  try  the  ECOs  out  against  the 
Basel ine  condition. 


ANALYZING  IHrdCT  OF  ECOs  ' 


Investigation  of  an  ECO,  after  simulating  the 
basic  building  energy  profile,  can  be  accomp¬ 
lished  by  making  a  simple  Input  data  change, 
then  running  the  BLAST  model  to  assess  the  ef¬ 
fect  of  the  change.  The  value  of  such  a  tool 
to  facility  engineering  management  cannot  be 
overstated  since  the  files  created  in  the  BLAST 
program  can  be  saved  on  disc  or  tape,.  This 
means  that  effort  expended  once,  If  kept  up  to 
date,  car  be  used  throughout  the  life  of  a 
building.  The  implications  of  having  this  en¬ 
gineering  tool  available  are  suggested  by  the 


\  s 


following  extract  from  the  ASD  BLAST  training 
material:"  (1)  You  want  to  add  a  partition 
from  floor  to  ceiling  in  a  building  zone.  A 
simple  input  change  to  the  already  constructed 
If  1 1  e c  can  tell  you  the  effect  of  that  partition 
on  your  energy  picture  in  the  building.  (2) 

You  want  to  investigate  a  potential  increase  or 
decrease  in  production  on  your  utility  bill. 
Maybe  you  would  like  to  add  a  shift.  Simply 
change  the  occupancy,  lighting  and  equipment 
schedules  for  your  already  constructed  build¬ 
ing  load  simulation  files  and  let  the  computer 
do  all  the  heavy  work.  (3)  You  want  to  inves¬ 
tigate  the  overall  effect  of  changing  the 
.throttling  range  of  your  plant's  thermostats. 
'This  is  a  simple  20  minute  exercise  if  the 
building  simulation  is  alieady  constructed. 

‘(4)  The  sensitivity  analysis  capabilities  of 
the  program  make  it  a  shoo-in  for  definition 
of  automated  Energy  Management  Control  Systems. 
You  can  Investigate  such  potential  benefits  as 
zone  lighting  control  or  air  handler  cycling 
before  laying  out  any  hard  cash  for  system  de¬ 
sign.  You  can  investigate  the  impact  of  equip¬ 
ment  maintenance  problems  and  determine  the 
benefits  of  central  monitoring  capability. 

(5)  Speaking  of  O&M,  the  engineer  who  prepares 
the  program  input  data  will  become  intimately 
fanuliar  with  the  operation  of  building  sys¬ 
tems.  The  Impact  of  seemingly  small  defici¬ 
encies  such  as  inoperative  or  partially  in¬ 
operative  outside  air  dampers  will  become 
readily  apparent  as  related  to  the  total  en¬ 
ergy  picture  for  a  building.  He  will  be  in  a 
position  to  recommend  O&M  procedures  that  cost 
little  or  nothing  to  Implement  but  have  tre¬ 
mendous  potential  for  energy  reduction." 


'  ECONOMIC  ANALYSIS  OF  ECOs 


The  economic  analysis  of  ECOs  is  performed  on 
a  life  cycle  costing  basis,  using  the  proced¬ 
ures  specified  in  the  DOE  Life  Cycle  Costing 
Emphasizing  Energy  Conservation  Handbook 
(ERDA  76/130).  The  calculations  required  by 
this  handbook  are  extensive,  necessitating 
more  computer  help.  A  computer  model  .LIFCY-2, 
has  been  obtained  from  the  DOE  to  support  the 
computation  effort.  LIFCY-2  provides  the  cap¬ 
ability  to  compare  economic  implications  of 
several  ECO  alternatives.  Sensitivity  analy¬ 
sis  can  also  be  easily  performed  to  assess  the 
effect  of  alternative  future  conditions  on  the 
life  cycle  cost  of  an  ECO. 


IMPLEMENTATION  OF  ECOs 


Limitations  on  this  paper  prevent  devoting  ex¬ 
tensive  discussion  to  the  implementation  of 
ECOs  determined  to  be  cost  effective.  The  an¬ 
alysis  provides  excellent  support  for  budget 
action,  as  the  ASD  experience  has  demonstrated 
Funds  appropriated  will  be  obligated  under  the 
applicable  facilities  contract.  The  informa- 
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“.ion  base  developed  during  the  analysis  phase 
ensures  an  audit  trail  which  will  be  used  by 
field  pricing  and  audit  personnel  to  ensure  that 
the  energy'cost  avoidance  does  accrue  to  the 
Air  Force  or  other  Government  customers  for  the 
life  of  the  ECO. 


A  STRATEGY  FOR  PROMOTING  ENERGY  CONSERVATION 


The  first  question  that  comes  to  mind  in  con¬ 
sidering  a  program  strategy  applicable  to  de¬ 
fense  contractors  in  general  is,  "Why  can't  it 
be  done  the  same  way  as  the  GOCO  plant  program? 
Everything  can  be  done,  in  fact  should  be  done, 
in  the  same  way  until  the  economic  analysis  is 
reached.  Here  is  where  the  difference  becomes 
evident.  In  the  GOCO  plant  program,  the  cus¬ 
tomer  is  making  an  investment  based  on  a  cost- 
benefit  analysis  of  customer  return  on  thecapiw 
tal  the  customer  provides.  The  operator  parti¬ 
cipates  to  the  extent  required  because  of  pros¬ 
pects  of  somewhat  improved  competitive  posture 
and  other  peripheral  benefits.  Now  if  the  con¬ 
tractor  owns  the  plant  to  be  retrofitted,  his 
decision  to  provide  the  capital  to  undertake 
energy  projects  is  based  on  economic  analysis, 
which  portrays  the  contractor's  return  on  in¬ 
vestment.  Benefits  to  the  contractor  in  this 
analysis  involve  consideration  of  two  key  ques¬ 
tions:  (1)  How  much  of  the  project  benefits 
will  the  contractor  enjoy  versus  benefits  accru¬ 
ing  to  the  customer.  (2)  Will  the  project  pro¬ 
vide  satisfactory  return  on  investment,  which 
now  considers  the  tax  implications?  It  can  be 
seen  that  the  Government,  as  customer,  also  can 
(and  should)  develop  an  economic  analysis  por¬ 
traying  the  customer  benefits  that  will  result 
from  the  contractor's  Investment  opportunity. 


developed.  Although  the  crux  of  the  issue  is 
the  incentive  for  investment,  a  task  that  is 
almost  as  challenging  is  the  job  of  getting  a 
contractor  to  institute  an  effective  program 
in  the  first  place.  One  alternative  would  be 
to  encourage  and  educate  contractors  to  under¬ 
take  energy  management  programs  on  a  voluntary 
basis.  This  approach  has  probably  done  some 
good,  but  if  contractors  fail  to  see  a  return 
from  their  efforts,  they  will  not  undertake  the 
kind  of  effort  that  is  needed.  By  the  same 
token,  if  the  Government  contract  manager  does 
not  have  accurate  technical  data  as  a  basis 
for  decision,  he  wjjl  be  reluctant  to  enter¬ 
tain  any  kind  of  Investment  incentives.  The 
alternative  is  to  make  an  energy  management 
plan  a  contractual  requirement  in  carefully 
selected  circumstances.  It  is  recognized  that 
the  OoD  has  resisted  suggestions  that  energy 
conservation  be  made  the  subject  matter  of 
contract  clauses.  This  position  has  beenwell-- 
advised  because  the  kinds  of  provisions  pro¬ 
posed  were  not  specific.  However,  if  the 
methods  advocated  by  this  paper  were  adopted, 
there  would  be  a  very  specific  deliverable  con¬ 
tract  item  involved  that  would  have  a  very 
specific  application.  There  is  no  panacea. 
Simplistic  approaches  can  lead  to  Impropri¬ 
eties  and  waste  of  resources.  However,  it  is 
reiterated  that  the  steps  that  lead  up  to  the 
crucial  investment  decision  are  critical .  The 
job  of  identifying  the  investment  opportunity 
and  surrounding  it  by  all  the  facts  necessary 
to  guarantee  the  projected  outcome  must  be 
done  right.  The  job  that  must  be  done  is  not 
a  management  effort.  It  is  not  an  accounting 
effort.  It  is  an  engineering  effort  with 
accountable  results  that  must  be  properly 
managed. 


If  this  comparative  analysis  is  done,  the  basis 
for  decision-making  becomes  clear.  If  the  in¬ 
vestment  is  attractive  to  the  contractor  and 
beneficial  to  the  customer,  the  contractor 
should  be  encouraged  to  make  the  necessary  in¬ 
vestment.  No  further  incentive  should  be  needed. 
If  the  Investment  is  attractive  to  the  contrac¬ 
tor  but  cost  benefit  to  the  customer  is  negli¬ 
gible,  encouragement  would  also  be  in  order,  but 
prim-rily  based  on  support  of  the  overall  Gov¬ 
ernment  interest  in  energy  conservation.  The 
crux  of  the  strategy  is  to  deal  with  those  op¬ 
portunities  that  Involve  substantial  cost  bene¬ 
fit  to  the  customer  but  a  share  to  the  contrac¬ 
tor  which  is  insufficient  to  justify  investment. 
There  is  no  way  of  estimating  what  percentage 
of  opportunities  would  involve  this  kind  of  dis¬ 
proportionate  prospect  of  return.  The  authors 
are  of  the  opinion  thai  the  patterns  of  forward 
overhead  pricing  and  incentive  contract  sharing 
in  defense  contracting  have  created  this  situ¬ 
ation  in  a  majority  of  cases.  7here  are  numer¬ 
ous  tactics  available  to  the  defense  contract 
manager  which  can  adjust  the  Incentives  Involved 
in  a  particular  contract  situation  to  obtain  the 
benefits  of  contractor  investments  to  reduce  en- 
'W  ergy  consumption.  New  tactics  may  have  to  be 
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A  SYSTEMS  ANALYSIS  PROCEDURE  FOR  EVALUATING  ENERGY  REDUCTION  ON  IPP  PROGRAMS 
Dr.  John  M.  Amos,  University  of  Missouri-Rolla 


INTRODUCTION 


The  Department  of  the  Air  Force  is  responsible 
for  the  maintenance  of  certain  industrial  cap¬ 
abilities  ossential  to  long-term  national 
defense  goals.  The  Industrial  Preparedness 
Planning  (IPP)  Program  is  established  for 
meeting  these  objectives  and  is  designed  to 
maintain  an  adequate  industrial  base  to  sup¬ 
port  DOD  requirements  for  selected  essential 
military  items  '.n  a  national  emergency,  in 
addition  to  the  maintenance  of  selected  indus¬ 
trial  segments  necessary  for  the  long-term 
national  defense. 

Modern  technology,  the  basis  for  much  recent 
economic  growth,  has  been  heavily  dependent  on 
energy,  especially  oil,  primarily  because  of 
its  historically  low  price.  Unfortunately, 

DOD  technology  has  also  followed  the  trend  of 
being  heavily  dependent  on  energy.  This  re¬ 
quires  society  to  allocate  a  greater  portion 
of  its  revenues  for  energy,  which  reduces  the 
government  tax  base,  making  it  difficult  to 
support  large  DOD  budgets.  In  turn,  DOD  has 
less  funds  for  development,  but  at  the  same 
time  increased  operating  costs  for  facilities 
because  of  increased  energy  prices. 

The  more  fundamental  immediate  problem  examined 
in  this  study  is  that  of  the  effects  various 
degrees  of  energy  reduction  will  have  on  sup¬ 
plies  and  equipment  obtained  from  industry  for 
various  Air  Force  weapons  systems.  Several 
specific  questions  occur,  such  ns  how  will  an 
energy  crisis  affect  production  in  IPP  plants 
in  a  particular  region,  what  are  the  critical 
processes  and  where  located,  and  what  is  the 
ability  of  IPP  plants  to  respond  to  commitmsnts 
during  an  emergency.  This  study  is  directed 
towards  responding  to  these  and  similar  ques¬ 
tions  . 


MET!'  .JLOGY 


The  Energy  System  Analysis  Procedure  (ESAP)  is 
general  in  nature  and  represents  a  broad  indus¬ 
trial  base.  Because  the  immediate  objective 
was  an  examination  of  possible  effects  or  un¬ 
stable  behavior  arising  from  the  energy  short¬ 
age0,  pertinent  factors  relating  to  energy  wort 
included  in  the  procedural  formulation.  Many 
principal  organizational  relationships  and  man¬ 
agement  policies  might  have  been  interesting, 
but  could  not  be  included.  However,  the  crit¬ 
ical  importance  of  the  structure  is  the  con¬ 
tributing  causes  to  the  principal  activities, 
delays,  etc.,  which  wore  included  resulting 
from  'lit*  fl own  of  energy  through  the  system. 


These  factors  included  in  the  system  affect 
the  generation  of  production,  shipments, 
energy,  etc. 

The  ESAP  approach  follows  the  same  steps  that 
are- common  to  other  design  techniques.  The 
goals  are  defined,  the  significant  factors 
identified,  procedure  system  constructed  and 
tested,  and  the  results  analyzed  and  inter¬ 
preted.  The  procedure  is  designed  around  a 
goal  requiring  a  visualized  description  of  the 
interrelated  parts  of  the  system.  These 
verbal  statements  are  translated  into  mathe¬ 
matical  notations  which  contain  the  mechanisms 
of  interaction  that  have  been  visualized  be¬ 
tween  the  various  parts  of  the  system. 

A  system  of  equations  was  developed  in  the  con¬ 
text  of  certain  conventions  that  state  how  the 
equations  are  to  be  evaluated.  These  equations 
control  the  changing  interactions  of  a  set  of 
variables  as  time  advances  and  are  computed 
periodically  to  provide  successive  new  states 
of  the  system. 

The  continuous  advance  of  time  is  broken  into 
monthly  intervals.  Changes  made  at  the  begin¬ 
ning  of  the  interval  (menth)  are  not  affected 
by  any  changes  that  occur  during  the  interval . 
At  the  end  of  the  interval,  new  values  of 
levels  are  calculated  and  from  these,  new  rates 
are  determined  for  the  next  interval . 

For  the  purpose  of  evaluation,  the  basic  equa¬ 
tions  are  'separated  into  flow  equations  and 
quantitative  equations .  For  each  time  step, 
the  quantitative  equations  are  evaluated 
first,  and  the  results  become  available  for 
use  in  the  flow  equations. 

Dolay  equations  introduced  a  time  lag,  a  con¬ 
version  process  that  accepts  a  given  inflow 
and  delivers  a  resulting  flow  of  output.  Many 
delays  are  short  and  their  effect  is  negligible 
compared  with  longer  delays. 

During  the  process,  the  relative  importance  of 
various  factors  is  determined.  Data  is  ob¬ 
tained  relative  to  changes  in  value  within  a 
range  of  present  operations;  obtaining  data  or 
refining  for  operations  outside  the  range  yould 
be  unjustified  as  these  operations  generally 
are  unprofitable. 

Even  though’  a  great  degree  of  aggregation 
occurs,  energy  types,  supplies,  products,  cus¬ 
tomers  and  production  arc  segregated  in  the 
procedure.  Only  those  items  are  aggregated 
that  have  similar  characteristics  either  in 
decisions  or  time  response,  functions,  etc., 
which  prosorve  the  important  nonlinearities  of 
the  system.  Aggregation  was  based  largely  by 
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examining  these  factors.  Individual  activities 
>.id  sequences  are  formulated  in  the  procedure; 
therefore,  flow  diagrams  were  developed  for  the 
sequence  of  individual  actions.  This  involved 
ciths  of  events,  formations,  delays,  backlogs, 
shipments,  and  production.  Through  this  meth¬ 
od,  the  establishment  of  aggregation  of  sep¬ 
arate  items  is  possible. 

Activity  in  the  procedure  consists  of  interact¬ 
ing  flow  networks  of  energy,  production,  and 
flow  of  materials.  The  materials  flow  is  con¬ 
trolled  by  many  interacting  relationships  rep¬ 
resenting  information  based  on  inventories, 
sales,  and  production.  Therefore,  those  parts 
are  included  that  directly  relate  to  energy. 

The  omission  of  other  variables  from  the  deci¬ 
sions  is  not  unrealistic,  because  these  influ¬ 
ences  on  decisions  seldom  take  precedence  for 
long  if  they  run  contrary  to  actual  energy 
resource  conditions.  The  procedure  has  been 
developed  to  interpret  the  response  of  the 
system.  Thus,  concentration  is  on  the  main 
channel  of  material  flow  (which  includes  ener¬ 
gy)  from  production  plant  to  customer  and  DOD, 
and  on  the  streams  of  information  flow  moving 
through  the  systems.  The  system  is  concerned 
with  four  major  types  of  energy — natural  gas, 
coal,  oil,  and  electricity;  therefore,  the  dia¬ 
gram  involves  a  similar  diagram  for  each  energy 
source.  This  defines  in  a  general  way  the 
problem  facing  industry  when  energy  supplies 
are  reduced. 

The  tracing  of  specific  time  makes  possible 
the  generation  of  specific  time  history  of  the 
behavior  that  would  result  if  the  system  (as 
described)  had  actually  occurred.  It  takes  the 
place  of  the  real  system  and  simulates  opera¬ 
tions  under  realistic  circumstances.  This 
permits  a  great  deal  more  to  be  learned  because 
the  experimental  conditions  are  fully  known, 
controllable,  and  reproducible,  so  that  be¬ 
havioral  changes  can  be  traced  directly  to 
their  causes. 


SOURCES  OF  DATA 


Data  and  information  were  obtained  from  inter¬ 
views  with  typical  organizations  participating 
in  IPP  programs.  A  list  of  these  organizations 
was  obtained  from  the  Register  of  Planned 
Emergency  Producers  (Office  o  ft  lie  Assistant 
Secretary  of  Defense,  Volumes  I,  II,  III,  DOD 
40053-H,  April  197S).  From  this  source, 
twenty-six  organizations  were  pre-interviewed 
concerning  IPP  programs,  their  operations,  use, 
etc.  From  these  a  sample  was  selected  to  pro¬ 
vide  data  for  the  ESAP  and  the  case  examples 
presented  in  the  context. 

Sufficient  information  and  data  existed  con¬ 
sisting  of  descriptive  knowledge  by  management 
for  the  study.  In  fact,  management  was  very 
sensitive  to  the  preserving  of  important  vari¬ 


ables  concerning  energy  and  IPP  programs;  and 
there  was  divulged  far  more  useful  information 
than  existed  in  recorded  data. 


ASSUMPTIONS 


The  problem  of  determining  the  effects  of 
energy  on  production  capacity  under  varying 
conditions  (especially  IPP  requirements)  is 
evaluated  through  an  Energy  System  Analysis 
Procedure  (ESAP) .  Such  an  approach  is  based 
on  several  premises: 

1.  Decisions  in  management  and  production  take 
place  in  a  framework  of  information-feedback 
systems . 

2.  Intuitive  judgment  is  generally  unreliable 
about  how  these  systems  will  change  with 
time,  even  when  good  knowledge  exists  of 
individual  parts  of  the  system. 

3.  Model  experimentation  fills  the  gaps  where 
knowledge  and  judgment  are  weakest  by  show¬ 
ing  the  way  in  which  the  known  separate 
system  parts  can  interact  to  produce  un¬ 
expected  and  troublesome  overall  system 
results . 

4.  Enough  information  is  available  for  an  ex¬ 
perimental  model  building  approach  without 
great  expense  and  delay  in  further  data 
collection. 

5.  The  mechanistic  decision-making  process  is 
true  enough  so  that  the  structure  of  poli¬ 
cies  and  decisions  of  an  organization  is 
represented. 

6.  The  organizational  systems  are  developed  to 
create  many  of  the  troubles  often  attributed 
to  outside  and  independent  causes. 

7.  Policy  and  changes  arc  feasible  that  produce 
substantial  improvement  in  the  behavior  and 
system  performance  which  is  often  far  from 
what  it  could  be,  and  initial  design  changes 
can  improve  all  segments  without  compromises 
or  losses  from  gains  in  another. 

Those  premises  are  the  basis  for  developing  an 
approach  to  the  understanding  of  the  effects 
that  energy  reductions  and  changes  have  on  the 
behavior  of  IPP  production  facilities.  The 
interactions  between  system  components  are  in 
many  situations  more  important  than  the  com¬ 
ponents  themselves.  Therefore,  the  Information 
feedback  becomes  the  basis  for  integrating  the 
separate  facets  of  the  process. 


VALIDATION  OF  PROCEDURE 


Validity  of  the  procedure,  ultimate  purpose, 


and  the  assumptions  underlying  the  procedure 
are  not  separated.  The  procedure  can  only  be 
expected  to  perform  to  the  extent  that  the  sys¬ 
tem  has  the  characteristics  to  achieve  the 
goals.  In  all  cases,  unknown  and  uncontrolled 
forces  will  develop  that  will  cause  events  to 
occur  which  will  affect  the  long-term  outcome, 
and  may  or  may  not  influence  individual  specif¬ 
ic  events  at  particular  points  of  time. 

The  behavior  of  the  procedure  is  greatly 
changed  if  any  of  the  controlling  policies  are 
changed.  The  use  of  quantitative  techniques 
takes  on  authenticity;  therefore,  judgment  must 
be  n  formal  and  sound  part  of  the  evaluation. 
Validation  does  not  stop  with  numerical  data 
but  uses  beth  -.ources  including  non-quantita- 
tive  areas. 


ENERGY  SYSTEM  ANALYSIS  PROCEDURE  (ESAP) 


The  Energy  System  Analysis  Procedure  (ESAP) 
describes  the  manufacturer's  behavior  during 
energy  reductions,  involving  and  relating  the 
essential  characteristics  of  the  firm.  Only 
the  most  pronounced  and  obvious  influences  are 
included.  The  purpose  is  not  to  achieve  com¬ 
plete  representations  of  all  functions,  but  an 
analysis  to  understand  the  contributions  to 
the  system  behavior. 

The  ESAP  has  the  following  characteristics: 

1 .  Describes  cause-effect  relationship  for  var¬ 
ious  energy  typos. 

2.  Is  simple  in  mathematical  nature. 

3.  Is  closely  synonymous  to  the  industrial 
terminology. 

4.  Can  extend  to  large  complex  situations. 

5.  Includes  a  continuous  interaction  of  energy- 
related  activities. 

Tne  structure  contains  the  following  essential 
features: 

1.  Customers  of  sover  .  levels  of  activity,  DOD, 
IPP  manufacturing  units,  and  suppliers. 

2.  Flows  from  one  lovel  to  another  of  informa¬ 
tion,  materials,  etc. 

5.  Decision  points  that  control  activities  in 
tho  structure.  These  aro  statements  of 
policy  that  determine  rosponso  to  conditions. 

4.  Information  sources  thnt  connect  the  struc¬ 
ture. 

In  this  analysis,  the  customers  (Including  DOD), 
production,  .suppliers,  and  energy  sources  make 
up 't lib  sector',,  which  arc  very  similar  to  one 


another.  In  approaching  the  actual  situation 
of 'energy  reduction  (shortage),  this  involves 
tentative  identification  of  the  pertinent  var¬ 
iables,  reducing  these  to  equation  form,  and 
selecting  the  factors  that  are  to  be  included. 

1.  A.  For  the  Customer  and  DOD  Sector,  the 

quantities  that  are  central  are: 

(1)  Backlog  sales 
,  (2)  Inventory 

B.  Correspondingly,  the  major  flows  perti- 
nont  to  the  objectives  are: 

(1)  Orders  from  customers  and  DOD 

(2)  Inventories  shipped 

(3)  Orders  to  production 

(4)  Transportation  to  customers  and  DOD 

(5)  Transportation  from  production 

’C.  The  principal  delays  for  these  quanti¬ 
ties  and  flows  are: 

(1)  Delay  in  inventories  shipped 

(2)  Delay  in  transportation  to  customers 
and  DOD 

(3)  Delay  in  backlog  sales 

(4)  Delay  in  trasnportation  from  produc¬ 
tion 

2.  A.  The  Production  Sector  involves  quanti¬ 

ties  set  forth  as  follows: 

(1)  Actual  raw  material  (RM)  inventories 

(2)  Unfilled  purchase  orders  from  sup¬ 
pliers 

B.  The  major  flows  for  this  sector  are: 

(1)  IPP  production 

(2)  Purchase  orders  to  suppliers 

C.  Delays  in  the  production  sector  are: 

(1)  Delay  in  purchase  orders  to  sup¬ 
pliers 

(2)  Delay  in  IPP  production 

(3)  Delay  in  transportation  from  sup¬ 
pliers 

3.  A.  The  Suppliers  Sector  uses  quantities 

factors  os  follows: 

(1)  Supplies  shipped 

B.  The  flows  are: 

(1)  Supplier  production 

(2)  Transportation  to  production 

C.  Delays  for  suppliers  are: 

(1)  Delay  for  supplior  production 

(2)  Oolny  for  transportation  to  produc¬ 
tion. 
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4.  A.  The  Energy  Sector  quantities  include: 

(1)  Energy  for  production 

(2)  Energy  for  suppliers 

(3)  Energy  for  transportation 

B.  The  flows  that  are  involved  are: 

(1)  Energy  allocation 

(2)  Energy  substitution 

C.  The  delays  are: 

(1)  Delay  in  energy  allocation  to  indus¬ 
try 

(2)  Delay  for  transportation 

Changes  in  data,  while  ignoring  the  super¬ 
imposed  meaningless  fluctuations,  require 
averaging  (smoothing) .  Averaging  of  data  oc¬ 
curs  to  some  extent  at  all  points  in  the  pro¬ 
cedure.  In  turn,  each  of  these  same  points 
contributes  its  source  of  fluctuations  to  the 
points  or  activities  being  controlled.  The 
mechanism  for  smoothing  is  the  numerical  pro¬ 
cessing  of  data  into  averages,  monthly, 
quarterly,  and  annual  summaries  of  sales,  prod¬ 
uction,  and  energy  usages  for  the  period  speci¬ 
fied.  These  formal  averaging  processes  are 
found  in  many  points  and  channels  of  the 
procedure. 


CATEGORICAL  FINDINGS 


These  findings  are  based  on  the  ESAF  of  firms 
having  IPP  programs  surveyed,  ranging  from 
light  fabrication  plants  to  basic  production 
plants. 

1.  The  critical  factor  causing  reduced  plant 
output  is  lack  of  materials  from  suppliers 
that  are  generally  major  users  of  another 
energy  source  in  the  production  process,  or 
lack  raw  materials.  From  the  analysis,  one 
or  two  suppliers  from  distant  regions  (such 
as  northeastern  U.S.)  caused  major  reduction 
of  output  in  these  plants. 

2.  Plants  have  made  provisions  for  standby 
energy  sources  for  heating  purposes;  how¬ 
ever,  tea  standby  is  available  for  electrical 
power  which  is  especially  important  to  these 
plants  since  "brownouts"  will  cause  real 
problems. 

3.  Results  for  the  program  are  for  a  one-year 
period,  which  is  valid  because  firms  can 
make  major  changes  beyond  a  year  to  cope 
with  energy  shortages. 

4.  IPP  programs  for  most  firms  are  out-of-date, 
as  they  have  not  been  updated  and  reviewed 
periodically.  Plants  have  added  and  dropped 
production  facilities  and  changed  technical 
know-how  since  IPP  surveys  were  prepared. 


5.  Many  new  production  facilities  in  the  area 
are  not  involved  In  IPP  programs. 

6.  Management  of  the  firms  with  IPP  programs 
feel  that  the  Air  Force/DOD  lacks  interest 
in  these  programs  because  of  the  poor  com¬ 
munication  with  them;  therefore,  management 
does  not  feel  any  commitment  to  Department 
of  the  Air  Force/DOD  requirements,  only  to 
their  regular  customers. 


LIMITATIONS  OF  ESAP 


All  procedures,  models,  systems,  etc.,  devel¬ 
oped  to  cope  with  a  given  problem  or  to  provide 
information  have  various  degrees  of  limita¬ 
tions.  It  is  important  that  these  limitations 
be  recognized  by  the  users  and  results  inter¬ 
preted  with  them  in  mind.  The  major  limita¬ 
tions  of  the  ESAP  are: 

1.  The  system  developed  for  the  project  is 
deterministic,  which  does  not  permit  the 
addition  of  data  during  the  period. 

2.  Seasonal  variations,  cyclical  changes,  etc., 
are  not  included  in  the  system.  These  can 
be  added,  which  would  make  the  analysis  more 
realistic  to  real-world  conditions. 

3.  There  is  a  lack  of  probability  distributions 
utilized  extensively  in  the  system.  A 
greater  use  of  Monte  Carlo  distributions 
would  make  the  output  closer  to  actual  real- 
world  events. 

4.  It  must  be  recognized  that  data  and  informa¬ 
tion  for  the  developing  and  testing  of  the 
procedure  was  limited  to  a  small  number  of 
IPP  firms  located  in  the  Midwestern  Region 
of  the  United  States. 

5.  The  present  United  States  energy  program  is 
an  allocation  based  on  past  average  usage 
rates.  For  example,  if  a  firm  had  ineffi¬ 
cient  production  equipment  and/or  buildings 
without  insulation  or  in  poor  repair,  the 
energy  usage  would  be  reduced  the  same  per¬ 
centage  as  the  firm  having  highly  efficient 
production  equipment  and  buildings.  No  pro¬ 
visions  are  made  in  the  energy  program  for 
efficient  use  of  energy.  Therefore,  no 
methods  or  means  arc  provided  in  the  analy¬ 
sis  for  efficiency  versus  inefficiency  of 
production  facilities. 


RECOWENDED  USES  FOR  THE  ESAP 
IN  AIR  FORCE  IPP  PROGRAMS 


1.  Analyzing  the  effects  of  energy  reduction  on 
the  firm's  production-capabilities. 

2.  Determining  which  production  facilities  in 
the  IPP  program  are  utilizing  energy  most 
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efficiently  for  selecting  production  facili¬ 
ties  for  IPP  programs. 

3.  P.stablishing  benchmarks  measuring  how  pro¬ 
duction  will  be  affected  during  energy 
reductions . 

4.  This  analysis  will  give  firms  an  idea  of 
what  factors  will  probably  limit  their  pro¬ 
duction  capabilities  during  various  types  of 
energy  reductions.  Then  DOD  may  encourage 
firms  either  to  prepare  for  alternative 
energy  sources  or  to  be  dropped  from  the 
IPP  ;  rogram. 

5.  Determining  wh.  ‘  DOD  supplies  will  be  in 
critical  shortage  and  should  be  stockpiled. 


RECOMMENDATIONS  FOR  IMPROVING  THE  IPP  PROGRAM 


1.  It  has  been  amply  demonstrated  that  society 
and  industry  have  not  yet  adopted  energy 
efficiency  and  conservation  practices.  How¬ 
ever,  the  government  cannot  expect  industry 
and  society  to  practice  energy  conservation 
and  reduction  if  it  does  not  adopt  such 
practices  itself.  The  Air  Force  must  make 
changes  and  show  how  these  changes  contrib¬ 
ute  to  increased  efficiency  through  the  IPP 
prograii .  The  Air  Force  must  take  the  leading 
role  in  this  area,  similar  to  the  Space 
Technology  program  in  which  space  technology 
has  been  adapted  to  cownercial  use. 

2.  The  F.SAP  provides  a  range  of  what  Air  Force 
planners  can  expect  from  various  types  of 
energy  reduction. 

3.  The  ESAP  should  be  performed  for  all  Air 
Force  IPP  firms  in  a  particular  federal 
region  to  determine  how  energy  reduction 
affects  them,  hater,  the  procedure  would 
involve  all  federal  regions  having  Air  Force 
IPP  plants,  then  still  later,  all  DOD 
facilities. 

4.  This  procedure  should  be  employed  to  evalu¬ 
ate  the  effect  of  er  -gy  on  all  new  proposed 
weapon  systems.  T!  ,  would  determine  which 
IPP  plants  would  be  expected  to  experience 
production  problems  in  meeting  commitments. 

5.  Because  production  capabilities  of  IPP 
plants  aro  changing  through  new  equipment, 
morn  efficient  enorgy  utllitation,  new  tech¬ 
nology.  raw  materials,  etc.,  the  procedure 
vlitutltl  1>p  til  lilted  oni-h  vonr  when  Form  1319 
Is  prepit veil . 

t>.  At  present,  IPP  plants  do  not  have  an  energy 
priority,  oven  during  an  cnergoncy.  There¬ 
fore,  the  Air  Force  and  DOD  should  work  to 
enact  an  enorgy  priority  system  for  IPP 
plums  in  the  United  States  allocation 
r logrnm. 
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FUTURE  SOURCES  OF  MILITARY  JET  FUELS 
William  L.  Stanley,  The  Rand  Corporation 


INTRODUCTION 


As  the  availability  and  economics  of  jet  fuels 
derived  from  crude  oil  become  less  certain  in 
the  future,  the  United  States  Air  Force  will 
need  to  consider  the  implications  of  using  jet 
fuels  derived  from  alternative  energy  re¬ 
sources.  This  highlights  some  of  the 

results  of  a  Rand  analysis  for  the  Air  Force 
that  sought  to  identify  (1)  the  most  promising 
energy  resource  alternatives  to  crude  oil  for 
jet  fuel  production,  (2)  the  most  attractive 
military  jet  fuels  derivable  from  the  resource 
alternatives,  and  (3)  the  appropriate  military 
R&D  activities  required  to  narrow  the  uncer¬ 
tainties  associated  with  synthetic  jet  fuels.1 

What  has  happened  to  military  jet  fuel  prices 
since  mid-1973  provides  much  of  the  motivation 
for  considering  alternative  energy  sources. 

The  price  the  Air  Force  pays  for  its  JP-4  jet 
fuel  has  Increased  by  over  $800  million;  at 
present  consumption  rates,  each  penny  per  gal¬ 
lon  increase  in  jet  fuel  prices  translates  to 
about  a  $40  million  increase  in  annual  Air 
Force  jet  fuel  expenditures.  Considering 
these  Increases  in  jet  fuel  costs,  it  seems 
quite  possible  that  some  time  in  the  future, 

Jet  fuels  derived  from  energy  sources  other 
than  crude  oil  may  become  economic. 

Ongoing  discussions  about  the  most  appropriate 
future  aviation  fuel  forms  provide  the  motiva¬ 
tion  for  evaluating  more  than  just  conven¬ 
tional  hydrocarbon  fuel  types.  Indeed,  some 
have  suggested  that  liquid  hydrogen  is  the 
aviation  fuel  of  the  future,  but  it  must  be 
measured  against  the  other  alternatives. 

The  long  lead  times  required  to  Introduce  new 
aviation  propulsion  technologies  dictate  that 
the  military  participate  in  synthetic- fuels- 
related  research  today.  Our  findings  provide 
some  suggestions  about  the  appropriate 
research  emphasis  in  the  present  environ¬ 
ment  of  considerable  uncertainty. 

Figure  1  illustrates  one  of  the  more  fundamen¬ 
tal  energy  problems  confronting  the  United 
States.2  While  we  have  a  declining  domestic 
resource  base  of  oil  and  gas,  we  rely  on  im¬ 
ported  and  domestic  supplies  of  these  resources 
to  sstlsfy  about  three-quarters  of  oi  r  energy 
needs.  Fortunately,  we  have  other  resource 
alternatives,  including  abundant  supplies  of 
coal  and  as  yet  unexplolted  re  >rves  of  oil 
shale.  The  extent  of  the  oll-snale  resource 
base,  and>  the  generally  favorable  results  of 
preliminary  experiments  conducted  by  the  Air 
Force,  Navy,  and  their  contractors  in  the 
retorting  and  refining  of  oil  shale  to  liquid 


tntrvy  1000 
(quadrillion 
ITUs  > 


Fractbn  • 
of  todi 

20 

comu«WWi  1 
in  \m  40 1 
(ptrctnO  | 
60 


Notes. 

B3  UnctrWnty  Bind 

Tote!  U.S.  energy 
Consumption  In  1974 
n  Quadrillion  BIUs 


DOAtlUC 

1 

DoflMrtic 

C9 

■ 

£SP 

rs 

StWe 

Oil 


I  NutlMf  «no 
;  M/drptixtelc- 4.7% 


Fig.  1 — U.S.  Fossil  Resources 
SOURCES:  [1][2)[30] (22) [4] . 

military  fuels,  indicate  that  oil  shale  de¬ 
serves  serious  consideration  as  a  future  energy 
source  for  jet  fuels  [23][26  )[14).  In  this 
paper  we  consider  a  subject  which  has  received 
somewhat  less  attention,  the  prospects  for 
using  coal  as  an  energy  source  for  jet  fuels 
for  Air  Force  aircraft  entering  the  inventory 
in  the  1985  to  2000  time  period. 

At  current  rates  of  domestic  crude-oil  produc¬ 
tion,  we  would  deplete  the  crude-oil  reserves 
noted  in  Fig.  1  in  about  40  to  60  years  (18], 
which  indicates  the  inevitability  of  some 
shifts  in  our  patterns  of  energy  resource  con¬ 
sumption  to  more  abundant  domestic  supplies  of 
energy.  Of  course,  if  and  when  we  begin  to 
place  greater  reliance  on  fossil  resources 
like  oil  shale  and  coal,  we  will  require  new 
processes  to  convert  these  solid  fuels  to 
liquids  suitable  for  transportation  uses. 

Figure  2  illustrates  a  respresentatlve,  but  by 
no  means  exhaustive,  set  of  processes  for  pro¬ 
ducing  selected  Jet  fuels  from  energy  re¬ 
source  alternatives  to  crude  oil  and  natural 
gas.  Several  of  the  energy  resources,  in¬ 
cluding  coal,  could,  in  principle,  be  used  to 
produce  any  of  the  jet  fuels  shown  In  Fig.  2. 
Oil  shale  could  also  ausume  such  a  role,  al¬ 
though  attention  thus  far  has  mainly  focused 
on  deriving  liquid  distillate  products  from 
oil  shale.  Hydrogen  has  the  virtue  of  being 
derivable  from  any  of  the  so-called  renewable 
or  ultimate  energy  sources  (e.g.,  solar  energy, 
nuclear  fusion) ,  but  the  economics  and  energy 
requirements  of  these  processes  do  not  promise 
to  improve  upon  the  economics  of  obtaining  hy¬ 
drogen  via  coal  gasification  in  the  1985-2000 
time  period.  Indeed,  whe::  one  considers  the 
resource  base  of  each  of  the  resources  shown  in 
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Fig.  2— Overview  of  Fuel  Supply  Processes 


Fig.  2,  the  present  and  foreseeable  technology 
for  converting  these  resources  into  jet  fuels 
of  interest,  and  the  evolving  energy  Rf.h  tech¬ 
nologies  being  emphasized  In  the  United  States 
today,  one  can  pragmatically  conclude  that 
coal  and  oil  shale  arc  the  most  attractive 
resource  alternatives  to  crude  oil  for  Jet 
fuel  production  between  now  and  the  end  of  the 
century. 


COMPARISON  OF  ALTERNATIVES 


To  narrow  the  list  of  fuel  candidates,  we  used 
a  screening  process  that  evaluated  the  diffi¬ 
culties  in  synthesizing  the  fuels,  the  compar¬ 
ative  physical  properties  of  the  fuels  in  the 
context  of  aviation  applications,  and  the  per¬ 
formance  of  airplanes  fueled  by  the  various 
alternatives  [81117].  As  a  result  of  this 
exercise,  we  eliminated  such  candidates  as 
acsonio,  ethanol,  methanol,  etc*,  and  con¬ 
cluded  that  two  cryogenic  fuels,  liquid  hydro¬ 
gen  and  liquid  methane,  and  a  synthetic  hydro¬ 
carbon  jet  fuel  (or  sv  -.hctic  JP,  to  use  a 
common  military  desi  .cion)  held  the  most 
promise  as  Jet  fue'  a  :ernatlves  derivable 
from  coal.  We  then  compared  these  three  alter¬ 
natives  in  terns  of  the  energy  requirements  to 
produce,  distribute,  and  store  the  fuels,  the 
costs  associated  with  such  fuel  supply  proces- 
nen,  the  resource  requirements,  and  seme  of  the 
environmental  Impact*.  We  highlight  below  seme 
or  thu  mure  relevant  enorgy  and  cost  aspects 
of  that  analysts. 


Energy 


Several  factors  motivated  our  consideration  of 
the  energy  expenditures  required  for  fuel 


production.  An  understanding  of  the  tcchnte.il 
reasons  why  certain  fuel  i  roduction  processes 
require  more  energy  than  others  can  lead  to  a 
greater  understanding  of  why  the  fuel  alter¬ 
natives  differ  In  cost.  It  can  also  facili¬ 
tate  the  assessment  of  the  total  energy- 
intensiveness  of  a  given  aircraft  and  fuel 
combination  to  aid  in  complying  with  recent 
DoD  guidelines  that  require  considering  energy 
effectiveness  as  well  as  cost  effectiveness  in 
evaluating  future  weapon  systems  1 16) [32). 
Finally,  it  seemed  prudent  to  identify  the 
total  energy  requirements  that  particular  fuel 
alternatives  would  impose  on  the  nation’s 
energy  resource  base,  since  the  Air  Force  must 
compete  for  these  supplies  with  many  other 
users  in  the  marketplace. 

to  measure  the  energy  requirements  for  fuel 
production  and  distribution,  we  developed 
representative  fuel  supply  systems  that  use 
surface-mined  coal  from  Wyoming  ns  an  energy 
source  to  produce  jet  fuel  for  a  West  Coast 
air  base.*  The  numbers  enclosed  by  dashed 
llrie3  above  the  elements  of  the  fuel  supply 
systems  in  Fig.  3  trace  the  flow  of  resource 
energy  (energy  derived  from  the  primary 
resource — coal)  from  extraction  to  ultimate 
distribution.  Liquid  hydrogen  production 
requires  289  Btu  of  coal  resource  energy  to 
produce  100  Btu  of  liquid  hydrogen  and  35  Btu 
of  useful  by-products.  Of  course,  fuel  pro¬ 
duction  also  requires  other  energy  to  fuel  the 
diesel  train,  build  the  facilities,  generate 
electricity  for  liquefaction,  etc.  We  show 
this  process  energy  below  the  elements  of  the 
fuel  supply  system.  The  liquid  hydrogen 
supply  system  requires  an  extremely  large 
process-energy  expenditure  to  generate  the 
electricity  to  liquefy  the  gaseous  hydrogen 
and  render  it  suitable  for  storage.  In  fact, 
the  process  energy  required  is  roughly  equiva¬ 
lent  to  the  energy  content  of  the  gaseous 
hydrogen  entering  the  liquefa.tion  plant.  As 
a  result,  about  3.2  Btu  of  energy  must  be 
input  for  every  Btu  of  liquid  hydrogen  and  by¬ 
products  output.  Thus,  liquid  hydrogen  pro¬ 
duction  uses  significantly  more  energy  th.in 
today's  crude-oil  supply  system,  which 
requires  about  1.2  Btu  of  energy  input  for 
[every  Btu  of  refined  products  output.  We 
shall  see  later  how  the  energy-intenslvcness 
of  hydrogen  liquefaction  contributes  signifi¬ 
cantly  to  the  cost  of  liquid  hydrogen. 

Methane  liquefaction  requires  only  about  10  co 
i  15  percent  of  the  electric  power  required  for 
hvdrogen  liquefaction  [2?].  Because  the  scale 
of  electricity  required  is  sufflclentlv  low  as 
co  not  preclude  on-site  power  generation, 
tiethanc  liquefaction  plants  typically  use  part 
of  the  gaseous  methane  entering  the  plant  to 
generate  clectrlcl£u;  hence,  with  resource 
energy  (the  gascour,  srlhanc)  supplying  the 
energy  for  liquefaction,  the  process  energy 
shown  in  Fig.  3  tor  methane  liquefaction 
reflects  only  the  energy  required  to  build  the 
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Fig.  3 — Energy  Needed  to  Produce  Alternative  Jet  Fuels 


facility  [7] [29] [21).  The  energy  accounting 
Indicates  that  1.9  Btu  of  energy  must  be  input 
for  every  Btu  of  liquid  methane  and  by-products 
output. 

In  absolute  terms,  synthetic  JP  production 
requires  more  coal-resource  energy  than  the 
other  two  alternatives,'  not  because  the  pro¬ 
cess  la  less  efficient,  but  because  the  re¬ 
finery  processes  less  than  one-half  of  every 
barrel  of  coal  syncrude  to  a  refined  Jet  fuel; 
most  of  the  remaining  output  Is  motor  gasoline. 
Figure  3  Indicates  a  comparatively  large 
process-energy  requirement  for  syncrude  refin¬ 
ing,  which  reflects  the  hydrogen  treatment  the 
coal  syncrude  must  undergo  to  lower  its  charac¬ 
teristically  high  aromatic  content,  as  well  as 
some  hydrocracking  of  heavier  distillate  frac¬ 
tions  that  maximizes  the  output  of  jet  fuel. 
Reducing  the  yield  of  jet  fuel  would  reduce 
energy  requirements.  Overall,  the  synthetic 
JP  process  requires  that  1.7  Btu  of  energy  be 
Input  for  every  Btu  of  synthetic  JP  and  by¬ 
products  output. 

We  have  also  uade  some  plausible,  but  optimis¬ 
tic,  estimates  of  possible  future  Improvements 
In  these  fuel  supply  systems  to  arrive  at  the 
energy  ratios  shown  on  the  right  in  Fig.  3. 

We  deliberately  assembled  this  rather  optimis¬ 
tic  set  of  estlsMtes  to  test  the  hypothesis 
that  the  characteristically  lighter  llquld- 


hydrogen-fueled  aircraft  might  use  less  total 
energy  than  the  other  alternatives.  The 
results  Indicated  chat  for  a  broad  class  of 
military  missions,  the  large  energy  expendi¬ 
tures  associated  with  liquid  hydrogen  produc¬ 
tion  and  distribution  more  chan  offset  the 
lower  on-board  energy  consuiqtion  of  a  sub¬ 
sonic  liquid-hydrogen-transport  aircraft  [17]. 
In  an  energy  context,  the  synthetic- JP-fueled 
aircraft  proved  more  energy  effective  than 
the  other  two  alternatives  for  almost  all  the 
missions  considered.5  We  can  conclude  from 
this  energy  assessment  chat  compared  to  the 
crude  oil  supply  system,  the  synthetic  JP 
alternative  does  not  represent  a  means  to  save 
energy,  although  it  does  represent  a  possible 
means  to  save  crude  oil  by  using  an  alterna¬ 
tive  energy  resource. 


Costs 


Any  absolute  economic  assessment  of  alterna¬ 
tive  jet  fuel  costs  must  remain  aomewhst  spec¬ 
ulative  until  operating  experience  Is  accumu¬ 
lated  with  large  synthetic  fuel  demonstration 
plants.  At  this  writing,  any  such  plants 
would  appear  to  be  at  least  three  to  five 
years  away  from  operation.  Nonetheless,  by 
making  consistent  assumptions  about  the  supply 
systems  of  the  three  fuel  alternatives,  we  can 
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gain  some  insights  about  the  relative  costa  of 
producing  and  delivering  the  fuels.  While  we 
originally  expressed  the  cost  analysis  on  a 
1974  do'lar  basis,  we  will  translate  the  more 
relevanc  results  to  a  1973  dollar  basis  at  the 
conclusion  of  the  assessment. 

We  developed  average  fuel  costs  for  the  produc¬ 
tion  and  delivery  of  the  fuels  to  a  group  of 
air  bases,  assuming  a  mix  of  underground-mined 
coal  from  the  east  and  surface-mined  coal  from 
the  west  having  an  average  price  of  about  $9.64 
per  ton,  or  54c  per  million  Btu.  Table  1 
Indicates  the  capital  cost  of  the  energy-con- 
version  facilities  per  dally  million  Btu  of 
fuel  prodti-fs,  including  a  28  percent  "owner¬ 
ship"  cost  over  and  above  the  basic  plant. 
Investment  to  cover  interest  during  construc¬ 
tion,  working  capital,  start-up  capital,  etc. 
Because  of  the  capltal-lntensiveness  of  these 
facilities,  the  method  of  financing  has  a 
strong  influence  on  fuel  costs. 


Table  1 
CAPITA!.  COSTS 


Energy 

Conversion 

Facility 

Capital  Cost 
per  Daily  Million  Btu 
of  Fuel  Products 
(1974  $/lOh  Btu) 

Coal  liquefaction 

1690 

Syncrude  refinery 

490 

Coni  gasification  to 

hydrogen 

2590 

Hydrogen  liquefaction 

2520 

Coal  gasification  to 

methane 

1730 

Methane  liquefaction 

340  . 

Figure  4  identifies  the  major  cost  categories 
for  energy  conversion,  Including  the  fixed 
(capital  charges) ,  operating  (recurring  labor 
coots,, property  taxes,  w  materials,  etc.), 
and  energy  coats.  Hoi  the  large  contribution 
of  liquefaction  electricity  to  liquid  hydrogen 
costs.  If  we  apply  credits  for  the  by¬ 
products,  particularly  the  large  gasoline  by¬ 
product  credit,  we  obtain  costs  of  $8.20, 

$3.56,  and  $2.91  per  million  Btu  for  the  liquid 
hydrogen,  liquid  methane,  and  synthetic  JP, 
respectively.  These  costs  assume  industrial 
financing  that  yields  n  10  percent  discounted 
cash  Clow  ruturn-on- Investment  after  taxes. 

Soma  have  suggested  that  Investors  may  very 
well  demand  ratiirnn  of  15  percent  or  more 
because  of  the  risks  Involved,  and  S9  a  means 
to  generate  the  equity  for  the  rapid  bui id-up 
of  a  synthetic  fuels  industry  (251.  As  a 
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consequence,  fuel  costs  could  very  well  reach 
or  exceed  the  values  shown  in  the  box  in 
Fig.  4.  We  can  conclude  from  this  assessment 
that  in  a  relative  sense,  synthetic  JP  would 
cost  significantly  less  than  liquid  hydrogen, 
and:  modestly  less  than  liquid  methane.  The 
fuel  cost  sensitivities  to  resource  costs, 
financing  assumptions,  and  plant  costs  shown 
In  Figs.  5  and  6  also  indicate  that  liquid 
hydrogen  costs  are  generally  more  sensitive 
to  unfavorable  changes  in  the  parameters 
because  of  the  less-efficient  production  and 
distribution  system. 

The  dramatic  differences  in  peacetime  and  war¬ 
time  jet  fuel  demandsby  the  military  (e.g. , 
consumption  changes  of  100  to  300  percent) 
could  also  pose  a  serious  problem  for  the  par¬ 
ticularly  capital-intensive  hydrogen  lique¬ 
faction  process.  Unless  a  large  market  of 
interruptible  users  could  be  developed  to  use 
the  excess  liquid  hydrogen  plant  capacity 
during  peacetime,  the  liquefaction  facility 
owner  would  have  to  raise  fuel  prices  appre¬ 
ciably  to  cover  his  large  fixed  costs.  In 
other  words,  there  could  be  a  large  cost 
penalty  for  underutilizing  the  system  [81 . 

The  synthetic  JP  option  has  the  apparent 
advantage  of  having  a  refinery  product  slate 
more  amenable  to  assimilation  into  existing 
petroleum  markets  during  peacetime. 

A  mission  analysis  of  airplanes  fueled  by 
these  three  alternatives  indicated  that  for  a 
broad  class  of  present  and  future  mission 
applications,  the  synthetic- JP-fueled  aircraft 
proved  significantly  more  coat  effective  than 
the  other  alternatives,  for  fuel  costs  in  the 
range  of  those  cited  in  Fig.  4  (17).  It  would 
seem  that  only  major  reductions  In  the  costs 
of  liquefying  gaseous  hydrogen  would  improve 
thi  relative  attractiveness  of  liquid  hydrogen 
airplanes. 

Moving  from  relative  comparisons  of  the  fuel 
alternatives  to  absolute  comparisons  with 
present  petroleum  market  conditions  entails 
considerable  uncertainty,  but  nonetheless  we 
will  do  so  to  illustrate  the  presently  un¬ 
favorable  economics  of  the  synthetic  JP  al¬ 
ternative.  Depending  on  the  financing,  tile 
synthetic  JP  co«t  in  our  example  ranges  from 
37c  r.o  45C  per  gallon  In  1974  terse,  or  con¬ 
verting  to  1978  terms,  about  45c  to  58c  per 
gallon  [6J15J.  As  indicated  in  Fig.  4,  as  of 
October  1977,  the  Air  Force  was  paying  the 
Defense  Fuel  Supply  Center  42c  per  gallon  for 
its  JP-4  fuel,  considerably  less  than  the  cost 
of  o  synthetic  JP  fuel  (3].  Other  analyses 
using  alternative  assumptions  about  coal  con¬ 
version  technology,  coal  costs,  and  financing 
yield  e  generally  broad  range  of  s-thetlc  JP 
coat  estimates,  but  virtually  all  of  these 
analyses  indicate  that  synthetic  JP  from  coal 
would  not  be  competitive  under  present  market 


conditions  [2 4).  The  risks  posed  by  these  un¬ 
favorable  economics,  as  well  as  the  uncertain 
pricing  basis  of  world  oil,  have  tended  to 
inhibit  private  industry  from  aggressively 
pursuing  the  synthetic  fuel  option  without 
government  assistance  of  some  form. 


RESEARCH  AND  DEVELOPMENT  EMPHASIS 


While  the  present  world  oil  price  does  not 
make  synthetic  JP  an  attractive  alternative 
in  today's  environment,  the  long  lend  times 
needed  to  introduce  new  propulsion  tech- 
nologie».  -ok  or  less  require  chat  the 
military  participate  in  synthetlc-fuels- 
rclated  reseatch  today  in  order  to ’-be  in  a 
position  to  choose  the  raoat  cost-effective 
synthetic  J?  fuel  option  at  some  future 
date.  For  the  military  aircraft  user  and 
developer,  the  primary  issue  concerns 
defining  the  proper  technical  and  economic 
tradeoffs  between  engine  technology  and 
fuel  processing  at  Lhe  refinery. 

Coal-derived  fuels  have  characteristic::  that 
enn  cause  problems  in  jet  engines.  Their 
generally  high  aromatic  concent,  or  con¬ 
versely,  low  hydrogen  content,  substantially 
contributes  to  combustion  problems.  Coal- 
derived  fuel3  generally  have  higher  freezing 
points,  and  when  burned  in  Jet  engines, 
generate  more  smoke  and  increase  combustor 
liner  temperatures  and  infrared  signatures. 
They  have  poorer  thermal  stability  proper¬ 
ties  chan  petroleum  fuels  and  pose  some 
compatible Ity  problens  with  elastomeric 
seals.  But  research  already  under  way  has 
demonstrated  that  improvements  in  combustor 
and  fuel  system  technology  can  help  deal  with 
many  of  these  problems  [13].  On  the  other 
hand,  at  soce  additional  cost  in  energy  and 
dollars,  refiners  can  hydrotreat  coal  liquids 
to  reduce  their  aromatic  content.  Tradeoff 
opportunities  also  exist  to  deal  with  the 
characteristically  high  nitrogen  content 
of  shale  liquids  [14].  But  the  refinery- 
engine  tradeoff  interface  has  not  yet  been 
defined  to  a  level  of  recision  that  could 
support  major  develo,  ent  decisions. 

Indeed,  the  considerable  uncertainties  about 
synthetic  JP  fuel  supply  and  utilization 
systems  argue  for  a  cautious  and  flexible 
R&D  approach  by  the  military.  The  pace  and 
extent  of  oil  shale  and  coal  resource 
development  remain  uncertain.  The  identi¬ 
fication  of  the  preferred  fuel-conversion 
technologies  and  their  economics  have  yet  to 
be  defined.  We  still  have  much  to  learn 
about  the  effects  of  synthetic  JP  fuels 
on  aircraft  engines  end  fuel  systems. 

Sped  flcntlnne  for  future  Jet  fuels  are 
still  being  Ulscunaed  and  debated. 


The  uncertainties  seem  to  dictate  a  para¬ 
metric  approach  to  define  fuel  charac  eristics 
and  the  associated  refinery  process  r  •nuire- 
ments.  In  other  words,  an  R&D  program  sl'uc- 
tured  to  gain  information  about  the  spectrum 
of  possible  outcomes  that  might  result  from 
the  present  uncertain  energy  situation  seems 
preferable  to  making  an  early  commitment  for 
a  particular  resource  and  fuel  type.  Such  an 
R&D  approach  should  place  the  military  in 
a  good  position  to  exercise  the  synthetic  JP 
fuel  option  when  these  fuels  enter  the  market- 
p’ace  as  alternatives  to  petroleum  fuels. 


FOOTNOTES 


‘This  paper  has  been  prepared  for  presenta¬ 
tion  at  the  Seventh  Annual  DoD  Procurement/ 
Acquisition  Research  Symposium,  May  31-Junc  2, 
1978,  at  Hershey,  Pennsylvania.  The  views 
expressed  in  this  paper  are  the  author's  own 
and  are  not  necessarily  shared  by  The  Rand 
Corporation  or  its  research  sponsors.  The 
paper  i3  based  on  research  fully  reported  in 
[8]  and  [17). 

‘Crude  oil  and  natural  gas  estimates  include 
identified  resources  and  estimated  undis¬ 
covered  resources  recoverable  with  current 
technology  (unshaded  area) .  The  shaded  area 
refers  to  additional  resources  that  might  be 
recovered  with  enhanced  recovery  techniques. 
The  oil-ahale  estimate  (unshaded)  Includes 
25  to  100  gallon  per  ton  Identified  recover¬ 
able  deposits  in  the  Green  L.ver  Formation. 

The  shaded  area  indicates  potentially  re¬ 
coverable  10  to  25  gallon  per  ton  deposits  in 
the  same  formation,  which  would  require 
development  of  new  recovery  techniques.  The 
lowest  coal  estimate  includes  recoverable 
measured  and  Indicated  resources.  The  highest 
coal  estimate  Includes  recoverable  measured, 
indicated,  inferred,  and  hypothetical 
resources. 

sWe  used  a  variety  of  sources  to  assemble  the 
operating  characteristics  and  costs  for  ttie 
elements  of  the  energy  distribution  and  con¬ 
version  systems  [15](19)[20)[9)[27 )[!2][10] 

[ 21  ] [ 31 ] [ 11 ) [ 28 ] [ 7 ] . 

'observe,  however,  that  if  coal  is  used  to 
generate  the  electricity  for  hydrogen  lique¬ 
faction,  the  liquid  hydrogen  supply  process 
requires  about  ns  much  coal  as  the  synthetic 
JP  alternative  while  delivering  about  half  ns 
much  energy. 

50ur  energy  and  coet  analyses  did  not  consider 
hypersonic  aircraft  applications  *...  which  the 
cryogenic  properties  of  hydrogen  or  methane 
fuels  night  facilitate  Innovative  aircraft 
design  concepts. 
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IMPORTANCE  OF  THIS  RESEARCH 


Abnormal  conditions  or  forces  sometime  preclude 
the  setting  of  the  price  of  particular  goods  or 
services  through  normal  operation  of  the  eco¬ 
nomic  marketplace.  This  situation  is  known  as 
a  "market  failure."  If  the  government  inter¬ 
cedes  and  establishes  regulatory  policy  to  cor¬ 
rect  such  market  failure,  then  the  affected 
part  of  the  economic  system  becomes  part  of  the 
"regulated"  sector.  Federal  government  pur¬ 
chases  in  which  price  cannot  be  determined 
independently  by  competitive  forces  In  the 
marketplace  are  classified  as  "negotiated  pro¬ 
curements."  Thus,  such  negotiated  procurements 
can  be  regarded  as  composing  a  regulated  sector 
of  the  economy.  A  better  understanding  of  the 
nature  of  this  regulated  sector  is  required  in 
order  to  allow  proper  formulation/modification 
of  policy  governing  these  procurements. 

This  paper  will  reflect  findings  from  research 
on  the  composition  of  the  negotiated  component 
of  total  Federal  procurement  expenditures. 


CONTENT  OF  PROPOSED  RESEARCH  PAPER 


This  proposed  paper  will  docunent  research 
findings  related  to  analysis  of  Federal  nego¬ 
tiated  procurement.  Research  findings  to  be 
Incorporated  will  attempt  to  answer  the  fol¬ 
lowing  questions: 

a.  What  is  the  composition  of  total  Federal 
negotiated  procurement  stratified  into  the  fol¬ 
lowing  categories: 

(1)  Small  Business  Set-asides. 

(2)  Labor  Surplus  Set-asides. 

(3)  Competitive  Negotiated. 

(4)  Sole  Source  -  Standard  Goods. 

(5)  Sole  Source  -  Non-standard  Goods. 

(6)  Small  purchase  ($10K  or  below). 

b.  What  Is  the  composition  of  total  Federal 
negotiated  procurement  in  terms  of  classes  of 
goods  involved,  stratified  by  such  categories 
as: 


(3)  Standard  Goods. 

(4)  Service  type  performance  (such  as 
A&E  services). 

c.  Does  the  supply  side  responding  to  the 
Federal  negotiated  procurement  demand  show  any 
special  trends  or  concentrations,  such  as: 

(1)  Dominance  by  individual  firms,  or 
groups  of  firms. 

(2)  Correlation  with  SIC  industrial 

sectors. 

d.  What  patterns  are  apparent  from  a  cross- 
sectional  analysis  by  Federal  agencies  for  the 
above  stratifications? 


BACKGROUND 


Total  Federal  procurement  expenditures  currently 
approximate  $50B  annually.  In  FY-76,  the  amount 
was  $54B,  of  which  $46B  was  classified  as  "nego¬ 
tiated."  The  Department  of  Defense  accounts  for 
approximately  75%  of  negotiated  expenditures,  but 
other  agencies  also  expend  significant  amounts 
using  the  negotiated  procurement  method. 


(1)  SIC  codes. 

(2)  Major  systems. 
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ABSTRACT 


This  study  proposes  a  comprehensive  set  of 
indicators  vhi  e  ;>  irpose  is  to  measure 
selected  dimensions  of  the  research,  develop¬ 
ment,  and  innovative  capabilities  of  small 
businesses.  Over  70  indicators  are  suggested, 
grouped  in  four  categories:  1)  resources, 

2)  structure  and  organization.  3)  administra¬ 
tive  and  legal  aspects  and  4)  outputs.  These 
indicators  resulted  from  an  extensive  survey 
of  the  literature  and  the  authors'  experience 
extending  over  a  period  of  25  years  in  the 
field  of  R&D/ innovation  management.  Alt  ough 
many  measurement  problems  still  remain  unsolv¬ 
ed,  this  stuoy  is  a  preliminary  attempt  to 
gather  and  to  form  a  unified  body  of  indica¬ 
tors  of  small  business  R&D  capabilities,  until 
n :w  scattered  through  different  sources.  The 
potential  set  of  indicators  emphasizes  many 
specific  capabilities  that  are  required  or 
deaired  by  federal  agenclea  as  part  of  their 
RDT&E  procurement  process. 


INTRODUCTION 


There  has  always  been  high  intercsr  In  the 
role  of  small  business  In  the  U.S.  economy 
and  society  no  an  essential  element  Ir.  the 
health  and  growth  of  the  country.  This 
interest  has  been  manifested  by  the  history  of 
legislation  favoring  or  protecting  small  bus¬ 
inesses  and  the  financial  institutions  that 
3erva  them,  such  as  the  Small  Business  Invest¬ 
ment  Companies  which  Congress  mandated  almost 
two  decades  ago. 


*Thia  study  was  supported  by  the  Notional 
Science  Foundation.  Purchase  Order  No. 
77-SI’-05<)9  is  International  Applied  Science 
and  Till1  lino  logy  Assoclatos  (IASTA.  fnc.). 


expression  of  many  of  the  kinds  of  qualiti-s 
that  have  built  this  country.  Traditionally, 
many  small  businesses  -  some  as  small  as  an 
individual  inventor  and  hie  assistant  (fre¬ 
quently  hia  wife  or  other  members  of  his 
family)  -  have  provided  new  products,  processes, 
services,  methods  of  merchandising,  and  other 
innovative  approaches  to  business.  Many  of 
the  devices  and  systems  in  common  use  origi¬ 
nated  from  individual  Inventors  or  small  firms 
which  either  employed  inventors  or  were  formed 
to  exploit  inventions. 


In  the  current  era  of  large-scale  R&D 
(Research  and  Development)  which  Is  dominated, 
at  least  quantitatively,  by  giant  firms,  the 
role  of  small  firms  in  the  overall  R&D/Innova- 
tlon  process  has  been  questioned  in  terms  i f 
potentially  unused  or  unexplolted  R&D  capa¬ 
bility.  There  has  teen,  for  some  time,  a 
feeling  among  some  observers  that  small  firms 
do  not  get  ' he ir  "fair  share"  of  government 
R&D  contracts  and  grants.  This  concern  is 
reflected  In  Che  "set  aside"  provisions  which 
are  prrt  of  the  authorization  acts  and  regu¬ 
lations  of  a  number  of  federal  agencies. 
Another  side  of  the  issue,  however,  is  the 
belief  that  there  is  a  significant  reservoir 
of  unused  or  unrecognized  R&D  and  related 
technical  skills  and  capabilities  among  the 
small  firms  of  this  country. 


In  addition  to  their  general  role  in  providing 
employment,  diversity,  income  and  stability 
to  Che  economies  of  various  states  and  regions, 
small  businesses  are  also  viewed  as  a  source 
of  entrepreneurial  energy,  ideas,  new  products, 
risk-taking,  and  managerial  talent,  and 


The  purpose  of  this  paper  is  to  propose  a 
candidate  set  of  factors  and  indicators  which 
may  bo  used  to  assess  the  R&D  and  technical 
capabilities  of  small  firms.  They  will  have 
Co  be  subjected  to  thorough  pilot  testing 
before  they  can  serve  on  a  routine  basis. 


DEFINITION  OK  RESEARCH  AND  DEVELOPMENT 


This  issue  poses  a  major  dilemma  in  the  speci¬ 
fic  case  of  small  businesses.  In  its  annual 
surveys  of  industrial  R&D,  the  National  Science 
Foundation  hn9  used,  over  many  years,  the 
following  definition  of  R&D  (1): 


Research  and  development  Includes  basic 
and  applied  research  ir.  the  sciences 
and  in  engineering,  and  de-.ign  and 
development  of  prototypes  and  processes 

.  it  includes  such  activities 

whether  assigned  to  separate  research 
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and  development  organizational  units 
of  the  company  or  carried  on  by  com¬ 
pany  laboratories  and  technical  groups 
not  part  of  a  research  and  development 
organization. 

This  definition  has  been  accepted  fairly 
generally  as  a  useful  definition  of  R&D  which 
allows  for  feasible  Identification  and 
measurement.  We  have  commented  elsewhere (2) 
on  the  limitations  which  this  definition 
Imposes  on  our  ability  to  fully  assess  the 
total  R&D/ Innovation  capacity  of  the  U.S. 
and  other  countries  or  even  the  full  R&D 
capabilities  of  firms,  parts  of  which  are  not 
included  in  the  activities  delimited  as  "R&D." 
That  Issue  remains  as  a  limitation  on  any 
survey  data  for  the  entire  R&D  capability  of 
the  Industrial  sector,  but  it  Is  of  vital 
importance  to  any  assessment  of  the  total 
R&D/ Innovation  capability  of  the  small  business 
sub-sector  of  the  Industrial  sector. 


R&D  IN  THE  SMALL  FIRM 


duetton  or  marketing  people,  or  a  general 
purpose  "chief  engineer"  (with  or  without 
assistants)  often  performs  the  whole  spectrum 
of  R&D/Innovatlon  activities  In  a  relatively 
undifferentiated  manner.  This  undifferen¬ 
tiated  manner  can  be  described  as  "doing 
what  is  necessary  and  feasible  to  get  the 
product  out  the  door,  keep  the  factory 
running,  keep  the  customers  happy,  or  keep 
the  regulators  off  our  back." 

For  many  small  businesses,  a  major  share  of 
the  so-called  R&D  is  done  for  them  by  custo¬ 
mers,  suppliers,  competitors,  or  people  who 
sell  know-how  and  technical  Information. 

There  is  still,  however,  a  need  for  applica¬ 
tion  of  the  knowledge  attained  from  outside 
and  adaptation  of  the  product,  process, 
materials,  or  service  to  the  particular  con¬ 
ditions  of  the  firm. 


ASSESSING  THE  R&D/TECHNICAL  CAPABILITIES 
OF  SMALL  BUSINESSES 


R&D  and  related  activities  in  large  and  very 
large  firms,  as  well  as  many  medium-size  oner, 
are  typically  organized  Into  formal  depart¬ 
ments  with  budgets,  staffs,  and  names  such  as: 
corporate  research,  divisional  engineering, 
product  development,  R&D,  advanced  development, 
product  engineering,  process  engineering, 
process  development,  divisional  laboratory, 
central  laboratory,  quality  assurance,  market 
research,  tool  engineering,  process  control, 
customer  service,  etc.,  etc.  These  formal 
activities  arc  fairly  easy  to  Identify  in 
terms  of  size  (number  of  people  and/or  budget), 
location,  assigned  duties  or  objectives,  facil¬ 
ities,  and  other  formal  characteristics.  This 
enables  them  to  be  Included  or  excluded  from 
the  periodic  surveys  conducted  by  NSF  and 
others  (e.g. ,  several  trade  publications  and 
research  Institutes  which  also  make  periodic 
R&D  surveys). 

In  the  case  of  amill  and  very  small  businesses, 
however,  the  Identification  and  measurement  of 
R&D  capability  Is  typically  a  very  different 
matter.  Few  small  businesses  have  formal 
departments  for  all  of  the  technical  functions 
they  actually  perform  as  part  of  the  R&D/lnno- 
vatlon  process  or  even  the  R&D  part  of  that 
process.  Many  of  them  do  not  have  any 
formally-designated  departments  or  laboratories 
with  exclusive  missions  as  defined  by  the 
titles  of  larger-company  activities.  In  the 
extreme,  the  lone  technical  entrepreneur  per¬ 
forms  all  or  many  of  these  functions  himself, 
sometimes  with  the  aid  of  an  "assistant"  or 
with  occasional  help  from  outside  consultants 
and  service  organizations. 


The  factors  and  Indicators  suggested  by  our 
study  are  considered  Important  for  the  conduct 
of  R&D-related  activities  in  the  small  firm 
and  cover  many  arpects  of  such  activities. 

The  19  factors  are  organized  In  U  categories 
or  groups,  and  over  70  illustrative  Indicators 
are  proposed  as  potential  measures  of  the 
factors. 


DEFINITION  OF  THE  GROUPS 


Group  I  -  Reaources-Inputs :  refers  to  the 
existence  of  human,  financial, 
aanlnlstretlve  and  facilities 
resources  In  the  small  business 
related  to  R&D  activities. 

Group  II-  Structure  and  Organization:  refers 
to  selected  characi;< lstlcs  of  small 
firms,  their  R&D  activities  and 
attributes  of  the  type,  volume, 
sources  and  performance  oc  su.h 
activities. 


Group  III-  Administrative  and  Legal  Aspects  . 

refers  to  the  extent'  of  administra¬ 


tive  capabilities  needed  to  perform 
contracted  R&D,  and  the  legal  pro¬ 
blems  affecting  R&D  potential  of  the 
smell  firms. 


Group  IV-  Outputs:  refers  to  the  types,  qua¬ 
lity,  and  reliability  of  technical 
outputs  produced  by  the  small  firm. 


For  larger  small  businesses,  with  some  more 
structure  and  technical  capability,  the  pro- 
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A  summary  of  the  factors  and  their  Illustra¬ 
tive  Indicators  is  given  In  Figure  1  below. 


CONCLUSIONS 


The  factors  and  Indicators  for  assessing  the 
R&D/ Innovation  capabilities  of  the  small  firm 
represent  an  extensive  li3t  which  may  be  used 
by  small  businessmen  and  R&D  grantors  as  a 
general  reference  in  the  analysis  of  such 
capabilities.  Severe  methodological  problems 
still  remain  in  terms  of  data  collection  and 
analysis  of  many  indicators.  This  study  was , 
however,  a  first  attempt  at  organizing  a 
possible  set  of  factors  for  uncovering  the 
hidden  R&D/Innovatlon  potential  of  small  bus¬ 
inesses. 
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CARRIERS  TO  EFFECTIVE  COMMUNICATION  IN  AFSC  SUBCONTRACT  MANAGEMENT 
Mark  Siefert,  Air  Command  and  Staff  College 


Introduction 

Surveillance  of  the  prime  contrac¬ 
tor's  subcontract  activities  has  been  a 
problem  for  the  Air  Force  and  Depart¬ 
ment  of  Defense  since  prime/subcontrac¬ 
tor  arrangements  have  t>een  in  existence. 
Some  authorities  believe  this  problem 
stems  from  the  privity  of  contracts 
principle,  which  prohibits  the  govern¬ 
ment  from  directly  interacting  with  the 
subcontractor.  Others  believe  it  has 
been  our  direct  engagement  with  the 
subcontractor  which  has  caused  many  of 
the  problems  we  face  today.  Whatever 
the  reason,  today's  system  program 
director  (SPD)  faces  the  challenge  of 
performing  surveillance  over  critical 
subcontracts  and  components  to  prevent 
or  curtail  problems  which  lead  to  cost 
and  schedule  growth  on  the  program. 

The  systems  program  office  (SPO) ,  con¬ 
tract  administration  services  (CAS), 
and  industry  must  exercise  subcontract 
management  (SM)  efficiently  to  insure 
that  the  large  number  of  program  dol¬ 
lars  flowing  to  the  subcontractors  is 
used  to  the  maximum  to  support  weapon 
systems  development. 

Problem 

Primarily  through  the  effort  of  Hq 
AF  Contract  Management  Division  (AFCMD), 
extensive  progress  has  been  made  in  the 
effectiveness  of  Air  Force  Systems  Com¬ 
mand  (AFSC)  subcontract  management. 

This  is  especially  true  of  cost-reim¬ 
bursement  and  incentive  contracts 
during  the  Demonstration/Validation  and 
Full-Scale  Engineering  Development 
phases  of  the  weapon  systems  acquisi¬ 
tion  process.  However,  recent  indivi¬ 
dual  and  team  studies  indicate  that 
AFSC  elements  still  have  significant 
difficulty  in  communicating  their  need 
for  subcontract  management  support. 
After  five  years  of  concentrated  effort 
within  AFSC,  the  key  organizations  of 
effective  AFSC  SM  surveillance,  the  SPO 
and  Air  Force  Plant  Representative 
Office  (APPRO) ,  are  still  not  operating 
on  the  same  frequency.  However,  the 
communication  gap  is  not  restricted  to 
these  organizations,  but  is  Command- 
wide. 


Objective 


The  objective  of  the  study  is  to 
identify  communication  barriers  in  the 
subcontract  management  area  within  all 
of  AFSC  and  focus  on  several  issues 


which  presently  Inhibit  cioo<t  communi¬ 
cation.  Thu  underlying  loanou  for 
choosing  this  objective  is  to  enhance 
the  effectiveness  of  the  AFSC  SM  pro¬ 
cess  and  therefore  provide  the  most 
cost-effective  support  for  our  devel¬ 
oping  programs. 


Study  Hypotheses 


The  following  three  hypotheses 
will  be  used  to  test  the  validity  of 
the  problem  statement.  The  findings 
and  conclusions  of  each  hypotheses 
will  result  in  the  retention  or  rejec¬ 
tion  of  an  hypothesis.  Hypotheses 
which  are  retained  will  substantiate 
the  existence  of  the  proposed  problem 
statement. 


1.  There  exist  varying  per¬ 
ceptions  by  the  SPO  and  AFPRO  concern¬ 
ing  what  should  be  emphasized  in  the 
area  of  subcontract  management  and  how 
it  should  accomplished.  This  condi¬ 
tion  has  led  to  a  gradual  erosion  of 
direct  program  support  in  the  subcon¬ 
tract  management  area. 

2.  There  is  within  the  Com¬ 
mand  a  poor  understanding  by  the  pro¬ 
gram  offices  of  what  SM  support  should 
be  provided  by  the  AFPRO  during  the 
contract  administration  portion  of  the 
weapon  systems  acquisition  process. 

3.  There  has  been  a  loss  of 
subcontract  management  corporate  mem¬ 
ory  throughout  the  Command.  Accord¬ 
ingly,  we  are  not  maximizing  our  past 
SM  experiences. 

Review 

As  a  result  of  an  AFSC  subcontract 
management  study  in  1972,  the  Command 
began  to  actively  pursue  visibility 
into  subcontract  operations.  Hq  AFSC 
issued  policy  guidance  which  directed 
greater  involvement  by  the  buying 
organizations  and  plant  representative 
offices  in  subcontracting  operations. 
After  several  years  of  deliberations 
and  discussions  with  DOD  and  the  Armed 
Services  Procurement  Regulation  Com¬ 
mittee,  AFSC  published  revised  guid¬ 
ance  as  an  AFSC  Supplement  to  ASPR 
23-5000,  titled  Subcontract  Management. 
AFSC  ASPR  Supp  23-5000,  dated  7  August 
1975,  set  forth  the  policy  for  AFSC 
program  office  surveillance  of  a  prime 
contractor's  subcontract  management 
system.  Also,  23-5000  established 
the  requirement  for  prime  contractors 
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to  submit  a  subcontract  management  plan 
in  response  to  requests  for  proposal 
for  all  major  acquisition  systems.  At 
a  minimum  the  SM  plan  would  include  a 
list  of  critical  subcontracted  items, 
reference  to  a  proposed  make  or  buy 
plan,  a  description  of  the  procurement 
planning  policies,  and  a  description  of 
the  program  management  organization 
which  would  implement  and  maintain  sur¬ 
veillance  over  critical,  subcontracts. 

With  the  advent  of  the  new  AFSC 
supplement,  the  AF  became  drawn  into 
(or  drew  itself  into)  the  subcontract¬ 
ing  arena.  Now,  the  prime  contractor 
was  contractually  bound  to  provide  the 
contracting  officer  into  the  subcon¬ 
tract  management  process.  As  a  result, 
the  contractual  authority  for  the  AF 
was  to  become  more  aware,  and  active  if 
necessary,  in  this  process.  At  the 
same  time,  tne  subcontract  management 
plan  and  subcontract  management  clauses 
served  to  notify  the  contractor  that 
the  AF  was  becoming  very  serious  about 
Insuring  that  contractors  are  controlling  sub¬ 
contract  costs  on  major  programs. 

An  outgrowth  of  the  AFSC  interest 
in  this  area  was  a  study  conducted  by 
AFCMD  to  determine  how  the  Command 
could  improve  subcontract  surveillance. 
AFCMD  would  also  assess  the  extend  of 
and  exercise  influence  over  subcontract 
and  overhead  costs  in  the  development 
of  weapon  systems.  The  study  resulted 
in  development  of  the  following  changes: 

1.  A  Directorate  of  Subcon¬ 
tract  Management  at  Hq  AFCMD  was  estab¬ 
lished  to  centralize  all  tasks  related 
to  subcontract  management.  Similar 
organizations  were  established  at  the 
AFPROs  with  the  necessary  organiza¬ 
tional  structure,  resources,  and  exper¬ 
tise  to  apply,  when  necessary,  the 
"clout"  to  the  prime  contractor,  in  the 
management  of  his  subcontractors.  The 
AFPRO/SM  Division  was  to  be  responsible 
for  assuring  that  t’  contractor  com¬ 
plies  with  public  v  .w,  prime  contract 
terms,  and  sound  business  practices. 

To  this  end,  the  AFPRO/SM  Division 
would  use  a  formalized  systems  approach 
to  management  in  the  subcontract  area. 
(1:30) 

Up  to  that  point,  the  entire  SM 
approach  was  geared  toward  getting  a 
systems  evaluation  function  estab¬ 
lished  and  operating.  There  was  little 
emphasis  on  providing  direct  support  or 
assistance  for  individual  subcontracts 
in  support  of  the  program  office.  The 
reasoning  apparently  was  to  develop  a 
preventive  approach  (versus  reactive) 


to  solving  subcontract  management 
problems  in  the  prime's  procurement 
system.  The  problems  of  the  indivi¬ 
dual  subcontracts  would  be  left  to  the 
ACO  and  the  program  office  to  resolve. 

With  the  establishment  of  the  new 
AFCMD  organization  and  the  publication 
of  the  AFSC  ASPR  Supplement  for  sub¬ 
contract  management,  the  AF  began  to 
penetrate  the  prime's  subcontract  sur¬ 
veillance  process.  Government  offi¬ 
cials  would  now  be  more  aware  of  the 
prime's  actions  with  his  subcontrac¬ 
tors  and  would  continually  review  the 
prime's  procurement  system. 

During  1976,  several  independent 
studies  were  conducted  in  the  contract 
administration  area  which  took  a  hard 
look  at  SM.  The  first  was  the  DOD 
study.  Project  FORWARD  LOOK,  which 
attempted  to  forecast  oper  ttion  and 
resource  requirements  needed  to  accom¬ 
plish  the  CAS  mission  in  the  face  of 
an  ever-changing  procurement  environ¬ 
ment  and  declining  resources.  The 
principle  objective  of  the  study  was 
to  develop  improved  contracc  adminis¬ 
tration  procedures  that  would  optimize 
manpower  resources  for  performing 
essential  CAS  tasks. 

Since  subcontract  management  por¬ 
tions  of  the  CAS  functional  disci¬ 
plines  were  not  separated  in  the  user 
satisfaction  survey  from  the  actions 
paramount  to  the  prime  contractor,  it 
is  difficult  to  draw  positive  conclu¬ 
sions  about  SM  surveillance.  However, 
the  report  showed  a  substantial  dif¬ 
ference  in  the  level  of  satisfaction 
between  the  various  functional  areas 
whrch  affect  subcontracts.  Also 
reflected  in  the  survey  was  a  higher 
degree  of  satisfaction  in  the  area  of 
systems  review  than  in  the  area  of 
direct  support  to  the  program  offices. 

A  second  study  was  conducted  by 
AFCMD,  titled  Prioritization  of  Con¬ 
tract  Management  Tasks.  The  objective 
of  the  study  was  primarily  to  assist 
AFCMD  managers  at  all  levels  in  prior¬ 
itizing  their  work  and  allocating  Com¬ 
mand  resources.  The  SM  results  of  the 
study  were  as  follows: 

1.  There  was  substantial  dis¬ 
agreement  between  the  AFPROs  and  AFCMD 
on  what  should  be  emphasized  in  SM. 

2,  In  all  cases  excc-ric  SM, 
there  was  significant  agreement  on  the 
priority  of  the  AFPRO  tasks  between 
the  AFPROs  and  ths  SPOs.  In  the  SM 
area  many  specifics  were  cited,  but  in 
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general,  disagreements  stemmed  from 
differences  in  perspective.  At  the 
direction  of  Hq  AFCMD,  the  AFPRO/SM 
divisions  employ  a  "syotems-oriented" 
management  concept  while  the  SPOs  are 
more  "operations-oriented, “  SPOs  are 
more  interested  in  the  tasks  that  con¬ 
cern  direct  support  to  the  program 
office.  (2:86-7) 

In  all,  the  AFCMD  study  presented 
a  rather  unfavorable  picture  concerning 
the  health  of  subcontract  management, 
both  within  AFCMD  and  between  AFCMD  and 
the  product  divisions. 

At  the  direction  of  the  Commander, 
AFSC,  a  third  major  study  was  conducted 
in  1976  by  the  AFSC  Program  Management 
Assistance  Group  (PMAG)  to  find  ways  to 
improve  SPO/AFPRO  teamwork  effective¬ 
ness  in  AFSC  system  acquisition.  The 
PMAG  concluded  that  the  AFSC,  as  a 
whole,  and  Acquisition  (Product)  divi¬ 
sions  in  particular,  have  a  tendancy 
to  regard  the  Contract  Management  Divi¬ 
sion  as  a  separate  culture  from  Systems 
Acquisition.  This  separate  culture 
point  of  view  vas  resulted  in  educa¬ 
tional  and  tr  ..ling  deficiencies  for 
both  SPO  and  AFPRO  personnel  which,  in 
turn,  have  resulted  in  an  educational 
and  experience  gap.  This  situation  has 
had  a  major  impact  on  SPO/AFPRO  commu¬ 
nication,  perception,  and  teamwork. 
(3:37) 

Of  interest  to  this  study  are  the 
four  recommendations  which  addressed  AF 
subcontract  management  functions:  (1) 
issue  policy  letter  to  require  subcon¬ 
tract  management  in  Memorandums  of 
Agreement  (MOAs) ;  (2)  apply  resources 
and  emphasis  early  during  consent  deci¬ 
sion  phase  of  prime's  development  of 
subcontract  structure;  (3)  develop 
better  liaison  with  secondary  CAS  orga¬ 
nizations;  and,  (4)  issue  a  policy 
letter  requiring  SPOs  to  establish  or 
designate  a  focal  point  within  the  SPO 
for  subcontract  management.  (3:31) 

The  four  SM  recommendations,  while 
only  discussing  a  few  of  the  existing 
problems,  did  generate  further  AFSC 
Conmand  awareness  of  the  breadth  of  SM 
communication  problems.  These  were 
problems  which  ultimately  affected  the 
surveillance  phase  of  RDT&E  contracts 
for  multi-million  dollar  procurements. 

The  year  1976  was  a  banner  year  for 
DOD  and  AF  "reviews"  in  the  contract 
management  area  and  more  particularly 
the  area  of  subcontracts.  However, 
recommendations  for  improved  communica¬ 
tion  were  few,  and  actions  even  fewer. 


Before  discussion  of  the  changes 
which  are  occurring,  we  need  to  under¬ 
stand  how  AFCMD  accomplishes  the  sub¬ 
contract  management  task  today  through 
the  Contractor  Management  System  Evalu¬ 
ation  Program  (CMSEP).  This  program  is 
the  core  management  tool  for  all  of 
AFCMD  operations.  The  SM  portion  of 
the  program  provides  the  AF  the  ability 
to  continually  evaluate  the  contrac¬ 
tor's  management  of  his  procurement 
process  from  the  receipt  of  the  request 
for  proposal  for  the  prime  contract  all 
the  way  through  to  the  closeout  of  the 
subcontracts!  The  AFPRO/SM  staff  con¬ 
ducts  periodic  reviews  of  key  elements 
of  the  contractor's  procurement  systen 
throughout  the  year.  These  periodic 
reviews  form  the  basis  for  recommending 
approval  or  withholding  approval  of  the 
procurement  system  by  the  Principal 
Administrative  Contracting  Officer. 

When  deficiencies  are  found  in  the  pro¬ 
curement  system,  they  are  reported  to 
the  Air  Force  Plant  Representative 
(AFPR) ,  who  reports  the  findings  to  the 
company  chief  operating  official,  the 
affected  SPO  director,  and  AFCMD.  The 
notification  nuts  the  contractor  into 
action  to  correct  the  problem  and  lets 
the  SPO  director  know  there  is  a  prob¬ 
lem  at  his  plant.  Considerable  empha¬ 
sis  is  placed  on  correcting  deficien¬ 
cies  which  could  lead  to  management 
problems  and  increased  program  costs. 

Support  for  the  CMSE  Program  has 
varied  widely  throughout  the  Command. 

In  the  last  few  years,  AFSC  has  sup¬ 
ported  the  program  and  encouraged 
acceptance  and  use  of  CMSEP  reports  by 
the  SPOs.  However,  acceptance  of  the 
program  by  the  product  divisions  has 
been  slow  to  develop  and  in  many  cases 
CMSEP  has  caused  significant  animosity 
at  the  working  level.  Next  we  will 
discuss  these  varying  opinions. 

Hypothesis  1 

The  AFCMD/SM  Division  was  esta¬ 
blished  to  place  greater  emphasis  or. 
subcontract  management  and  reduce  defi¬ 
ciencies  in  the  prime  contractor's  pro¬ 
curement  system,  before  these  dcficien- 
could  lead  to  individual  subcontract 
problems.  Unfortunately,  this  was  not 
the  approach  which  the  systen  program 
offices  had  hoped  the  new  organization 
would  take.  The  SPOs  were  looking  for 
greater  visibility  into  their  subcon¬ 
tracts  ar.d  greater  support  for  the  pro¬ 
gram  office  from  the  AFPRO/SM  divi¬ 
sions.  Hq  AFCMD  had  directed  the 
AFPROs  to  follow  a  contractor  systems- 
oriented  approach  of  subcontract 
management.  Individual  subcontract 
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problems  continued  to  bo  addressed  by 
the  SPO  in  concert  with  the  ACO  and 
Defense  Contracts  Administration  Ser¬ 
vice  (DCAS)  elements  in  or  near  the 
subcontractor's  plant.  Also,  many 
major  program  offices  viewed  subcon¬ 
tract  management  during  this  time  as  an 
exercise  in  crisis  management. 

Although  many  of  the  APPRO  members  in 
SM  saw  clear  advantages  in  assisting 
the  SPO  wi  tli  its  subcontractor  prob¬ 
lems,  they  were  bound  by  AFCMD  to 
emphasize  systems  management.  Hence  in 
1974-1975,  the  AFPROs  were  literally 
caught  in  the  middle  of  a  struggle 
between  AFCMD  and  the  product  divi¬ 
sions,  whi ’ '  simultaneously  attempting 
to  servt.  botii  masters.  The  communica¬ 
tion  barriers  in  SM  between  AFCMD 
organizations  and  the  product  divisions 
were  at  their  apex.  There  was  an 
almost  total  lack  of  understanding 
between  the  parties  as  to  what  the 
other  was  attempting  to  do  in  SM. 

Also,  MOAs  for  the  most  part  were 
silent  concerning  SM  support.  This 
situation  was  especially  difficult  for 
the  product  divisions  to  accept  since 
by  its  very  existence,  an  AFPRO  is  a 
service  organization,  dedicated  to 
support  the  new  AF  development  program. 
Yet  AFPRO/SM  divisions  were  doing  what 
their  headquarters  desired  at  the 
expense  of  providing  direct  service  to 
the  SPO. 

Between  1975  and  1977  a.  dichotomy 
affecting  SM  appeared  within  the  Com¬ 
mand.  On  the  one  hand  we  saw  more 
involvement  in  subcontract  activities 
by  the  SPO  and  the  contracting  officer 
as  directed  by  AFSC  ASPR  Supp.  23-5000. 
On  the  other  hand  we  saw  less  involve¬ 
ment  by  the  AFPROs  as  directed  by  AFCMD 
Regulation  70-24,  Subcontract  Manage¬ 
ment  Program.  Although  not  formally 
recognized  in  AFSC,  this  dichotomy  has 
been  a  root  cause  in  fragmenting  the 
total  team  concept  for  SM. 

With  the  publi' 'tion  of  the  AFCMD 
Prioritization  of  ontract  Management 
Tasks  study  in  Juno  1976,  the  real  SM 
problems  within  AFSC  camo  to  light. 
Given  the  opportunity  to  state  their 
opinions  and  concerns,  the  AFPROs  and 
SPOs  clearly  showed  that  AFCMD/SM  and 
the  product  divisions  maintained  a 
divergent  perspective  from  that  of 
AFCMD  concerning  what  should  be  done. 
The  SPOs  would  have  to  reorient  their 
thinking  and  accept  the  AFCMD  systems 
approach  to  subcontract  management. 
Accordingly,  the  communication  prob¬ 
lems  and  lack  of  understanding  in  SM 
remained.  At  this  point  in  mid-1976, 
wo  saw  the  communication  barriers 


solidly  entrenched. 

We  will  now  look  at  what  appears  to 
be  a  changing  emphasis  within  AFCMD 
subcontract  management.  AFCMD  appears 
to  be  drifting  from  its  former  staunch 
approach  of  accomplishing  nothing  but 
systems  evaluation  to  one  of  performing 
systems  evaluation  and  accommodating 
program  office  needs.  This  charge  has 
resulted  in  a  strengthening  of  SM  rela¬ 
tionships  between  AFCMD  and  the  product 
divisions .  Let  us  now  examine  the  evo¬ 
lution  of  this  shift  in  emphasis  by 
reviewing  some  of  the  policy  changes 
which  occurred  in  1976-1977  and  the 
reasons  for  the  changes. 

As  a  result  of  AFCMDR  70-24  and 
the  Prioritization  of  Contract  Manage¬ 
ment  Tasks  study,  AFCMD/SM  became 
aware  that  the  entire  SM  program  was 
not  working  out  as  AFCMD  had  intended. 
Both  the  AFPROs  and  the  SPOs  were 
having  difficulty  accepting  the  priori¬ 
ties  of  tasks  outlined  in  the  regula¬ 
tion,  which  put  program  support  behind 
system  evaluation  and  literally 
directed  how  the  AFPRO  subcontract 
managers  would  do  their  job.  Feedback 
in  the  SM  area  obtained  as  a  result  of 
the  Prioritization  of  Contract  Manage¬ 
ment  Tasks  study  was  most  unfavorable. 
Likewise,  Command-wide  staffing  of  a 
proposed  revision  of  AFCMDR  70-24  in 
1976  also  brought  a  multitude  of 
recommended  changes  and  improvements. 
(4:1)  At  this  point  AFCMD/SM  recog¬ 
nized  it  had  to  make  some  effort  to 
bridge  the  communication  gap  with  the 
program  offices. 

Also  in  1976,  AFCMD  recognized  that 
the  CMSE  Program  was  maturing  and  that 
the  system  evaluators,  including  SM 
evaluators,  were  becoming  more 
efficient  in  reviewing  elements  of  the 
contractor 1 s  procurement  system. 
Documentation  procedures  and  periodic 
reviews  we re  taking  less  time,  and 
more  of  the  SM  evaluator's  time  now 
was  available  to  provide  direct  pro¬ 
gram  support  In  concert  with  the  ACO. 

In  July  1977,  AFCMDR  70-24  was 
revised  significantly  in  an  attempt  to 
eliminate  the  barriers  between  the  SPO 
and  AFPRO.  The  instructional  guidance 
and  priority  arrangements  which 
created  animosity  between  the  AFPROs 
and  SPOs  were  removed.  The  AFPR  was 
given  the  opportunity  to  become  more 
active  in  subcontract  manage-  nt  and 
was  directed  to  establish  his  own 
priorities  and  procedures  for  SM  acti¬ 
vities.  AFCMD/SM  had  recognized  that 
more  individualized  interface  with  the 
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program  offices  was  required  and  that 
the  AFPR  was  the  key  person  to  insure 
the  SM  interface  worked  effectively. 

In  subcontract  management,  the  AFPR 
could  now  become  more  accommodating  to 
the  desires  of  the  SPD  and  more  sensi¬ 
tive  to  his  needs  for  support.  Once 
the  CMSE  Program  was  functioning 
smoothly,  AFCMD  recognized  that  it 
should  permit  its  scarce  SM  resources 
to  concentrate  on  the  high  priority, 
critical  subcontracts. 

Hypothesis  2 

Now  let  us  look  at  some  of  the 
causes  for  misunderstandings  between 
the  SPO  and  AFPRO  concerning  what  is 
to  be  accomplished  in  SM.  We  know  that 
the  SPO  has  the  initial  action  to 
obtain  the  needed  subcontract  visibi¬ 
lity.  This  is  where  the  contracts  are 
written  with  the  appropriate  clauses 
to  insure  that  the  contractor  has  a 
Subcontract  Management  Plan  and  that 
he  interfaces  with  the  contracting 
officer  or  his  representatives.  This 
part  of  the  job  is  done  rather  well  in 
AFS,C  today.  Where  the  effort  begins 
to  weaken  is  in  the  initial  working  . 
relationships  with  the  AFPRO.  These 
good  relationships  must  begin  long 
before  contracts  are  awarded  or  MOAs 
are  executed.  There  must  be  an  open¬ 
ing  of  the  minds  early  in  the  program 
to  determine  what  is  required  during 
the  surveillance  phase.  The  MOA  is  the 
vehicle  whereby  the  SPO  makes  its 
desires  known  to  the  AFPRO.  It  is  the 
charter  wherein  proposed  SM  activity 
is  recorded.  Unfortunately,  experience 
shows  numerous  shortcomings  in  the  SM 
appendices  of  MOAs. 

It  is  also  necessary  to  examine  the 
position  of  the  product  division  in 
cementing  good  SM  relationships  early 
in  its  programs.  My  informal  survey 
revealed  there  is  little  dialogue 
between  the  product  division  and  AFCMD 
on  SM  support  to  the  program  offices. 
Further,  the  development  of  MOAs  is 
loft  strictly  to  the  SPO  and  AFPRO. 

One  product  division  SM  focal  point  said  ht 
does  not  even  know  or  see  the  agree¬ 
ments  which  are  worked  out  between  the 
two  parties.  As  a  result,  the  SPOs 
are  developing  their  SM  plans  for  CAS 
support  without  the  benefit  of  the 
product  division's  past  experiences. 

This  becomes  critical  when  one  consi¬ 
ders  the  small  number  of  SM  success 
stories  within  this  Command.  Hence 
we  continue  to  plod  along  with  SM  plan¬ 
ning  while  looking  at  the  same  type  of 
information  while  disregarding  the 
benefits  of  SM  innovations  developed 


by  other  SPOs.  There  appears  to  be  a 
meaningful  role  for  the  product  divi¬ 
sion  staff  in  the  development  of  MOAs, 
especially  in  SM.  Much  emphasis  is 
placed  on  program  documents  such  as 
Determination  and  Findings  and  Advance 
Procurement  Plans  which  have  much 
upward  visibility,  but  little  is  placed 
on  documents  with  lower-level  involve¬ 
ment. 

The  next  item  of  concern  is  the 
determination  by  the  SPO  of  what  it 
wants  to  be  accomplished  in  SM  during 
the  contract  surveillance  phase.  My 
review  of  nine  AFSC  MOAs  shows  that 
there  was  a  lack  of  knowledge  or  desire 
on  the  part  of  both  parties  to  iterate 
what  was  to  be  accomplished  in  SM,  or 
that  the  SPO  even  knew  what  it  wanted. 
In  fact,  four  of  the  MOAs  did  not  even 
address  subcontract  management.  Cur¬ 
rent  AFSC  policy  states  that  MOAs 
should  not  repeat  verbatim  instructions 
provided  in  other  documents  such  as 
ASPR  1-406.  They  should,  however,  be 
quite  specific  and  detailed  m  descrip¬ 
tions  of  the  functions,  methods  and 
interface  details  for  the  tasks  identi¬ 
fied.  The  MOA  should  bo  used  as  the 
vehicle  to  identify  and  assign  surveil¬ 
lance  activities  and  reporting  require¬ 
ments  for  the  AFPRO  and  SPO.  (5:23) 

We  are  not  complying  with  the  intent 
of  this  well-founded  and  necessary  AFSC 
policy.  Simply  stated,  the  SPOs  are 
not  putting  enough  words  in  the  SM  sec¬ 
tion  of  the  MOAs  to  clearly  express  to 
the  AFPRO  what  it  is  they  want  the 
AFPRO  to  accomplish.  If  the  parties  to 
the  MOA  cannot  succinctly  record  what 
is  to  be  accomplished,  there  is  little 
wonder  that  confusion  and  misunder¬ 
standing  result. 

Also,  personalities  and  experience 
play  a  significant  part  at  this  junc¬ 
ture.  A  program  manager  who  has  had 
experience  in  CAS  operations  will  be 
much  more  sensitive  to  the  AFPRO  situ¬ 
ation.  He  will  know  that  his  program 
is  not  the  only  one  in  the  plant  and 
therefore  must  be  closely  coordinated 
with  the  others.  Likewise,  the  AFPRO 
must  be  aware  of  the  program  manager 1 s 
experience  and  be  flexible  enough  to 
accommodate  his  actions  and  busy  TDY 
schedule. 

Still  another  area  of  concern  is 
the  role  of  the  AFPRO  during  the  pre- 
MOA  period.  Too  often,  the  AFFRO  is 
content  to  await  delayed  inquiries  from 
the  SPO.  If  this  situation  develops, 
the  AFPRO  should  begin  to  question  the 
SPO  concerning  the  planned  extent  of 
contract  administration  support  to  be 
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required.  This  should  get  the  program 
manager  thinking  and  force  discussions 
between  the  parties.  Also,  the  APPRO 
should  offer  suggestions  or  possible 
avenues  of  approach  to  the  SPO.  It 
should  tell  the  SPO  what  has  been  suc¬ 
cessful  in  the  AFPRO  on  previous  pro¬ 
grams  and  what  some  of  the  results  are. 
After  all,  the  APPRO  has  the  experi¬ 
ence.  This  approach,  although  some¬ 
times  overlooked,  could  provide  the 
catalyst  for  an  effective  and  smooth 
SPO/AFPRO  relationship  for  the  life  of 
the  program.  Thus,  before  being  corn- 
mi  tted  to  the  MOA,  each  party  would 
know  fully  the  thoughts  and  desires  of 
the  otii " 

Hypothesis  3 

As  AF  subcontract  management  pro¬ 
fessionals,  how  well  are  we  recording 
our  experiences  for  those  programs 
which  are  to  follow?  Are  we  retaining 
the  SM  corporate  memory  and  using  it  to 
the  advantage  of  the  program?  I  be¬ 
lieve  we  are  doing  an  inadequate  job  in 
the  SM  area,  which  is  leading  to  unnec¬ 
essary  subcontract  dollar  expenditures 
on  our  major  weapons  programs.  Retain¬ 
ing  a  good,  SM  corporate  memory  has 
been  difficult  because  there  are  no 
known  regulations  or  higher  authority 
requiring  us  to  do  so.  As  mentioned  in 
the  discussion  on  Memorandums  of  Agree¬ 
ment,  we  move  from  one  program  to  the 
next,  taking  but  a  few  of  the  good  SM 
lessons  learned.  The  situation  becomes 
a  vicious  circle,  because  the  MOAs 
understandably  will  be  weak  in  the  SM 
appendix  if  there  is  not  a  strong  cor¬ 
porate  memory  dictating  what  should  be 
perpetuated  in  the  MOA. 

For  a  moment,  let  us  review  why  the 
the  corporate  memory  issue  has  been  so 
elusive  for  SM.  The  SM  corporate  mem¬ 
ory  has  been  weakened  primarily  by 
three  factors:  lack  of  personnel  expe¬ 
rience  and  expertise;  lack  of  emphasis 
placed  upon  subcc  -.ract  management  by 
the  product  divi  ,ons;  and,  apathy 
toward  SM  on  the  part  of  the  SPOs. 

In  the  first  instance,  the  person¬ 
nel  aspect  takes  many  forms.  There  is 
a  definite  lack  of  personnel  with  SM 
experience  of  any  kind  operating  within 
the  SP03 .  This  is  understandable  since 
most  of  thn  SM  activity  within  DOD  is 
conducted  oithor  by  civilian  ACOs,  pro¬ 
curement  methods  analysts,  or  assis¬ 
tant:.  for  subcontracts  in  the  AFPROs. 
Further,  civilian  personnel  within  CAS 
tend  to  transfer  within  that  community 
and  not  into  the  buying  offices. 
Accordingly,  there  is  also  a  lack  of 


personnel  experienced  in  SM  operations 
working  on  the  product  division  staffs. 
Many  have  worked  the  procurement  pro¬ 
cess  but  few,  if  any,  routinely  have 
worked  SM  problems.  Also,  key  civil¬ 
ian  personnel  within  both  AFCMD  and 
AFSC  SM  functions  within  the  Command 
have  been  lost  to  transfer  or  promo¬ 
tion  within  the  past  year. 

The  second  reason  for  a  weakened 
corporate  memory  is  the  fact  that 
within  the  product  divisions  today,  SM 
ic  treated  as  an  additional  duty.  This 
is  somewhat  surprising  when  one  consi¬ 
ders  the  millions  of  dollars  spent  each 
year  by  that  division  on  subcontracted 
effort.  Although  the  product  divisions 
have  taken  an  active  and  appropriate 
role  in  insuring  that  contracts  con¬ 
tain  the  current  SM  clauses,  they  have 
done  little  to  assist  the  SPOs  in 
insuring  that  the  SM  process  is  run 
effectively  and  that  the  interface 
with  AFCMD  is  running  smoothly. 

The  last  area  is  the  need  for 
emphasis  to  be  placed  upon  SM  by  the 
SPO.  In  many  cases,  the  SPOs  do  not 
know  what  needs  to  be  accomplished  in 
SM.  Also,  SM  problems  tend  to  be  over¬ 
shadowed  by  more  important  SPO  issues 
such  as  system  engineering  changes, 
test  program  difficulties,  and  funding 
limitations.  Therefore  SM  considera¬ 
tions  usually  receive  less  attention 
than  others  unless  there  is  a  catas¬ 
trophic  subcontract  failure. 

Several  possibilities  for  accom¬ 
plishing  the  restoration  of  SM  corpo¬ 
rate  memory  exist.  The  best  SM  corpo¬ 
rate  memory  within  AFSC  today  rests 
with  the  AFPROs.  Here  is  where  AFCMD 
has  stored  the  wealth  of  its  subcon¬ 
tract  experts  who  have  been  dealing 
with  prime  contractors  (in  many  cases 
the  same  contractor)  for  years.  As 
mentioned  in  the  MOA  discussion,  these 
are  the  experts  Who  know  what  proce- 
i  dures  worked  with  a  specific  contrac- 
1  tor  in  the  past.  The  SPOs  must  solicit 
the  knowledge  of  these  valuable  AF 
resources  to  prevent  the  pitfalls  of 
previous  programs,  along  with  the  pair, 
and  cost  of  correcting  these  mistakes. 

AFCMD  has  a  responsibility  to  share 
among  the  AFPROs  the  le/eons  learned 
by  each  individual  AFPRO.  AFCMD  has 
been  loss  than  forceful  in  this 
endeavor.  As  mentioned  earlier,  pri¬ 
mary  AFCMD  emphasis  has  be^r  toward 
systems  management.  Understandably, 
the  distribution  of  SM  lessons  learned 
within  AFCMD  has  dealt  primarily  with 
systems  management.  With  the 
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satisfactory  implementation  of  CMSEP 
throughout  the  Command,  emphasis  may 
shift  more  toward  direct  program  sup¬ 
port. 

Also,  the  product  divisions  and 
AFCMD  should  establish  a  dialogue  at 
the  division  headquarters  level  to 
discuss  what  has  worked  well  in  SM 
direct  program  support  in  the  past. 

The  author  recognizes  that  this  action 
might  be  more  idealistic  than  realistic 
since  the  two  headquarters  staffs  would 
have  to  overcome  previous  opinions 
concerning  the  other's  approach  to  SM. 
According  to  the  PMAG  study,  the 
parties  will  have  to  set  aside  precon¬ 
ceived  barriers  which  inhibit  effec¬ 
tive  communication.  (3:14)  Neverthe¬ 
less,  a  complete  and  free-flowing  dia¬ 
logue  in  the  form  of  a  workshop  (versus 
formal  briefings)  would  create  the 
necessary  catalyst  needed  at  this  level 
to  retain  the  SM  corporate  memory.  The 
emphasis  should  be  on  how  the  opera¬ 
tions  can  reduce  the  program  risk  and 
increase  the  subcontract  visibility  for 
the  program  managers. 

The  product  divisions  must  iden¬ 
tify  the  SM  success  stories  and  innova¬ 
tive  techniques  being  employed  today 
within  their  divisions  and  spread  the 
word  to  the  newly- formed  SPOs.  They 
must  take  an  active  part  in  soliciting 
this  information  from  the  SPOs. 

I  have  presented  four  alternatives 
to  assist  in  restoring  the  corporate 
memory.  Implementation  of  any  of  these 
alternatives  would  assist  the  SM  commu¬ 
nication  throughout  the  Command. 

Conclusion 

In  conclusion,  we  have  seen  the 
need  for  greater  subcontract  visibility 
by  the  AF  program  manager,  since  visi¬ 
bility  is  the  key  to  avoiding  costly 
overruns.  In  AFSC,  visibility  has  been 
inhibited  by  poor  SM  communication  as 
shown  by  the  hypotheses.  To  obtain  the 
necessary  visibility,  the  prime  con¬ 
tractor  must  provide  timely  and  effec¬ 
tive  management  in  its  contractual 
dealings  with  its  vendors.  Likewise, 
the  AFPRQ/SPO  team  must  use  all  the 
resources  and  ingenuity  available  to 
influence  or  assist  the  prime,  when 
necessary,  without  violating  the 
privity  of  contracts  principle. 

The  analysis  of  Hypothesis  1  ha3 
presented  a  shift  in  emphasis  by  AFCMD 
toward  greater  involvement  in  gaining 
SM  visibility.  This  has  been  manifes¬ 
ted  in  AFCMDR  70-24  which  now  permits 


the  AFPR  more  flexibility  in  support¬ 
ing  the  program  managers.  Today  there 
is  a  better  atmosphere  of  mutual  under¬ 
standing  and  communication  in  SM 
between  the  AFPRO  and  SPO  than  ever 
before.  The  previous  trend  of  erosion 
of  direct  SM  support  has  turned 
around.  However,  the  SPOs  must  take 
more  positive  action  in  making  known 
their  desires  for  subcontract  adminis¬ 
tration  support  from  the  AFPROs. 

Hypothesis  2  shows  that  the  pro¬ 
gram  office  has  taken  a  passive  and 
sometimes  apathetic  attitude  toward 
SM  and  has  become  involved  only  when 
a  subcontracting  crisis  occurs.  Lack 
of  SPO  personnel  experienced  in  SM 
activities  and  constant  reliance  upon 
the  AFPRO  have  been  contributing  fac¬ 
tors  influencing  this  attitude.  This 
attitude  is  further  demonstrated  by 
the  unenthusiastic  manner  which  the 
SPO  and  product  division  staffs  exhi¬ 
bit  in  dealing  with  the  SM  appendix  of 
the  MOA. 

The  Hypothesis  3  analysis  concluded 
that  the  product  divisions  have  not 
retained  a  good  SM  corporate  memory 
and  hence  cannot  provide  meaningful 
SM  experiences  to  the  developing  SPO. 

The  Hypothesis  conclusions  sub¬ 
stantiate  the  existence  of  communica¬ 
tion  barriers  in  AFSC/SM  operatings 
and  represent  what  I  believe  are  the 
three  major,  contributing  factors 
inhibiting  effective  SM  communication 
in  AFSC  today. 
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BUYING  COMMERCIAL  ITEMS 


USING  OFF-THE-SHELF  COMPETITION  TO  UFJIUCE  THE  COST  OF  GOVERNMENT 

George  S.  Ostroweki,  Don  Sowla  Associates,  Inc. 
Arlington,  Virginia 


INTRODUCTION 


Ttiia  paper  focuses  on  policies  and  practices 
of  the  Federal  Government  in  the  purchase  of 
commercial  products.  These  are  the  thousands 
of  products  bought  and  used  every  day  by  the 
general  public,  industry,  and  nonprofit  organ¬ 
izations,  as  veil  as  by  the  Government.  The 
thesis  is  that  most  of  the  Government's  needs 
for  commercial  products  can  be  acquired  more 
effectively  and  cheaply  by  relying  primarily 
on  "off-the-shelf  competition"  than  on  solici¬ 
tations  based  on  Government  specifications. 

As  a  result  of  the  language  used  in  Federal 
procurement  statutes  and  the  implementing 
regulations,  it  ha3  become  traditional 
practice  in  Government  to:  Determine  its 
needs.  Describe  them  by  writing  ourchase 
specifications  in  such  a  way  tha<  any  poten¬ 
tial  supplier  can  produce  the  item.  Request 
bids  or  proposals  for  products  that  meet  the 
description.  Award  a  contract  t'-  the  supplier 
offering  the  lowest  price. 

The  practice  works  well  for  spec!  il  needs,  but 
it  is  a  costly  way  to  buy  product i  that  are 
readily  available  on  the  commercial  market. 

In  addition  to  the  cost  of  the  process,  the 
result  is  a  hodgepodge  of  products  made  or 
modified  to  just  barely  meet  the  Government 
specification.  This  "competition  by  specifi¬ 
cation"  is  also  limited  to  firmB  that  are. 
willing  to  compete  in  this  manner. 

The  problem  has  been  recognized  in  many 
Government  studies  including  that  made  by  the 
Congressional  Commission  on  Government 
Procurement.  As  a  result  of  the  Commission's 
findings,  the  Office  of  Fedaral  Procurement 
Policy  (OFPP) ,  Office  of  Management  and  Budget 
(MB) ,  Issued  a  Federal  procurement  and  supply 
policy  requiring  that:  "The  Covcrnm*;. t  vij) 
purchase  cOssaerclal,  off-the-shelf,  pro 
when  such  products  vill  adequately  \  the 
Government's  requirements,  provided  such 
products  have  an  established  commercial  market 
acceptability.  The  Government  rf.l  utilize 
commercial  distribution  channel;*  m  supplying 
commercial  products  to  its  uaaro." 

But  how  do  you  buy  off-the-shelf  produces 
using  timeworn  Government  purchase  methods? 

The  Department  of  Defense  has  established  a 
"Commercial  Cotaodity  Acquisition  Program" 
fCCAP)  to  find  the  answer  to  this  question. 


One  difficult/  ii:  finding  the  answer  is  the 
Government ' e  concept  of  competition.  It  is 
gfaer.illy  referred  to  as  "adequate  price 
competition."  Guidelines  in  procurement 
directives  to  obtain  price  competition 
require  offers  that  are  responsive  to  a 
solicitation  specifying  or  describing  i 
minimum  Government  need.  Therefore,  many 
Federal  officials  still  insist  that  negotia¬ 
tions  based  on  prices  established  in  the 
marketplace  for  off-the-shelf  products  do  no- 
meet  the  Government’s  concept  of  adequate 
price  competition.  The  result  is  continuation 
of  the  complex  and  costly  specification 
system  for  many  products  that  could  more 
effectively  he  purchased  off-the-shelf. 

However,  a  few  Government  activities  have 
established  prepriced  contractual  arrangements 
with  multiple  sources  on  the  basis  of  estab¬ 
lished  catalog  or  market  prices.  These 
arrangements  cover  off-the-shelf  products  (or 
selection  to  fit  the  need  at  the  11321  level. 

We  believe  that  provision  should  be  made  in 
procurement  statutes  and  directives  to  use 
off-the-shelf  competition  as  a  primary  method 
of  purchasing  commsrcial  products.  Consolida¬ 
tion  of  requirements  for  competition  by 
specification  would  only  Be  used  when  warrant¬ 
ed  by  significant  total  cost  benefits. 

Let  us  now  review  the  needs  of  Government 
uasrB  for  commercial  products  and  compare 
"competition  by  specification"  versus  "off- 
the-shelf  competition"  in  meeting  these  needs. 


SATISFACTION  OF  THE  USER'S  NEED 


Tht  primary  purport  ot  Government  procurement 
and  distribution,  systems  is  to  provide  the 
ultimate  user  with  the  supplies,  equipment, 
and  services  required  to  accomplish  a  Job  or 
fulfill  a  need. 

There  arc  many  users,  especially  in  the 
Depar&icpt  of  Defense  that,  by  the  nature  or 
complexity  of  the  equipment  they  need  and  the 
way  it  has  to  be  supported,  must  be  provided 
with  products  of  special  design  or  that  must 
be  of  standard  configuration.  But  most  Gov¬ 
ernment  users  arc  engaged  in  functions  with 
needs  that  are  similar  or  identical  to  those 
outside  the  Government.  These  are  the 
commercial  product  users. 
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A  survey  of  commercial  product  users  y  »  . 
Commit  ton  on  Government  Prccuremen'.  tr 
chat  their  greatest  concern  is  for  ■ 

sui tabillty.  responsive  deli'  etc.  S'  <■'  >  : 
simplicity.  Users  invariably  <_c. r-o 
ment  procurement  and  support  of  cob''--1-'  * 
products  with  their  own  ability  to  buy  ",.e 
same  kinds  of  items  and  uervices  on  fr 
commercial  market  for  their  own  person* .  use. 
Even  though  they  become  resigned  .  0  to.- 
"system"  within  which  they  must  functi,  .  they 
are  not  satisfied  unLess  their  needn  • 
more  efficiently  and  economically  thai  t.:>  y 
believe  they  could  do  for  them- elves. 

Many  items  are  bought  by  the  Government  that 
are  not  suitable  for  a  wide  ra-  ?.e  of  intended 
purposes.  Those  items  are  not  used  effective¬ 
ly  and  mary  are  disposed  of  as  surplus  without 
ever  having  been  used.  Where  usar3  know  what 
off-the-shelf  products  are  available  that  will 
best  fill  their  needs,  product  suitability  is 
an  important  consideration. 

The  most  critical  need  for  responsiveness  is 
in  parts  and  supplies  needed  in  maintenance 
where  requirements  cannot  be  predicted.  How¬ 
ever,  in  filling  any  need,  where  the  user 
knows  chat  a  suitable  item  is  available  from 
a  local  commercial  outlet,  delays  occasioned 
by  a  lengthy  purchasing  or  requisitioning 
p  ocess  are  irritating  and  costly.  Yet  the 
Government  has  esta,  . i3hed  huge  depot  and 
distribution  system:  Cvf  commercially  avail¬ 
able  items  that  only  involve  sporadic  Govern¬ 
ment  demands. 

Most  users  know  what  they  need  and  can  easily 
communicate  this  requirement  to  a  colleague, 
but  they  have  difficulty  in  describing  the 
need  to  the  procurement  community  for  purchase 
action.  This  problem  lies  with  Government 
procurement  requirements  for  specifying  needs 
so  that  any  potential  supplier  can  respond  by 
offering  a  product  that  will  meet  the  speci¬ 
fied  need.  But  products  made  for  the  market¬ 
place  differ  in  form,  function,  and  quality. 

The  users  believe  they  know  (.by  experience  or 
profession)  the  products  .a  the  marketplace 
that  can  .best  satisfy  t.heir  needs;  but  procure¬ 
ment  requires  a  nonre-  .ictivo  description  of 
minimum  Government  net j  to  colicit  offers  from 
all  potential  suppliets. 


COMPETITION  BY  SPECIFICATION 


General  policy  on  the  use  of  specifications 
and  purchase  descriptions  is  provided  in 
ASPR  1-liOO  nnd  in  FPR  1-1.305.  General 
policy  is  th-u  Federal  and  military  specifica¬ 
tions,  as  well  as  industry  documents  adopted 
by  the  Government,  are  mandatory  in  cwe 
procurement  of  supplies  and  service-.-!  covered 
ty  such  spec-  tcntlon8. 


The  term  "adequate  price  competition" 
referred  to  in  the  statutes  as  "full  nnd  free 
competition."  In  ASPR  3-807  and  FPR  1.2-807, 
Pricing  Techniques,  the  term  is  further 
defined  as  something  that  exists  when  (i)  at 
least  two  responds  *  o  offerors  (ii)  who  can 
satisfy  the  purchaser's  (c.g.,  the  Govern¬ 
ment's)  requii  ements  (ill)  independently 
contend  for  a  contract  to  be  awardei  to  the 
responsive  and  responsible  offeror  submitting 
the  lowest  evaluated  price  (iv)  by  submitting 
priced  offers  responsive  to  the  expressed 
requirements  of  the  solicitation. 

Compliance  with  these  directives  is  achieved 
by  solicitation  of  bids  or  proposal  i  from  all 
prospective  suppliers  to  furnish  prjducts 
.list  meet  the  need.  The  supplier  submitting 
the  lowest  priced  item  is  generally  awarded 
the  contract  without  comparing  /alue  of 
products  offered.  Although  the  cor. -ept  is 
straight-forward,  the  most  lraporta.it  factor 
is  item  price  with  little  consideration  for 
total  coat  to  the  Government. 

The  procurement  process  is  part  of  total  cost. 
It  includes  an  inordinate  effort  in:  Quanti¬ 
fying  requircra&nts.  Developing  specifica¬ 
tions  or  purchase  descriptions.  Soliciting 
bics  or  proposals.  Evaluating  offers.  Making 
awards.  And  managing  the  resultant  contract 
to  assure  delivery  of  products  meeting  the 
specification  or  description. 

In  addition  to  the  administrative  cost  and  the 
delays  in  delivery  occasioned  by  complexity  of 
rise  process,  other  actions  occur  that  further 
Increase  total  costs.  Since  the  process  is 
recognized  by  management  as  costly,  and 
economy  of  scale  is  assumed,  there  is  a  strong 
tendency  to  reduce  duplication  by  centralizing 
the  function  and  consolidating  requirements 
for  many  activities.  Computing  stock  require¬ 
ments  in  anticipation  of  requisitions  fre¬ 
quently  result  in  huge  surpluses.  Estimation 
and  computation  of  needs  for  many  activities, 
of  a  single  product,  takes  months. 

When  development  of  a  new  product  specifica¬ 
tion  or  description  is  required  it  may  take  a 
year  or  two  from  identification  of  a  need  to 
providing  procurement  with  a  complete  purch.  se 
request.  The  contracting  process  can  also 
take  a  year  or  mor*  due  to  delays  In  complying 
with  administrative  requirements,  particularly 
if  protests  must  be  answered.  All  this  cost 
nnd  time  i3  considered  to  be  a  normal  require¬ 
ment  of  the  process  as  dictated  by  Congress. 
There  is  no  ac'V'vnnlug  (<•..  the  cost  to  the 
taxpayer  or  relationship  of  total  costs  to 
benefits  in  using  the  concept  of  "competition 
by  specification"  in  purchase  of  commercial 
products. 
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OFF-THE-SHELF  COMPETITION 


An  alternative  o  the  Government  process  of 
"competition  by  specification"  is  "off-the* 
snelf  competition"  for  commercial  products. 

The  basic  difference  in  the  two  concepts  is 
that  instead  of  asking  industry  to  offer 
products  meeting  a  Governmsnt  specification  or 
description,  the  Government  act*  as  another 
customer  for  privately  designed  and  developed 
products  currently  offered  by  industry  in  the 
marketplace.  Th  i  is  now  done  by  the  Govern¬ 
ment  in  making  small  purchasva,  in  emergencies, 
and  in  several  other  indefinite  delivery 
contract  arrangements  that  ars  not  expressly 
provided  for  in  the  ^iocurement  statutes  or 
implementing  dlre<  tives. 


•  Air  Force  Buy  ll.S.  Here  QUIMI)  1‘cogiam . 

Ms  program  was  instituted  In  1962  to  provide 
DOD  activities  located  overseas  with  many 
off-the-shelf  products  covered  by  Federal 
Supply  Schedules  in  the  United  States.  The 
contracts  art  limited  to  those  U.S.  firms 
that  havt  over Jess  distribution  systems  and 
can  delivtt'C  and  service  U.S.  made  products  to 
overoeas  activities  more  effectively  and 
economically  than  if  the  items  were  obtained 
from  the  United  States  through  Government 
distribution  chattels.  The  solicitation, 
negotiation  and  contracting  practices 
established  by  tnc  Air  Force  for  tills  program 
ara  similar  tc  those  used  in  the  Federal 
Supply  Service  multiple-award  schedule 
program. 
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Die  following  programs  are  cited  as  examples 
of  where  off-the-shelf  items  ara  bought  with¬ 
out  use  of  product  specif icationa  by  negotia¬ 
ting  discounts  from  established  market  prices. 

*  Federal  Supply  Service  multiple-award 
schedule  program.  Tins  program  was  initiated 
by  the  Treasury  Department  over  50  years  ago. 
It  consists  of  a  pricing  arrengemer t  with  each 
manufacturer  or  supplier  that  sells  commercial 
products  In  the  marketplace  who  will  provide 
there  same  products  to  any  Government  ordering 
acti  ’Ity  at  an  agreed  upon  price.  The  value 
of  orders  under  this  program  for  fiscal  1977 
was  SI. 5  billion. 

Initial  solicitation  Is  for  offers  of  entire 
lines  of  off-the-shelf  products  at  a  discount 
from  established  cat-’og  or  market  prices. 

The  offers  are  evali  .ed  and  negotiations  are 
conducted  with  each  Mrm  that  has  a  product 
Che  Government  may  need  during  the  contract 
period.  Awatd  criteria  is  a  price  objective 
(benchmark)  determined  appropriate  by  the 
buyer  in  consideration  of  the  anticipated 
volume  of  Government  business  and  the  range 
of  discounts  offered  by  competitors  for  the 
same  range  of  products.  The  resulting 
contracts  are  made  available  to  every  Govern¬ 
ment  activity  for  ordering  needed  items 
directly  from  the  supplier  without  furthar 
negotiation.  These  using  activities  select 
the  lowest  priced  item  that  will  fill  their 
needs  from  the  multiple  sources  on  contract. 

•  Department  of  Defense  feed  supply  bullatis 
program.  This  program  is  very  similar  to  the 
Federal  Supply  Schedule  Program  but  It  is  for 
processed  food*  that  are  purchased  for  resale 
through  Department  of  Defense  Commtaasriea. 

The  solicitation  procedures,  negotiations, 
and  resulting  contracts  may  differ  from 
multiple-award  Federal  Supply  Schadulea,  but 
the  concept  of  using  off-the-shelf  competition 
as  a  basis  for  contract  pricing  Is  tha  same. 


K  -TIPLE-SOURCE  CONTRACTING  AUTHORITY 


The  FSS  citep  f-ction  302(c) (!0)  of  the 
Federal  Property  and  Administrative  Services 
Act  as  authority  to  negotiate  multiple-award 
Federal  Supply  Schedules.  This  exception  to 
formal  advertising  is  "for  property  or 
services  for  which  it  is  impracticable  to 
secure  competition."  An  identical  exception 
Is  included  In  the  Armed  Services  Procurement 
Act. 

Examples  of  when  this  authority  may  be  used 
aro  given  in  the  Federal  Procurement  Regula¬ 
tions  (FPR)  and  the  Armed  Services  Procure¬ 
ment  Regulation  (hSPR)  .  These  examples 
Include  cases  where  the  supplies  or  services 
can  be  obtained  from  only  one  person  or  firm 
"sole  source"  and  when  it  is  impossible  to 
draft  adequate  specifications  or  purchase 
description;!  for  a  solicitation  for  bids. 

Unfortunately  the  weaning  of  this  exception 
and  the  examples  for  its  use  convey  the 
impreseion  that  "competition"  is  not  feasible 
when  using  this  authority.  Even  the  i’Sr 
refers  to  single-award  schedules  •  '.,-ietl- 
tive,  inferring  that  multiple-award  .  •  t.)es 
are  noncompetitive.  But  those  ranna>  iny  the 
multiple-award  program  recognize  it  a*,  eing 
based  on  off-the-shelf  competition  with  two 
additional  competitive  steps  achieved,  one  in 
the  process  of  contract  negotiations  and  me 
in  product  selection  at  point  of  use. 

Multiple-source  contracts  come  under  a  type 
of  contract  defined  in  the  FFI.  and  ASPR  as 
"indefinite  delivery."  These  ore  prepriced 
arrangements  for  s  period  of  time  where  the 
quantity  is  either  indufinite  or  Is  dependent 
on  Government  needs.  However,  the  FPR  and 
ASPP.  do  not  provide  for  c-.ltiple-source 
indefinite  delivery  contracts.  Instructions 
are  provided  In  the  directives  for  placing 
orders  against  multiple-award  FSS  schedules 


but  oven  there  the  ASPR  indicates  that  non- 
mandatory  FSS  schedules  are  to  be  considered 
"another  source  of  supply." 


MEETING  TOE  USERS  NEED 


The  criteria  for  commercial  product  evaluation 
must  be  based  on  satisfaction  of  the  user's 
need.  Accoidlngly,  suitability  of  the  product 
for  i ts  intended  use  and  responsive  delivery 
must  be  considered  along  with  ordering 
simplicity.  Simplified  small  purchase  proce¬ 
dures  :re  currently  provided  for  by  statute 
and  pt'orurcreai.  directives  for  purchases  under 
$10,000.  ".ovecui  in  attempts  to  reduce  the 
number  of  individual  purr  late  action*  by 
Government  activities  these  purcbcaea  are 
limited  to  items  that  are  not  easily  provided 
by  a  central  depot  type  ac.ivity.  Small 
purchases  madr-  at  the  point  of  use  can  be 
accomplished  quickly  and  effectively  without 
development  of  detailed  specif icatior.a .  But 
when  small  purchases  arc  consolidated  to 
exceed  $10, 000,  they  must  follow  the  procure¬ 
ment  process  for  competition  by  specification. 

As  the  size  of  the  purchase  increases  so  does 
the  cost  of  the  proceag  and  the  expectation  of 
being  offered  off-the-shelf  products  lo 
reduced.  The  cost  of  the  process  increases 
due  to  the  time  involved  in -estimating  and 
consolidating  requirements,  preparing  more 
detailed  specifications,  using  greater  care  in 
technical  evaluations,  and  in  debriefing  of 
unsuccessful  offerors.  T.ve  product  offered  In 
response  to  a  solicitation  may  be  an  off-the- 
shelf  Item  if  one  is  readily  available  that 
meets  the  specification.  But  if  the  size  of 
the  o-der  is  large  enough  for  separate 
production,  a  modified  version  of  the  off- 
the-shelf  item  that  barely  meets  the  speci¬ 
fication  will  most  likely  be  offered.  There 
is  no  assurance  that  the.  -item  offered  has  the 
same  quality,  reliability  or  features  of  its 
commercial  counterpart.  When  the  quantity  is 
large  enough  the  solicitation  also  eucourages 
bids  or  proposals  from  firms  Chat  do  not  make 
that  particular  item  for  calc  in  the 
commercial  marketplace.  .hus  evaluation  of 
products  offered  becomet  increasingly  diffi¬ 
cult  as  the  quantity  procured  increase* ,  and 
the  potential  problem  in  maintaining  the 
Item  also  increase.  Attempts  to  solve  this 
problem  by  using  performance  typo  specifica¬ 
tions  are  hampered  by  luck  of  credible 
procedures  In  comparing  the  value  of  items 
offered  on  large  quantity  purchases  of 
commercial  products. 

The  prog’ans  cited  as  examples  of  using  off- 
iho  m|io|'  o»ipet  1 1  Ion  In  purehsse  cf 
Oinwiai'  lai  i'lodnvltt  all  I'nuult  In  multlpl, 
source  riuisteirta.  rhusv.  contractu  represent 
the  range  <>1  pioducts  and  services  that  the 
contra-  ting  officer  believes  will  b«  needed 


during  the  contract  period.  They  are  all 
sold  In  substantial  quantities  to  the  general 
public.  They  have  met  the  test  of  the 
marketplace  for  quality  and  reliability.  They 
are  not  modified  to  meet  a  minimum  government 
specification.  They  represent  various 
quality  levels  as  needed  in  the  marketplace. 
Government  users  are  familiar  with  these 
products  through  their  own  private  use  or  by 
keeping  up  with  technology  as  part  of  their 
professional  or  technical  interests.  These 
are  the  products  that  are  referenced  in  trade 
journals  and  are  used  by  the  industry  counter- 
pa.  ,.  t"  the  Government  technician.  They 
represent  the  .atest  technology  in  consumer 
products  with  attendant  benefits  of  the 
latest  consumer  product  safety  reoulrements. 

When  the  user  (professional  or  technician) 
prepares  a  request  for  a  commercial  product 
he  irtll  identify  those  items  that  he  is 
familiar  with  and  knows  that  their  quality  and 
featuros  meet  his  needs i  When  multiple 
source  contracts  have  already  been  establish¬ 
ed  for  these  product  lines  the  user  can 
contact  the  local  purchasing  office  for 
information  on  those  items  covered  by  contract, 
lie  may  then  select  the  lowest  priced  item 
f  ,et  fills  his  needs.  The  purchase  request 
can  then  cite  the  item  by  manufacturers 
description  or  model  designation  without 
development  of  a  specification.  If  other 
than  the  lowest  priced  item  Is  requested  it 
must  be  justified  by  the- user.  The  requesting 
process  is  responsive,  simple,  and  easily 
understood  by  users. 

Tnere  is  much  concern  by  managers  of  central¬ 
ized  buying  activities  that  central  control  is 
lost  when  user  activities  are  authorized  to 
select  products  to  fit  their  needs.  They 
believe  chat  users  will  select  a  greater 
capacity  or  quality  than  they  need.  Ibis 
may  sometimes  occur  but” with  less  frequency 
than  when  selection  is  far  removed  from  the 
point  of  use.  In  fact,  central  buying  by 
specification  results  in  standardization  that 
exceeds  the  need  of  all  those  users  below  the 
scondatd  and  those  with  needs  above  the  stan¬ 
dard  will  not  use  the  Item  anyway. 

The  activity  purchase  office  can  quickly  place 
a  delivery  order  against  a  multiple  source 
contract  on  a  one  page  form.  Many  companies 
provide  for  these  orders  to  be  placed  with  a 
local  retail  outlet  for  more  responsive 
delivery  and  customer  service.  In  fact  the 
purchasing  office  can  even  place  the  order  by 
telephone  and  confirm  it  by  the  one  page 
delivery  order.  The  responsiveness  of 
delivery  in  as  fast  ns  the  user  would  receive 
if  ho  made  the  purchase  far  his  own  use. 

When  users  feel  that  they  are  a  part  of  the 
selection  process  thov  are  less  trained  to 
find  fault  with  the  resulting  pro-hot  but  this 
Js  not  the  only  benefit  when  purchasing  off- 
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the-shelf  items.  Multiple  source  contracts 
are  designed  to  use  the  commercial  diatribu- 
tion  system  so  there  is  no  Government  stock 
to  become  obsolete,  pilfered  or  lost. 
Deliveries  are  made  from  the  same  stock  that 
serves  industry  and  the  general  public  so  the 
product  not  only  meets  quality  requirements 
of  the  marketplace  but  it  probably  comas  with 
a  commercial  warranty.  Further,  the  level  of 
quality  needed  for  a  particular  application 
can  be  selected  since  the  entire  line  of  each 
source  is  prepriced  by  discount  from  market 
prices. 


The  basic  multiple  source  contract  does  not 
assure  any  sales  so  the  companies  must  compete 
with  one  another  continuously  during  the 
contract  period.  If  service  is  poor  or  product 
quality  drops  for  any  company  they  will  no 
longer  be  competitive.  And  fortunately  the 
Government  is  not  "locked  in"  on  a  long  term 
contract  arrangement  for  large  quantities. 


COST  AND  PRICE 


One  of  the  assumptions  of  the  Goverrttent  la 
that  any  reduction  in  unit  price  achieved  by 
making  large  quantity  purchases  la  a  savings. 
Since  there  is  no  accounting  for  efforts 
expended  in  consolidating  requirements,  pre¬ 
paring  specifications,  solicitation,  inspect¬ 
ion,  warehousing,  distribution,  and  management 
of  these  activities,  theae  costs  are  not 
considered  In  comparing  alternative  methods  of 
acquiring  commercial  products. 


rhe  price  negotiated  on  multiple  source 
contracts  is  based  on  the  terms  and  condi¬ 
tions  of  the  solicitation.  Price  and  dis¬ 
count  offers  are  solicited  for  the  commercial 
line  of  products.  In  the  case  of  the  FSS 
multiple  award  schedules  no  total  quantities 
are  established,  orders  are  placed  by 
thousands  of  ordering  officers  throughout  the 
United  States,  and  destination  delivery  is 
required  to  each  user.  A.  frequent  criticism 
of  multiple  source  contracts  is  that  the 
system  does  not  assure  the  lovest  possible 
price  for  a  given  delivery  and  that  the  lowest 
priced  item  is  not  always  selected  for  the 
specific  need.  The  average  size  of  each  ordtr 
as  established  on  our  user  level  survey  was 
$531.  Obviously  the  contract  prices. 

Including  transportation  coats,  which  esnnot 
be  determined  at  time  of  contract  negotiation, 
are  averaged  so  those  larger  user  activities 
that  are  in  urban  areas  can  separately  obtain 
better  prices  at  the  expense  of  isolated 
low-volume  activities.  Variations  in  the 
pricing  structure  for  large  users  could  be 
arranged  without  detracting  from  the  advan¬ 
tages  of  the  concept. 


Selection  of  the  least  total  cost  item  at  the 
point  of  use  la  a  Judgment  decision  that  can 


bast  be  made  at  the  local  site  to  fit  the 
specific  need.  These  decisions  have  to  be 
justified  to  the  satisfaction  of  the 
contracting  officer  and  the  discipline  for 
making  the  right  decision  is  a  responsibility 
of  management. 


In  addition  to  the  three  competitive  levels 
(l.e.,  marketplace,  negotiated  discount,  and 
user  selactlon) ,  the  pricing  of  multiple- 
source  contracts  is  fixed  for  a  period  of  one 
year.  The  exception  i3  for  reductions  that 
are  made  in  the  basic  market  price  from  which 
discounts  were  computed  and  are  subject  to 
price  reduction  provisions.  Therefore,  the 
Government  has  the  benefit  of  a  fixed  price 
for  a  year  even  though  prices  are  rising  in 
tha  marketplace.  During  periods  of  very  high 
rates  of  inflation,  such  as  during  wartiraa, 
econorj’.c  price  adjustment  provision  can  be 
included  in  the  contracts. 


CONn.’JSIONS 


•  Product  suitability,  responsive  delivery, 
and  ordering  simplicity,  are  criteria  for 
evaluation  of  systems  that  provide  commercial 
products  to  Government  users. 


•  Procurement  statutes  have  established  Gov¬ 
ernment  purchase  methodology  for  commercial 
type  products  that  are  effective  in  achieving 
low  unit  prices  but  the  process  is  slow  and 
costly  and  the  products  are  likely  to  be  of  a 
quality  that  may  not  be  the  best  buy  for  the 
Government. 


•  Purchase  mechanisms  are  in  use  throughout 
the  Government  that  benefit  from  "competition 
of  tha  marketplace"  by  providing  Government 
users  the  same  products  that  are  available  to 
non-Government  users.  These  procedures  are 
not  provided  for  in  procurement  statutes  or  in 
basic  procurement  directives. 


•  The  total  cost  of  purchasing  by  various 
methods  is  not  generally  known  and  la  not 
considered  in  selection  of  purchase  methods 
and  techniques. 


a  There  is  a  need  for  recognition  in  procure¬ 
ment  statutes  and  proturaoant  directives  of 
purchase  methods  'that  are  based  on  "off-the- 
shelf  competition"  add  for  consideration  of 
tha  coat  of  the  acquisition  process  as  part 
of  total  cost  to  the  Government. 


•.Recognition  by  the  Congress  and  procurement 
managers  of  tha  potential  for  economy  and 
effectiveness  by  increasing  reliance  on  off- 
the-shelf  competition  would  lead  to  improve¬ 
ment  in  procurement  practices  and  Increased 
use  of  tha  concept  whan  it  is  the  moat  cost 
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effective  method.  Institutionalization  of 
the  concept  vould  significantly  reduce  costs 
of  Government. 
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THE  COMMERCIAL  ITEM  SUPPORT  PROGRAM  (CISP)  MATHEMATICAL  MODEL 
George  A.  Clark,  Defense  Logistics  Agency 


INTRODUCTION 


This  study,  performed  by  the  DLA  Operations 
Research  and  Economic  Analysis  Office  (OLA-LO), 
examines  the  Total  Support  Cost  for  managing 
an  item  of  supply  under  several  alternative 
methods  within  the  Department  of  Defense.  The 
study  emanated  from  a  request  of  the  Assistant 
Secretary  of  Defense  (MRA&L)  that  the  Defense 
Logistics  Agency  develop  a  plan  for  implement¬ 
ing  a  Corrmercial  Item  Support  Program  (CISP). 

A  part  of  that  plan  requires  mathematical  for¬ 
mulas  and  costing  procedures  to  compare  the 
Total  Support  Cost  of  the  various  possible 
alternatives. 

In  1972  the  Commission  on  Government  Procure¬ 
ment  (COGP)  published  a  report  stating  that 
the  DLA  overhead  and  operating  costs  were  ex¬ 
cessive.  The  COG?  concluded  that,  "even  with¬ 
out  considering  obsolescence,  DLA  support  costs 
are  significantly  higher  than  those  of  civil¬ 
ian  activities.  This  was  said  to  be  due  to  (a) 
the  type  of  management  required  for  military 
logistics  support  beyond  that  required  for 
civilian  systems,  (b)  the  economic  and  demand 
characteristics  of  the  items  being  supported, 
and  (c)  the  high  costs  of  Inventory  investment 
associated  with  low  turnover  [1]. 

The  General  Accounting  Office  (GAO)  and  the 
Office  of  Management  and  8udget  (0MB)  recently 
expressed  similar  criticism  of  OLA  inventory 
management.  In  one  report  in  August  1976,  the 
GAO  stated  that  the  DLA  manages  many  minor, 
low-use  supply  items  which  could  be  supplied 
more  economically  through  comnercial  distribu¬ 
tion  systems  [2],  Subsequently,  the  GAO  re¬ 
ported  [3]  that  by  not  using  full  cost  account¬ 
ing  in  its  cost  analyses,  the  DLA  justified 
central  stockage  of  these  items.  In  addition, 
the  Office  of  Federal  Procurement  Policy  (OFPP) 
of  0MB  in  May  1975  issued  a  policy  statement 
requiring  maximum  use  of  the  commercial  distri¬ 
bution  systems,  asserting  that  comnercial  dis¬ 
tribution  systems  were  more  economical  than 
government  systems.  However,  the  GAO  has  rec¬ 
ommended  that  the  OFPP  modify  its  policy  to 
state  that  the  comnercial  distribution  system 
should  be  used  only  when  it  is  cost/effective 
to  do  so.  The  Assistant  Secretary  of  Defense 
for  Manpower,  Reserve  Affairs  and  Logistics, 

ASO (MRA&L),  and  the  DLA  are  in  agreement  with 
latter  GAO  recommendations. 

Although  these  recent  criticims  emphasize  cost 
at  the  expense  of  military  support,  they  do 
have  some  basis  and  point  to  a  real  need  for 
the  DoO  to  justify  economically  central  pro¬ 
curement  and  stockage.  It  is  alleged  that  the 
OLA  currently  stocks  many  items  which  have  wide 


commercial  availability,  do  not  require  a 
military  or  Federal  specification,  for  which 
private  industry  response  time  is  sufficient 
to  support  military  needs,  and  for  which  cen¬ 
tral  procurement  is  too  costly.  Accordingly, 
the  DLA  has  initiated  two  complementary  major 
management  programs  to  identify  comnercial 
items,  examine  the  need  for  government  speci¬ 
fications,  and  determine  the  most  cost/effec¬ 
tive  method  of  management. 

The  Commercial  Commodity  Acquisition  Program 
(CCAP)  reviews  Government  specification  items 
3nd  offers  the  ooportunity  to  (1)  eliminate 
all  unnecessary  Government  specifications  for 
commercial  products;  or  (2)  use  industry 
standards  in  lieu  of  Government  specifications 
when  a  formal  specification  is  required;  or 
(3)  “scrub  down”  the  Government  specifications 
to  reflect  the  commercial  product  to  the  maxi¬ 
mum  extent  possible  when  Government  specifica 
tions  cannot  be  eliminated.  Items  which  can 
be  purchased  without  the  Government  specifica¬ 
tions  will  then  be  processed  by  the  CISP. 

The  CISP  seeks  to  identify  items  which  have 
wide  commercial  availability  and  for  which 
commercial  support  is  most  cost/effective. 

The  DLA  is  currently  developing  guidelines  to 
determine  commercial  availability  through  mar¬ 
ket  surveys  and  local  purchase  testing  of  cen¬ 
trally  procured  items,  and  has  prepared  a  com¬ 
prehensive  CISP  plan. 


THE  STUDY 


Objective.  This  paper  develops  the  Total  Sup¬ 
port  Cost  (TSC)  models  to  compare  the  econom¬ 
ics  of  alternative  methods  of  supply  support. 
The  models  will  be  used  to  determine  the  least 
cost  method  to  manage  commercially  available 
Items. 

Scope.  The  study  essentially  addresses .six  of 
the  eight  supply  support  alternatives  identi¬ 
fied  by  the  ASD(MRASL).  These  alternatives 
are  listed  below  and  correlated  to  their  cor¬ 
responding  DLA  Supply  Status  Code  (SSC). 


Item  Management  Alternative  (IMA)  DLA  SSC 


Contractor  Suppbrt  None 
Local  Purchase  2 
Supply  Schedule  Support  None 
ICP  Delivery  Order  Support  3 
ICP  Procurement  on  Demand  3 
Central  Stockage  1.A 
Combined  Management  1,A 
Contractor  Support  1,A 
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OLA  SSC  classifications  are  defined  as  follows: 

SSC-A.  Items  coded  in  this  management 
i.ategory  are  generally  low  demand  or  insurance 
items.  They  are  infrequently  demanded,  gener¬ 
ally  high  price  items  with  long  procurement 
lead  times.  A  nominal  quantity  is  stocked. 

SSC-1 .  Items  coded  in  this  management 
category  are  demand-based  centrally  procured 
tv  the  OLA,  and  generally  stored  wiiVn  the 
DLA  distribution  system.  {There  is  some  stor¬ 
age  of  OLA-owned  materiel  in  other  OoO  ware¬ 
housing  facilities.) 

SSC- 2.  Items  cod-d  in  this  management 
category  are  local  purchase  items  which  are 
procured  and  stored  by  user  activities  or 
their  suODly  support  systems.  The  OLA  provides 
only  cataloe'-iq  axi  sometimes  contracting  sup¬ 
port.  SSC-2  items  may  also  be  obtained  through 
Contractor  Operated  Civil  Engineer  Supply 
Stores  (COCF.SS)  or  Contractor-Operated  Parts 
Stores  (COPARS),  in  which  case  the  OLA  pro¬ 
vides  no  contracting  support  [4], 

SSC-3.  Hems  coded  in  this  management 
category  are  centrally  procured  and  otherwise 
supported  by  the  OLA,  but  are  not  positioned 
in  OoD  warehouses.  Customer  demands  are  sat- 
isfiec  by  direct  delivery  orders  placed  on  the 
contractor  by  the  OLA.  The  Indefinite  Delivery 
Type  Contract  (IDTC)  is  a  common  procurement 
instrument  for  these  items.  The  OLA  does  not 
procure  'ts  assigned  items  through  a  schedule 
system  such  as  the  Federal  Supply  Schedule 
(FS'j)  system  utilized  by  the  GSA. 

Other  SSC  Codes.  At  present  the  following 
categories  are  excluded  ant  not  considered  in 
f..s  analysis: 

SSC-4.  Military  Assistance  Program 
i SLA9)  items  are  centrally  procured  and  stocked 
solely  for  MAP. 

SSC -5  Reference  only  items  used  only 

for  bid  invitations,  allowance  lists,  etc. 

SSC-6.  Terminal  items,  issue  until 
exhausted. 

SSC--7.  Items  coded  in  this  management 
category  are  centrally  procured  and  stocked  for 
overseas  requisitioned. 

SSC-S.  Government-Furnished  Materiel 
(GFM)  and  Government-Procured  Property  (GFP) 
for  use  in  manufacture  of  items. 

SSC-9.  Semiactive,  potentially  inac¬ 
tive,  future  stockage  not  'uthorized. 

SSC-0.  No  statu  code. 

Inventory  Management  Alternatives  (IMAs) 

1MA1-  Contractor  Support^  This  alterna- 
tive  includes  supply  support  arrangements  such 
as  the  COCESS  and  COPARS.  No  specific  cost 
model  will  be  developed  by  the  OLA.  Each  base/ 
activity  will  compare  the  costs  of  contractor 
support  with  Its  current  local  purchase  pro¬ 
cedures  to  determine  the  nett  economical  method 
of  supply  for  decentralized  items.  The  OoO 
will  publish  guidance  on  this  subject. 

IHA2  -  Local  Purchase.  This  alternative 
represents  current  local  purchase  practice. 
Local  purchase  is  defined  in  the  basic  CISP 
plan  and  ASPR  1-201.28  as  the  authorized 


purchase  of  materiel,  supplies  and  services  by 
an  installation  for  its  own  use  or  use  Of  an 
installation  activity  logisticallv  supported 
by  it.  Local  purchase  is  not  limited  to  the 
immediate  geographical  area  in  which  the  pur¬ 
chasing  activity  is  located. 

LMA3  -  Supply  Schedu7es  Support.  Thi * 
alternative  represents  s.pport  by  procurement 
from  published  schedules,  analogous  to  the  FSS 
maintained  by  the  GSA.  When  this  alternative 
is  used,  OLA  Supply  Centers  (DSCs)  initiate 
Indefinite  Delivery  Type  Contracts  and  publish 
and  distribute  printed  schedules  worldwide  to 
us°rs.  Installations  would  order  from  and  pay 
directly  to  t'“  contractor.  This  type  of  con¬ 
tract  normally  lists  items;  however,  o.’e  con¬ 
tract  may  cover  several  items  and  a  separate 
contract  may  be  required  for  each  of  several 
manufacturers  who  may  supply  this  same  item. 

1KA4  -  ICP  Delivery  Order  Support.  This 
alternative  includes  as  subalternatives  OLA 
procurement  instruments  such  as  Basic  Ordering 
Agreements  (BOAs),  Blanket  Purchase  Agreements 
(BPas),  and  IOTCs.  IMA4  is  for  direct  del ive-y 
to  the  user  -.ith  orders  issued  by  ICP. 

BOA  is  defined  in  the  CISP  plan  and  ASPR 
3-410.2  as  a  written  instrument  of  understand¬ 
ing  executed  between  a  procuring  activity  and 
a  contractor  which  sets  forth  the  negotiated 
contract  clauses  which  are  applicable  to  fu¬ 
ture  procurement  between  the  parties.  The  BOA 
includes  a  description  of  the  supplies  to  be 
furnished  or  services  to  be  performed  when 
ordered  and  a  description  of  the  method  for 
determination  of  the  prices  to  be  oaid  to  the 
contractor.  BOAs  are  often  used  for  sole 
source  items.  There  is  no  fixed  price.  The 
total  agreement  is  for  over  S10.000.  BOAs  are 
explicit  and  become  legally  binding  upon  both 
Darties.  Each  purchase  is  negotiated  separate¬ 
ly.  Some  automation  is  possible. 

A  BPA  (ASPR  3-605)  is  a  simplified  method  of 
filling  anticipated  repetitive  needs  for  small 
quantities  of  suppliers  or  services  by  estab¬ 
lishing  "charge  accounts"  with  oualified 
sources  of  supply.  BPAs  may  be  used  for  pro¬ 
curements  whose  individual  delivery  orders  do 
net  exceed  $10,000  each.  There  is  no  fixed 
price.  BPAs  are  much  simpler  than  BOAs.  De¬ 
livery  orders  for  under  S500  against  a  BPA  are 
highly  automated;  <AMMS  Automated  Small  Purchase 
System  (SASPS  I)  which  consists  of  a  rotating 
list  of  suppliers  is  used  and  no  competition  is 
required.  Above  $500  BPAs  are  seldom  used. 
Instead  SANMS  Automated  Small  Purchase  System 
(SASPS  il)  is  used.  At  least  two  bidders  are 
automatically  sent  Request  for  Quotes  (RFQ)  and 
subsequently  a  Purchase  Order  (P0)  is  issued. 
SAMMS  is  the  Standard  Automated  Materiel  Man¬ 
agement  System,  of  OLA.  When  there  are  no  ex¬ 
ceptions  by  bidders,  the  evaluation  1-  automated. 
Exceptions  must  be  manually  evaluated. 

IOTCs  includes  the  following  type  contracts: 

Oefinite  Quantity  Contract.  This  type 
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contract  provides  for  a  definite  quantity  of 
specified  supplies  or  the  performance  of  speci¬ 
fied  services  for  a  fixed  period  with  deliver¬ 
ies  or  performance  at  designated  locations 
upon  order. 

Requirements  Contract.  This  type  contract 
provides  for  filling  all  actual  purchase  re¬ 
quirements  of  specific  supplies  or  services  of 
designated  activities  during  a  specified  con¬ 
tract  period  with  deliveries  to  be  scheduled 
by  the  timely  placement  of  orders  upon  the  con¬ 
tractor  by  OLA  for  designated  items  either 
specifically  or  by  class  of  items. 

Indefinite  Quantity  Contract.  This  type 
contract  provides  for  the  burnishing  of  an 
indefinite  quantity,  within  stated  limits,  of 
specific  supplies  or  services,  during  a  speci¬ 
fied  contract  period,  with  deliveries  to  be 
scheduled  by  the  timely  placement  of  orders 
upon  the  contractor  by  OLA  for  designated  items 
either  specifically  or  by  class  of  items. 

IOTCs  are  generally  used  for  procurements  whose 
total  annual  demand  is  equal  to  or  greater  than 
$10,000.  There  is  a  fixed  price.  In  the  near 
future,  delivery  orders  against  IOTCs  will  be 
automated  in  OLA. 

IMA5  -  Procurement  on  Demand.  This  alter¬ 
native  represents  the  current  type  of  support 
given  SSC-3  Items  in  OLA.  A  purchase  action  is 
initiated  each  time  a  requisition  is  received. 
This  alternative  is  designed  primarily  for  sup¬ 
port  of  low  frequency  items. 

1MA6  -  Central  Stockage.  This  alternative 
represents  the  current  type  of  support  given 
OLA  SSC-1  and  SSC-A  items.  It  consists  of  bulk 
procurements,  depot  stockage  and  issues  for 
each  requisition.  Procurements  can  be  small  or 
large  purchase,  BPA,  I0TC,  SASPS  I  or  SASPS  II. 

IMA7  -  Combination  Management.  This  alter¬ 
native  maintains  central  stockage  to  support 
high  priority  requisitions  and  supports  prior¬ 
ity  group  III  requisitions  by  delivery  orders 
against  IDTCs.  Hence,  it  is  a  combination  of 
IMA4  (IDTC)  and  IMA6.  This  alternative  envis¬ 
ions  the  support  of  priority  groups  I  and  II  by 
filling  such  requisitions  from  stock.  Priority 
group  III  would  be  filled  by  direct  delivery. 
The  intent,  is  to  minimize  stockage  while  pro¬ 
viding  responsive  service  when  needed.  DLA 
would  use  IOTCs  for  filling  priority  group  III 
requisitions  and  for  placing  orders  for  stock. 
In  this  case,  IOTCs  might  be  for  less  than 
$10,000  demand  pet  year. 

IMA8  -  Contractor  Storage.  ICP  arranges 
for  purchase  of  fixed  quantities  of  items  from 
a  contractor  and  for  the  same  contractor  to 
furnish  services  for  receipt,  storage,  and 
issue  based  upon  release  orders  from  the  ICP. 
Contractor  storage  is  a  separate  issue  and 
should  be  considered  at  a  future  date. 


TOTAL  SUPPORT  COST  , 

General .  The  total  support  cost  (TSC)  for  an 


item  of  supply  is  the  full  cost  incurred  by 
the  Government  in  delivering  the  item  to  the 
customer.  As  well  as  the  price  paid  for  the 
item,  the  full  cost  includes  an  allocated 
share  of  the  cost  of  the  support  system  used 
to  acquire  and  deliver  the  item.  Thus,  both 
the  market  price  paid  under  each  procurement 
alternative  and  the  overhead  costs  of  the  sup¬ 
port  system  are  directly  included  in  the  ISC 
concept.  This  definition  is  equivalent  to  the 
landed  or  full  cost  concept  used  by  the  GAO  in 
its  recent  analysis  [3].  The  TSC  not  only  in¬ 
cludes  funded  costs  but  also  certain  unfunded 
costs,  specifically  the  investment  and  obso¬ 
lescence  costs  of  Inventory  and  the  fringe 
benefit  costs  of  civil  service  employees. 

In  the  past,  the  TSC  approach  was  a  review  of 
costs  incurred,  and  an  extrapolation  of  those 
costs  as  future  expenses  Incurred  through  ad¬ 
ditional  workload,  or  as  savings  accruing  from 
reduced  workload.  It  was,  therefore,  an  aver¬ 
age  rather  than  incremental  cost  approach  and 
has  both  significant  advantages  and  disadvan¬ 
tages. 

Average  Cost  and  Incremental  Cost  Concepts. 

Two  methods  of  considering  the  cost  of  manag- 
ing  an  item  are  possible:  (1)  Average  cost 
adds  all  costs  and  divides  by  the  number  of 
items  managed.  This  method  does  not  consider 
the  characteristics  of  different  items.  It 
assumes  that  all  items  are  managed  at  the  same 
cost.  (2)  Incremental  cost  considers  each 
item  individually  and  computes  the  cost  to 
manage  based  upon  the  variable  workloads  cre¬ 
ated  by  the  Item's  characteristics. 

Average  cost  and  marginal  (Incremental)  cost 
criteria  are  applied  in  quite  different  deci¬ 
sion  problems.  If  one  is  considering  a  rela¬ 
tively  small  adjustment  to  workload  within  an 
organization,  i.e.,  one  Item  at  a  time,  mar¬ 
ginal  costs  and  marginal  benefits  will  be  com¬ 
pared  to  identify  the  cost-beneficial  course 
of  action.  However,  if  one  is  deciding  be¬ 
tween  the  total  population  average,  average 
cost  may  be  used.  The  techniques  applied  by 
the  COGP,  GAO  and  recently  ASD(HRAJL)  have 
been  based  on  average  cost,  for  the  reason 
that  DLA  support  was  compared  with  the  total 
of  local  purchase  and  commercial  support  alter¬ 
natives.  If  the  total  inventory  management 
function  were  to  be  changed,  the  average  cost 
method  would  apply.  If  only  a  portion  of  DLA 
item  management  Is  to  be  considered  for  change, 
the  average  cost  does  not  apply.  This  paper 
examines  the  marginal  cost  approach. 

Funded  and  Unfunded  Costs.  In  order  to  deter¬ 
mine  the  cost  of  DLA  supply  support,  all  Oper¬ 
ating  and  Maintenance  (O&M)  costs  for  FY  76 
were  reviewed  for  applicability  to  the  supply 
support  mission.  Applicable  O&M  costs  were 
defined  as  all  costs  incurred  in  the  support 
of  items  of  supply  assigned  to  OLA  for  item 
management.  Costs  associated  with  other 


jf  s„  jLLisj-jik.*,,:, . . 


logistics  missions  were  not  considered  in  the 
calculation  of  the  cost  of  DLA  supply  support. 
For  example,  all  O&M  costs  of  the  Defense 
Industrial  Plant  Equipment  Center  (DIPEC),  and 
the  larger  portions  of  OSH  costs  of  the  Con¬ 
tract  Administration  Services  (CAS)  mission 
and  the  Defense  Property  Disposal  Service  were 
not  included  in  the  cost  calculations. 

Whenever  an  O&M  account  was  deducted  as  inap¬ 
plicable,  e.g.,  DIPEC,  a  prorated  portion  of 
other  DLA  resources  expended  in  support  of 
that  account  was  also  deducted.  This  proce¬ 
dure  required  a  cost  proration  of  all  DLA 
management  support  organizations,  such  as  the 
DLA  Administrative  Support  Center  (DASC),  DLA 
Field  Offices  and  the  OLA  Headquarters,  to  the 
Primary  Level  Field  Activities  (PLFAs)  and  the 
CAS  mission. 

These  costs  include  applicable  O&M  as  well  as 
the  unfunded  costs  of  inventory  holding  and 
Federal  employee  fringe  benefits.  Other  un¬ 
funded  costs  such  as  interest  costs  on  cash 
balances,  depreciation,  and  costs  of  alterna¬ 
tive  uses  of  land,  equipment,  and  buildings, 
all  of  which  may  appear  in  economic  analyses 
in  the  private  sector,  were  not  included  in 
the  cost  rate.  The  rationale  for  these  deci¬ 
sions  relating  to  unfunded  costs  is  discussed 
below. 

Inventory  Holding  Costs.  The  major  unfundec 
cost  of  DLA  support  is  the  cost  of  holding  in¬ 
ventories.  In  this  analysis  the  holding  rate 
is  applied  to  the  actual  inventory  as  reported 
in  the  quarterly  stratification  report. 

The  rate  consists  of  three  components:  an 
interest  charge  of  10%  per  annum  applied  to 
the  value  of  the  inventory;  a  1%  storage  rate, 
also  applied  to  the  value,  which  captures  the 
depot  O&M  variable  costs  of  managing  inventory, 
exclusive  of  receiving,  packing,  issue  and 
transportation  functions;  a  variable  obsoles¬ 
cence  rate  which  is  designed  to  recover  the 
costs  of  decay  in  the  demand  process,  or  the 
percentage  of  the  buy  quantity  which  is  lost 
to  the  obsolescence  process  at  the  time  of  the 
buy;  and  last,  a  miscellaneous  loss  rate. 

While  DLA  has  set  the  miscel!  neous  loss  rate 
at  zero,  it  has  calculated  an  obsolescence 
loss  rate  for  each  commodity,  based  on  the 
value  of  the  inventory  sent  to  disposal. 

The  manner  in  which  holding  cost  is  applied  de¬ 
pends  upon  the  decision  to  be  made.  For  pur¬ 
poses  of  estimating  average  total  cost  and 
fixed  overhead  cost,  a  conflict  arises  as  to 
the  use  of  actual  costs  indicated  in  OLA  P350 
cost  account  for  storage  or  the  U  which  is  in¬ 
cluded  in  the  holding  rate  in  accordance  with 
OoOl  4140.39  [5].  This  study  has  considered 
these  detailed  costs  and  in  the  final  analysis 
eliminates  the  P350  costs  and  uses  1%  Included 
in  the  holding  rate. 

As  used  in  this  analysis  and  for  ease  of 


application,  the  interest  rate  is  applied 
against  the  value  of  annual  gross  sales. 

Mobilization  Reserve  Stocks.  Mobilization 
reserve  stocks  are  not  used  to  support  current 
operations.  Hence,  they  are  not  a  considera¬ 
tion  under  CISP  and  are  not  Included  in  the 
total  cost  support  formulations. 

Approved  Force  Acquisition  Objective  (AFAO). 

It  is  this  strata  which  is  budgeted  for  sup- 
port  of  peace  time  demands.  Recent  analyses 
by  the  OLA  Operations  Research  Office  suggest 
that  the  demand  dec^y  is  curvel inear.  The 
study  demonstrates  that  inventory  has  close  to 
a  1001  probability  of  being  demanded  during 
the  first  two  years.  If  bought  in  larger  quan¬ 
tities,  the  dollar  value  of  which  is  low,  the 
probability  of  it  being  demanded  drops  dramat¬ 
ically.  Based  upon  this  curve  and  the  fact 
that  at  best  these  are  approximations,  no  obso¬ 
lescence  is  charged  to  AFAO;  only  storage  and 
interest  are  charged. 

Economic  Retention.  Based  upon  normal  proba- 
bility  tables,  the  average  probability  of  re¬ 
tention  stocks  being  demanded  has  been  deter¬ 
mined.  A  separate  curve  was  developed  for 
each  obsolescence  rate.  The  cost  of  holding 
retention  is  computed  as  the  loss  due  to  obso¬ 
lescence,  the  Interest  cost  applied  to  the  ex¬ 
pected  value  of  the  materiel,  and  storage  >.ost. 

Excess.  Excess  materiel  is  to  be  disposed  of; 
returned  to  the  private  sector.  It  is  no  long¬ 
er  a  part  of  the  DoD  inventory.  We  have  taken 
the  loss  by  obsolescence  in  other  strata.  It 
is  not  included  as  a  CISP  holding  cost. 

In  Transit.  Tnese  are  stocks  which  have  been 
accepted  by  DLA  at  origin  and  are  not  yet  in 
storage.  They  are  Included  and  charged  inter¬ 
est  only  similar  to  AFAO. 

Interest  Cost  on  Cash  Balances.  As  well  as 
applying  an  Investment  cost  to  inventories,  a 
private  company  would  apply  an  investment  cost 
to  any  funds  which  are  not  earning  the  poten¬ 
tial  return  from  an  alternative  Investment. 

Any  kind  of  revolving  fund  which  has  a  net  pos¬ 
itive  cash  investment  would  incur  an  investment 
cost.  DoD  Stock  Fund  cash  balances  are  main¬ 
tained  purely  as  book  balances  and,  in  fact, 
are  not  supported  by  actual  cash  on-hand.  No 
funds  are  being  withheld  from  the  private  sec¬ 
tor;  therefore,  the  study  makes  no  charges  for 
interest  costs  on  cash  balances. 

Depreciation  Costs.  Depreciation  accounting  Is 
used  In  the  private  sector  to  reflect  the  charge 
of  fixed  asset  costs  against  current  operations. 
Tax  credits  allowed  serve  as  a  mechanism  «  : 
encourage  private  sector  capital  investments 
and  thereby  stimulates  economic  growth.  For 
example,  a  private  company  will  seek  to  recover 
the  cost  of  storage  facilities  through  depre¬ 
ciating  the  initial  construction  cost  over  a 
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given  life  cycle.  A  time  stream  of  tax 
credits  will  then  compensate,  {more  or  less  to 
the  extent  of  actual  costs)  for  this  Invest¬ 
ment. 

In  government,  the  financing  of  major  capital 
equipment  and  facilities  is  through  congress¬ 
ional  appropriation  and  there  is  no  corres¬ 
ponding  concept  of  tax  credit  which  would  off¬ 
set  this  cost  and  thereby  encourage  investment 
in  government.  Cost/benefit  analysis  has  been 
the  major  mechanism  for  evaluating  government 
capital  investments,  and  once  funds  are  ex¬ 
pended,  the  initial  costs  are  sunk  and  there¬ 
fore  irrelevant  to  any  future  analyses.  A 
private  corporation  would,  however,  show  an 
annual  cost  due  to  depreciation;  the  annual 
cost  would  include  the  initial  investment. 
Depreciation  tax  credits  would  appear  as  com¬ 
pensating  revenues.  There  is  simply  no 
rational  analogy  for  this  type  of  financing  in 
government.  Consequently,  no  depreciation 
costs  have  been  included  as  unfunded  costs  in 
determining  the  cost  of  DLA  supply  support. 

Fringe  Benefit  Costs.  Federal  employees  re¬ 
ceive  benefits  which  are  costs  on  the  aggre¬ 
gate  Federal  level,  but  these  fringe  benefit 
costs  do  not  appear  as  0AM  costs  in  budget 
statements  of  individual  agencies.  Conse¬ 
quently,  fringe  benefit  costs  must  be  added  to 
the  personnel  cost  component  of  0AM  costs  to 
determine  the  true  cost  of  DLA  supply  support. 
The  current  total  fringe  benefit  rate  Is  18.1*. 

Opportunity  Costs  of  Capital  Assets.  Another 
unfunded  cost  which  appears  In  private  sector 
cost  analyses  is  the  cost  of  the  best  alter¬ 
native  use  of  capital  assets  (land,  equipment, 
buildings).  These  costs  are  generally  labeled 
opportunity  costs  -  the  costs  of  alternative 
opportunities  foregone  by  deciding  upon  a  par¬ 
ticular  course  of  action.  There  is  an  oppor¬ 
tunity  cost  associated  with  operating  a  depot 
if  that  depot  has  a  private  market  value.  Al¬ 
though  the  cost  of  foregoing  sale  of  a  depot 
to  the  private  sector  may  be  relevant,  it  has 
not  been  possible  to  identify  the  best  alter¬ 
native  use  of  a  Defense  depot.  Sale  of  the 
facility  may  not  even  be  a  feasible  alterna¬ 
tive  let  alone  the  best  alternative.  The 
opportunity  costs  of  government-owned  capital 
assets  have  not  been  included  in  the  cost  of 
DLA  supply  support. 

THE  MODELS 

IMA2  -  Local  Purchase 

T$C2  •  (P2)0-A2>f+0+Rb+Z)(V)(1+D2)+(A2)(F) 
(P5+Rm)+L2(K) 

where  P2  is  cost  of  a  procurement  as  a 
f[(V/F)(1+Do}]  and  has  a  different 
value  dependent  upon  the  value  of  the  procure¬ 
ment.  Where  K  is  a  fC <V ) {l+05) (A2)/ (1 -A2 )D . 


adjusted  by  the  unit  price  differential 
f[(V)(l+03)] 

IMA4  -  1CP  Delivery  Order  Type  Contracts/Agree- 
ments 

lMA4a  -  Basic  Ordering  Agreements  (BOA) 

TSC4a  *  Igo^|pBOA+R)^+('+DBOA)(vMl+Ra+z) 

where  K  1 s2a  function  of  the  annual  demand  ad¬ 
justed  by  the  unit  price  differential 
fC(V)(l+DB0A)] 

IMA4b  -  Blanket  Purchase  Agreement  (BPA)  also 

T3CPTI  ~an~dUT  ~  — - - - 

TSC4b  =  lj3P/|+(PBPA+R  ) F+ ( 1 +Ra+Z ) ( V ) ( 1 *D  BPA ) 

where  P3pA^is  a  function  of  the  dollar  value 
of  the  procurement  adjusted  by  the  Unit  Price 
differential  f [ (V/F ) (1+DBPA)3 •  This  same  for¬ 
mula  applies  to  SASPS  I  and  II  procurements; 
the  value  of  PBPA  changes  for  SASPS  II. 

IMA4c  -  Indefinite  Delivery  Type  Contract 

TMT -  —  - 

TSC4c  =  IiD|^+(PiDTC+R)F+(1+Ra+z)(v)n+DlDTc) 

where  K  is  a  function  of  the  annual  dollar  de¬ 
mand  adjusted  by  the  unit  price  differential 
f[(V)(l+D1DTC)]. 

1MA5  -  Central  Procurement  on  Demand  (POD) 

TSC5  =  (P5+R  )F+ ( 1  +Ra+Z )  (V )  ( 1 +D5  J+Ljf  ( K) 
where  K  is  a  function  of  the  annual  dollar  de¬ 
mand  adjusted  by  the  unit  price  differential 
f[{V)(HD5)]. 

IMA6  -  Central  Stockage 
TSC6  »  (J+S)F+Bj (V/Q)+(1 +Ra+H)V+L2 ( K)+I 
where  K  is  a  function  of  the  annual  dollar  de¬ 
mand  f(V). 

Bi  varies  dependent  upon  the  procurement 
instrument  used. 

For  regular  bulk  procurements,  Bi  =  either  the 
small  or  large  procurement  cost  of  Bi  and  I  = 

or  BPA  or  SASPS  I,  B*  *  B2and  I  =  Iopn. 

For  SASPS  II,  -  83  and  I  =  IbPA1 
For  IDTC,  Bi  =  §4  and  I  *  I IDTC • 

IMA7  -  DLA  Combination  Management.  In  this 
alternative  stocks  are  maintained  to  support 
the  high  priority  demand  base  only  (priorities 
1-8).  Low  priority  demands  will  be  supported 
by  IDTCs.  Since  it  is  unclear  at  this  time 
how  many  storage  facilities  would  be  required 
to  support  a  large-scale  conversion  to  combi¬ 
nation  management,  the  same  overhead  cost  has 
been  applied.  It  is  likely  that  the  value  of 
L2  would  increase  in  the  event  of  large-scale 
combination  management  because  overhead  costs 
are  not  likely  to  be  reduced  in  proportion  to 
inventory  reductions.  Thus,  the  TSC7  formula 
is  conservative. 


IMA3-Su 


_  _ ly  schedule  Support 

fsC3  »  l+f,3F+0+fta+it)(V)()+D3)+L1(K) 
where  K  is  a  function  of  the  annual  demand 


TSC7  *  Ii0TC+l-2(R)+O-RlX(J+S)F+(1+Ra+H)(V) 
O+DIDTC)]+0'Rl)(f>IDTc)E(v)(1+0IDTc)/ 
Qc]+Rl[(PiDTc+R)F+(l+Ra)(V)(l+DI07c)l 
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where  K  is  a  function  of  the  annual  dollar  de¬ 
mand  adjusted  by  the  unit  price  differential 
f[(V)(1+DiQTc)]. 


Definition  of  Costs  and  Other  Inputs.  Values 
have  been  derived  for  all  inputs  required  to 
drive  the  models.  Some  of  our  values  are  quite 
valid;  others  require  further  study.  We  have 
coded  each  input  value  with  a  Roman  numeral, 
indicating  its  reliability:  The  higher  the 
Roman  numeral,  the  more  reliable  the  value. 


Review 

Currently  under  further  study. 


Values  are  best  estimates  based  upon 
studies  wlrch  have  not  been  validated  by 
DLA.  These  should  be  studied  further  at 
the  earliest  practical  date. 


Values  are  best  estimates  based  upon 
studies  which  have  not  been  validated  by 
DLA.  However,  these  values  appear 
reasonable  or  are  not  vital  to  results. 


Values  are  averages  and  are  the  result 
of  a  DLA  study.  These  should  be  examined 
further  to  determine  if  the  averages  ap¬ 
ply  in  the  extremes  (high  or  low  ranges), 
or  if  policy  changes  in  the  future  would 
affect  the  average. 


Values  are  the  result  of  a  detailed  DLA 
study.  Further  study  is  not  considered 
necessary  except  for  some  future  update. 


P2  -  Average  administrative  cost  to  procure  at 
installation  level.  Costs  are  estimated  to 
vary-ss  a  function  of  the  value  to  be  procured- 
(the  average  requisition  value).  These  values 
are  under  further  study  by  the  Military 
Services.  (Code  I) 


F  -  Frequency  of  requisitions  per  item  per  year 
at  the  ICF.  Formulas  assume  one  order  per  re¬ 
quisition  for  other  than  central  stockage  and 
assuming  no  change  in  average  on  hand  Inventory. 
(Code  HA) 


‘  Rate  of  annual  holding  rate  of  inventory 
to  annual  dollar  demands  „  local  Installation 
when  local  management  is  .ised.  (Code  I) 


Z  -  Rate  of  returns  redistributions  lost  to  the 
system  per  year  when  central  stockage  is  not 
used  (Code  V) 


°2  -  Average  unit  cost  differential  for  local 
purchase  vs.  central  ICP  procurement.  These 
values  are  under  review  by  the  Military  Services 
and  in  addition  are  being  tested  by  the  CISP’s 
Early  Initiatives.  The  expression  (1+D2)V  is 
used  to  adjust  the  annual  dollar  demand  oy  the 
unit  price  differential.  (Code  I) 


V  -  Annual  dollar  demands  of  the  item  at  stand¬ 
ard  price.  (Code  NA) 


I  -  Cost  per  item  on  a  supply  schedule.  A 
schedule  may  contain  one  item  on  a  contract 
line  or  it  may  refer  to  an  entire  catalog  of  a 
manufacturer.  It  may  be  necessary  to  establish 
several  contract  lines  for  the  same  item  when 
supplied  by  more  than  one  manufacturer. 

(Code  II) 


P3  -  Cost  of  placing  an  order  against  an  SS 
type  contract  (Code  II) 


D-  -  Unit  price  differential  for  FSS  buy  rel¬ 
ative  to  stocked  >tem  buy.  (Code  II) 


Li  -  Prorated  ICP  overhead  for  an  SS  type  buy. 


loor  and  ceiling  values  are  used  (Code  IV) 


L2  -  Prorated  DLA  ICP  overhead  costs  per  dollar 
demand  by  commodity.  Application  is  same 


function  as  variable  L-,.  (Code  IV) 


IgoA  "  Establishment  of  an  item  on  a  BOA. 
Boas  may  accept  all  items  a  manufacturer  or 
distributor  sells.  (Code  IV) 


I  opt  -  Same  as  BOA  (Code  IV) 


I  IDTC  -  Establishment  of  an  item  on  an  IDTC 
(Code  IV) 


pB0A  ‘  Cost  Per  order  placed  against  a  BOA 
using  an  automated  system  for  a  percentage  of 
the  items.  (Code  IV) 


P8PA  ‘  Cost  of  Placing  an  order  against  a  BPA. 
These  are  direct  delivery  costs.  Automation  is 
effective  for  below  $500  procurements  by  6PA. 
Between  $500  and  $10,000.  an  automated  system 
(SASPS  II)  Is  used.  BPAs  are  not  generally 
used  in  DLA  for  calls  above  $500.  (Code  V)[8] 


Pjqtq  -  Cost  of  placing  an  order  against  an 
IDTC  assumes  automation,  except  Clothing  and 
Textile,  Medical,  and  Subsistence.  (Code  V) 


°B0A  ”  Price  differential  estimated  to  be  the 
same  as  for  the  FSS  buy.  (Code  II) 


OgpA  -  Same  as  above. 


°IDTC  ‘  Same  as  aljove. 


R  -  Requisition  processing  cost  by  ICP;  in¬ 
cludes  installation  cost.  (Code  V)  [7] 


-  Rate  for  holding  cost  of  inventory  invest¬ 


ment  component  at  the  installation  level  when 
central  management  used.  It  is  the  ratio  of 
holding  cost  of  Inventory  to  annual  dollar  de¬ 
mands  at  the  installation  level.  (Code  I) 


Pc  -  Purchase  costs  for  procurement  on  demand, 
standard  purchase  order,  for  procurement  values 
under  and  over  $10,000  (Code  V) 


I  1 
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Or  -  Price  differential  for  procurement  on 
demand  estimated  to  be  the  same  as  for  the  FSS 
buy.  (Code  II) 

S  -  Depot  overhead  per  line  shipped. 

(Code  IV) 

J  -  Issue  cost,  includes  installation  requi¬ 
sition  preparation  and  transmittal  cost,  ICP 
requisition  processing  cost,  depot  picking, 
packing,  issue  and  transportation  directorate 
costs,  but  not  second  destination  transporta¬ 
tion  costs  (already  included  in  ICP  price). 
(Code  V) 

Bi  -  Procurement  costs  for  stocked  buys,  in¬ 
cludes  receiving  costs,  for  procurements  under 
and  over  $10,000.  (Code  V) 


Demand  S  Reqn  10  Regn 


LP 

56 

106 

SS 

i12 

197 

BOA 

NA 

NA 

SASPS  I 

61 

86 

SASPS  II 

NA 

NA 

IDTC 

96 

121 

POD 

460 

893 

CS  Proc 

111 

165 

CS  BPA 

NA 

NA 

CS  Automated 

88 

142' 

CS  IDTC 

127 

181 

Combined  Mgt. 

109 

145 

The  manager,  knowing  the  annual  number  of 
requisitions  and  the  dollar  demand,  selects 
the  least  cost  feasible  alternative. 


B2  -  b3  -  84  -  SASPS  I  and  II  vendor's  lists 
for  stock  buys  and  include  receivin':  costs 
(Code  V).  IDTC  costs  are  manual  (Code  IV). 

H  -  Holding  cost  rate  by  commodity  as  X  of 
gross  sales.  (Code  V) 

r-|  -  Fraction  of  the  demand  attributable  to 
priority  group  III  requisitions.  (Code  V) 

Q  -  E0Q  in  dollars  (Wilson). 

Qc  -  Reduced  buy  quantity  in  dollars  for 
combination  management.  The  value  of  Q  = 
k  /  V (1+DlDTC)  O-Rl ) 


A-  -  Percentage  of  2A  requisitions  to  be  re¬ 
ceived  for  an  SSC2  item  for  each  requisition 
formerly  received  for  a  stocked  item  (Code  IV). 
(CT  and  S  are  based  upon  an  average  of  the 
others  as  data  was  not  available  at  the  time 
inis  report  was  prepared.)  Code  II. 

r_  -  Cost,  to  process  a  manual  requisition 
(Code  IV). 


Impact  by  DSC.  Based  upon  the  values  above,  a 
computer  program  was  run  to  test  the  models  on 
each  of  the  seven  commodities.  This  program 
produces  a  matrix,  generally  as  follows: 


; 

REQUISITION  FREQUENCY 

$  Demand 

5 

10 

15 

5 

xiyi 

*1*2 

*1*3 

10 

*2*1 

15 

100,000 

...  .1000 


For  each  cell  of  the  matrix,  the  total  support 
cost  of  each  alternative  Is  computed.  For 
example: 


Review  of  test  results.  A  review  of  tests 
made  to  date  suggests: 

a.  The  most  significant  factor  in  the 
decision  between  alternative  management  meth¬ 
ods  is  the  procurement  costs.  Automation  for 
BPAs,  vendors’  lists  and  IDTCs  is  highiy 
economic.  Analyses  of  these  tests  strongly 
suggest  that  a  central  automated  system  is 
more  effective  than  multiple  local  purchase 
activities. 

b.  Depot  stockage  results  in  variable  pro¬ 
cessing  costs,  depot  overhead  costs  and  hold¬ 
ing  costs.  Depot  costs  increase  with  increas¬ 
ed  number  of  shipments.  These  are  the  costs 
we  would  be  transferring  to  the  commercial 
distributors  by  us,ing  the  comnercial  distribu¬ 
tion  system  instead  of  DoD  depot  stockage.  We 
might  expect  some  increase  in  the  unit  price 
to  offset  this  increased  cost.  Sensitivity 
testing  suggests  that  direct  delivery  unit 
price  would  have  to 'be  15%  higher  in  order 

for  it  to  outweigh  the  depot  stockage  costs; 
and  then  that  would  only  be  for  low  frequency 
requisitioned  items.  It  would  require  over 
25%  differential  to  make  depot  stockage  of  a 
significant  number  of  items  economic. 


CONCLUSIONS 


CISP 


1.  Greater  use  should  be  made  of  the  Commer¬ 
cial  Distribution  System  (BPAs,  IDTCs)  by 
Defense  Supply  Centers. 

2.  Economics  alone  can  justify  stockage  only 
in  certain  cases.  Military  stockage  should 
not  be  based  upon  economics  alone. 

3.  Local/installation  management  is  not 
necessarily  the  most  economic  method  of  item 
management,  particularly  for  high  frequency 
demand  items. 
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FORWARD  PRICING  ARRANGEMENTS 

"COMMON  SENSE?' 

(Snail  Purchase) 

Col  Charles  E.  Wheeler,  Director  Procurement  &  Production 
OO-ALC  Hill  AFB  UT 


INTRODUCTION 


During  FY  1975  OO-ALC  D/PP  Management  deter¬ 
mined  to  take  unique  and  positive  action  in 
the  small  purchase  area  (PL  93-356  "  $10,000). 

The  main  thrust  of  management's  drive  was 
directly  placed  upon: 

1.  Excessive  administrative  costs 

2.  Increased  workload 

3.  Reduced  manpower  allocations 

4.  Negligible  return  in  negotiated 
savings 

5.  Customer  (D/MM)  unsatisfactory 
"fill  races'.' 

D/PP  Management  was  faced  with  "a  disproportion¬ 
ate  decrease  in  human  resources  being  expend :d 
on  sole  source,  small  purchases  with  minor 
returns  in  the  form  of  negotiated  reductions 
and  corresponding  50  +  days  of  administrative 
lead  time  that  contributed  to  the  unsatisfact¬ 
ory  "fill  rate"  of  our  assigned  weapon  system." 

The  first  part  of  Ogden's  D/PP  five  part  problem 
namely  excessive  administrative  costs,  is  shared 
by  all  in  DOD  as  can  be  seen  from  ASPM  <12, 

31  Mar  1976,  ".  .  .if  each  of  these  actions  were 
to  cost  $100  in ' admin i sera  Cion ,  DOD  would  be 
spending  $1  Billion  to  buy  $4.8  Billion.  .  .  ." 

The  second  and  third  parts  of  D/PP  Management's 
problem  are  illustrated:  FY  1975  Central 
Procurement  contractual  actions: 


Actions: 

Under  $10,000  - 

20,457 

842 

Over 

$10,000  - 

3,798 

162 

Total 

24,255  - 

1002 

Dollars: 

Under 

$10,000  - 

$32,706,488 

82 

Over 

$10,000  - 

402,167,815 

922 

Total 

$434,874,303 

1002 

Central  Procurement  authorized  allocations 
FY  75  first  quarter  367  ea  vs  FY  76  first 
quarter  350  -  17  ea  allocation  reduction. 

Note:  Salient  point  from  the  above  -  84X  of 
our  contractual  actions  spent  8X  of  our  pro¬ 
curement  dollars  and  with  reduced  manpower 
allocations. 

The  fourth  part  ot  the  problem  was  analyzed 
with  J041  statistic  Sample  Cycle  4  Information 
which  shoved: 


Period  12  Months 

Universe  $4,669,230.07 

Qty  3,666  actions 

Sample  $466,052.03 

Qty  369  actions 

Of  the  sample  (369  actions)  only  58  ea  had 
negotiated  amounts  of  $6,168.15  or  a  negligible 
negotiated  savings  (reduction  factor  of  1.32) 

The  fifth  part  of  Ogden  D/PP  problem  is  shared 
throughout  USAF  and  probably  DOD  and  is  due  to 
our  aging  weapon  systems  (out  of  production), 
increased  flying  or  on-line  time,  and  need  for 
the  related  spare  parts.  Compounding  this  is 
the  increased  administrative  or  procurement 
lead  time  which  then  delays  the  contractor 
delivery  date  to  satisfy  our  "fill  rate"  date 
of  PRs. 


STUDY 


The  entire  purpose  of  this  study  was  to  Innovate 
a  completely  new  concept  in  the  small  purchase 
area  that  would:  Remove  all  administrative 
lead  time  (issue  same  day  requirement  received-) 
reduce  administrative  cost3,  and  result  in 
satisfactory  earnings  to  industry  and  fair 
satisfactory  prices  to  DOD  that  would  withstand 
congressional  or  any/all  public  review. 

By  reducing  procurement  lead  time,  improve  the 
contractor's  delivery  time  which  would  improve 
our  customer's  "fill  rates." 

The  first  phase  of  our  study  was  conducted  with 
our  high  volume  major  suppliers  of  sole  source 
replenishment  spares,  namely,  McDonnell  Air¬ 
craft  Co  (KCAIR) ,  St  Louis  MO  -  F/RF-4  Spare 
Parts;  The  Boeing  Co,  Seattle  WA,  and  Rockwell 
International  Corp,  Autonetics  Croup,  Anehelm 
CA  on  our  Minuteman  (M/M)  Spare  Parts.  During 
the  period  Dec  1974  through  Jan  1975  HCAIR  re¬ 
ceived  contracts  in  the  following  dollar  cate¬ 
gories: 

$100  -  $2,500  »  121  ea 

$2,500  -  $5,000  -  22  ea 
$5,000  -  $15,000  -  30  ea 

$15,000  -  $50,000  -  16  ea 

Total  •  189  Contracts 

As  can  readily  be  seen,  MCAIR  received  a  pre¬ 
ponderance  of  small  purchase  contracts  result¬ 
ing  in  a  parallel  situation  of  disproportionate 
expenditure  of  their  resources. 


225 


-S 


-v  \ 


The  second  phase  was  ro  flow  che  procurement 
process  through  our  major  suppliers  (using 
MCA1R  as  ar  example).  Steps: 

1.  Buyer  would  receive  small  purchase  PR. 

2.  prepare  solicitation  and  mail. 

3.  Buyer  would  follow  up  with  TWX*  and 
telecons. 

4.  MCAIR  would  cake  up  to  30-45  days  to 
respond. 

5.  Buyer  would  attempt  analysis  and  negoti¬ 
ation  without  certified  cost  data. 

6.  Buyer  normally  would  request  an  extension 
of  quote  while  In  the  "tug  of  war"  for 
cost  data  on  these  small  purchases. 

7.  Confirming  wire  received  on  price  and 
delivery. 

8.  Price  documented  or.  small  purchase  PNM, 

DD  Form  1784. 

9.  Contract  submitted  for  l’CO  review. 

10.  Contract  issued. 

The  above  ten  seeps  took  an  average  50  to  70 
days  of  administrative  tit.e. 

The  third  phase  was  to  determine  if  valid  past 
prices  were  readily  available  so  that  the  luyer 
could,  upon  receipt  of  purchase  request  (PR), 
apply  a  time  factor,  utilize  the  past  delivery 
Information  for  the  part  number  on  the  PR  and 
issue  a  small  pre-priccd  purchase  order  contract 
the  same  day  as  PR  is  received  without  £  solici¬ 
tation  to  the  contractor  and  doing  away  with 
Steps  2-8  of  above.  For  example: 

Steps  2-8 

PR- 1  RFQ  QUOTF.  F.VAL  '.NEC  DOC  hWARD 

ELIMINATED 

if 

the  buyer  has  a  valid  prior  price 
to  use  in  conjunction  with  a  negoti¬ 
ated  forward  pricing  factor. 

In  this  third  phase,  different  methods  were 
used  in  establishing  the  past  base  prices  as 
being  valid  for  forward  pricing  purposes. 

MCAIR:  Approximately  700  part  numbers  were 
substantiated  with  cost  analysis  and  audit  and 
negotiations  due  to  a  MCAIR  cost  accounting 
change  (Analog  12+3,  1974';  therefore,  valid 
p36C  prices  for  these  7<*  part  numbers  were 
available . 

AU rOHETICS :  Two  Job  orders  -  concurrent  spare 
parts  and  nonconcurrene  spares  were  verified  in 
total  which  showed  a  loss/marginal  profit  to  the 
contractor.  A  statistical  sample  of  part  num¬ 
bers  was  verified  with  the  cognizant  field 
AFPRO  office. 

BOEING  CO:  Statistical  sample  of  part  numbers 
were  verified  by  the  cognizant  AFPRO  office  as 
being  the  latest  actualo  (per  part  number  ac¬ 
counting  system). 

The  fourth  phase  centered  on  a  pricing  formula 
which  could  be  applied  to  "past"  pricoo  vh'ch 
would  consider  the  difference  in  time  and  re¬ 
sult  in  "preaent"  day  prices.  Method  developed: 


'  <’ AIR:  Sample  common  parts  across  all  F-4 
series  were  priced  to  a  past  vs  current  posture 
Tc  this  posture  was  added  a  limited  set  up 
lactor  (compensate  for  tailing  down  of  produc¬ 
tion  of  aircraft)  +  current  rates  vs  past  time 
rates  were  applied  and  difference  between  com¬ 
putations  resulted  in  the  yearly  time  factors. 

MHONETICS :  Different  years  of  pricing  history 
were  re-estimated  to  '•urrent  pricing  conditions 
which  Included  updated  vendor  quotes,  Differ¬ 
ence  between  yearly  estimates  became  tine 
factors  to  apply, 

BOEING:  Unique  situation  -  cost  breakdowns  al¬ 
ways  provided  regardless  of  dollar  value. 
Therefore,  past  cost  breakdowns  are  used  adjust¬ 
ed  to  current  PR  quantities  and  negotiated  ACO 
forward  pricing  rates  are  applied;  contracts 
are  issued. 

The  fifth  phase  concerned  controls  on' the 
pricing  arrangements: 

Objective:  Equitable  earnings  to  contractor 
and  with  Government  protection  was  achieved  by: 

Cost  segregations  by  quarters/ semi-annual  by 
our  ALC  contractors.  Contractor's  reserve 
right  co  perform  a  reasonable  check  on  con¬ 
tracts  received  by  performing  a  current  intern¬ 
al  estimate  based  on  current  plant  conditions 
and  rates.  If  total  Internal  estimate  is  with¬ 
in  +  or  -  5 2,  then  contract  price  is  firm;  if 
not,  contract  adjusted  (Autoneclcs  ar.d  Boeing 
Co).  Twice  yearly  cost  vs  contracts  Issued  ore 
reconciled  if  earnings  are  within  +  or  -52  of 
target  earnings;  no  adjustment  made.  If  out¬ 
side  of  tolerance  factors,  adjustments  are  made 
to  the  time  factors  or  voluntary  refunds  are 
made  by  HCAIR  (only). 


RESULTS 


Ogden  D/PP,  under  this  unique  concept,  has 
issued  contracts  (which  our  three  above  con¬ 
tractors  would  accept  without  solicitation, 
not  knowing  what  part  number  or  quantity  was 
being  contracted  for)  in  one  day  with  a  minor 
amount  of  administration  costs  which  removed 
che  administrative  lead  time  and  consequently 
contractors  delivered  in  a  shorter  period 
which  was  greatly  more  responsive  co  the  PR 
need  daces. 

VOLUME  6  STATISTICS  (as  of  Feb  78) 

Contracts  issued  2,568  ea 

Dollars  contracted  $9,612,837 

Average  concract  value  $3,743 

^Average  days  to  Issue  14.6 

Z  of  delivery  changes  22.82 

X  errors  made  5.2% 

Dollars  credUod  back  to 

00-ALC  $415,000 

*from  PR  receipt  to  contract  distribution  con¬ 
sidering  routine  handling  Fr-ra  50  -*■  davs  to 
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15  or  70%  improvement.  Could  be  100%  improve¬ 
ment  since  capability  if  there  for  one  day 
issuance.  MCAIR  has  reduced  estimators  (lower 
overhead) . 

By  immediate  placement  of  orders  under  $10,000 
(upon  receipt  of  purchase  request)  allows  USA!-' 
to  compress  the  procurement  lead  time  and 
actually  shortens  the  production  lead  time 
which  substantially  Improves  contractor's  de¬ 
linquency  rates.  The  administrative  costs, 
i.e.  proposal  preparation,  reviews,  reproduc¬ 
tion,  transmittal  including  postage,  TUX'  tran¬ 
smitting  supporting  data,  or  extending  quota¬ 
tions  and  negotiation  telecons  all  have  been 
saved  on  the  2,568  ea  contracts  issued  as  of 
Feb  1978. 

Cost  savings  of  personnel  have  been  realized 
in  che  estimating  department  (MCAIR).  Con¬ 
tractor  has  applied  his  estimating  talents  to 
the  larger,  more  complex'  procurement  proposals. 
Further,  new  program  proposals  are  being  pre¬ 
pare!  with  the  existing  personnel  (to  our  know¬ 
ledge).  Instead  of  potential  sales  in  this 
area,  the  contractor  now  has  firm  sales,  as 
each  1155  and  or  priced  order  is  a  contractual 
instrument  to  proceed. 

Discussions  with  our  contractors  indicate  r  rm 
sales  vs  potential  sales  is  a  very  significant 
asset,  not  only  to  themselves  but  to  their 
vendors,  also  significantly  Impacts  deliveries. 


systems. 

"Spin  out"  benefits.  Subcontractor  delivery 
and  prices  were  notably  improved  due  to  firm 
contract  requirements  rather  than  a  "what  if" 
quotation  condition.  Flow  time  value:  AFI.O- 
wide  one  day  stock  fund  equals  approximately 
one  million  dollars  in  inventory. 

Initially  00-ALC  D/PP  'eld  these  agreements  to 
a  threshold  of  $10,000  per  line  item  '’contract). 
This  was  expanded  to  $25,000  per  line  item. 

As  refunds  and  adjustments  were  made  and  statis¬ 
tics  proved  that  these  arrangements  were  work¬ 
ing,  benefits  (verified)  were  occurring. 

Current  plans  include  contact  and  preliminary 
work  completed  with  the  following  potential 
contractors: 

Westinghouse  Electric,  Baltimore  MD  -  APQ  120 
Chicago  Aerial,  Barrington  IL  -  Camera  .Sysrens 
Texas  Instruments,  Dallas  TX  -  Radar  Systems 

Further  plans  are  to  raise  the  threshold  to 
$50,000  then  $100,000  as  inflation  continues 
and  manpower  decreeses  and  the  benefits  of 
this  method  of  procurement  are  further  proven. 
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for  example: 

MCAIR  (Data  thru  Jul  76) 

(1) 

ASPM  #2,  31  Mar  1976 

1st  Qtr 

2nd  Qtr 

(2) 

ASPR  1-109.1 

Nr  M  contracts 

172 

241 

Nr  Line  Items 

202 

284 

(3) 

ASPR  1-312 

Of  che  line  items 

39  -  FMS 

34  -  FMS 

Items  delivered  early 

131  -  70% 

177  -  72% 

(4) 

ASPR  3-807. 3(g)(1) 

Items  delivered  late 
PR  required  delivery: 

18  -  10% 

11  -  5% 

(5) 

ASPR  3-807.12 

Early 

78  -  50% 

138  -  78% 

Late 

38  -  24% 

13  -  7% 

(6) 

ASPR  16-813 

CUM 

(7) 

JAG  Legal  Opinion,  28  Mar  1977 

Thru  Jul  76  Thru  Jul  76 

BoelnR  Autonetics 

(8) 

J041  E9RM 

Nr  Contracts 

135 

102 

(9) 

Manpower  Source  List 

Nr  Line  items 

143 

107 

Item  with  deliveries 

78 

34 

(10) 

PL  93-356 

Items  delivered  early 

78  -  100% 

34  -  100% 

Items  delivered  late 
PR  required  delivery: 

0 

0 

(11) 

RCS  LOG  PP (Q)-7402 

Early 

65  -  832 

32  -  94% 

Late 

!  3  -  17% 

2  -  6% 

Under  this  unique  concept,  00-ALC  D/PP  has: 

Reduced  administrative  costs  to  both  D/PP  and 
the  various  contractors  which  has  considerably 
shortened  the  procurement  lead  time  given  to 
the  contractors  for  production  time  and  conse¬ 
quently,  has  Improved  delivery  times;  also  im¬ 
proved  the  "fill  rates"  of  assigned  weapons 


MILITARY  SYSTEMS  ACQUISITION  IN  A  COMMERCIAL  WORLD 


Lt  Colonel  Lee  A.  Rigby,  Deputy  for  KC-10  Joint  Program  Office 


KC-10  PROCUREMENT  OVERVIEW 


The  KC-.'.O  (also,  Advanced  Tanker/Cargo  Air¬ 
craft  (ATCA))  program  began  during  the  1967- 
1970  time  period  when  both  the  Air  Force's 
Strategic  Air  Command  (SAC)  and  Tactical  Air 
Command  (TAC)  recognized  a  requirement  for  in¬ 
creased  air  refueling  capability.  The  Air 
For.-o,  therefore,  conducted  a  study  of  ad¬ 
vance  I  tanker  design  options  which  emphasized 
new  aircraft  capabilities  and  costs.  All  new 
design  opti^.e  »  '«?  found  to  be  cost  prohibi¬ 
tive.  In  1971/1972,  flight  tests  were  conduc¬ 
ted  to  determine  the  feasibility  of  converting 
an  existing  wide-body  commercial  aircraft  into 
a  military  tanker  aircraft.  Simulated  refuel¬ 
ing  hookups  were  completed  using  a  modified 
B-747  aircraft  and  foremating  tests  were  com¬ 
pleted  using  a  DC-10.  Simultaneously,  renewed 
Interest  developed  In  an  advanced  capability 
cargo  aircraft.  As  a  result  of  these  activi¬ 
ties,  the  Air  Staff  issued  n  Program  Manage¬ 
ment  Directive  (PHD)  to  the  Air  Force  Systems 
Command  (AFSC)  in  February  1974.  The  PHD  di¬ 
rected  the  acquisition  of  a  commercial  wide- 
body  freighter  aircraft  m-'d-fled  only  as  neces¬ 
sary  to  provide  an  air  refueling  capability, 
and  fully  exploit  the  ajj craft's  cargo  carrying 
capability  cooraonsure.. *  with  the  Inherent  de¬ 
sign  of  the  aircraft  and  the  existing  fuselage 
structure.  Additionally,  AFSC  investigated  the 
cost  and  modifications  required  to  provide  a 
commercial  vlde-h-’’*  vi  freighter  aircraft  with 
oversize  ird  juts  .ze  cargo  capability.  It  also 
made  a  comprehensive  survey  to  assess  the  abil¬ 
ity  of  Industry  »  provide  a  full  range  of  lo¬ 
gistic  support.  After  going  through  two  starts 
and  stops  between  1974  and  1976,  the  procure¬ 
ment  process  for  the  program  was  finally  ini¬ 
tiated  In  early  1976.  The  Request  for  Proposal 
(SFP)  foi  acquicltion  was  released  in  August 
1976  and  the  RrF  fer  the  contractor  logistics 
support  program  was  subsequently  released  in 
September  1976.  The  source  selection  process 
was  suspended  in  February  ’977  due  to  the  elim¬ 
ination  of  funding  from  t  President’s  pro¬ 
posed  FY78  budget.  After  a  slx-nonth  delay, 
source  selection  resumed  In  August  1977  and  was 
completed  In  December  1977  with  the  award  of 
both  the  acquisition  anJ  logistics  support  con¬ 
tracts  to  the  Douglao  Aircraft  Company.  The 
aircraft  system  was  subsequently  named  the 
KC-10. 


GENERAL  PROCUREMENT  APPROACH 


From  Its  Inception,  the  KC-10  program  hao  been 
characterized  by  an  Innovative  approach  and  tne 
development  of  new  acquicltion  and  logistics 


support  procurement  methods.  One  of  the  most 
revolutionary  steps  taken  by  the  KC-10  Program 
Office  was  the  decision  to  procure  contractor 
logistics  support  of  a  major  weapon  system 
concurrent  with  the  procurement  of  the  system 
itself.  This  decision  was  based  on  the  con¬ 
clusion  that  concurrent  procurement  would 
force  early  consideration  of  support  require¬ 
ments  in  the  acquisition  contract,  encourage 
maximum  competition  for  the  logistics  support 
contract,  and  foster  innovative  support  pro¬ 
posals.  Additionally,  more  accurate  life 
cycle  cost  estimates  for  aircraft  selection 
purposes  would  result  because  actual  support 
costs  would  be  known. 


The  overall  approach  to  the  acquisition  of  the 
KC-10  was  also  novel  in  that  the  Air  Force  set 
out  to  fir.d  an  existing  aircraft  that  met  its 
needs  in  lieu  of  designing,  building  and  test¬ 
ing  a  system  from  the  "ground  up."  The  Boeing 
747  and  the  Douglas  DC-10  freighters  were  con¬ 
sidered  in  order  to  take  maximum  advantage  of 
commercial  Investment  existing  facilities  and 
an  on-going  production  line.  The  aircraft 
competition  was  limited  to  FAA  certified  wlde- 
fcody  freighter  aircraft  to  reduce  the  Govern¬ 
ment's  development  Investment  required  to 
qualify  other  wide-body  manufacturers-  An  FAA 
certlfica; fan  requirement  was  imposed  to  allow 
che  Air  Force  to  cake  advantage  o.'  existing 
commercial  investment,  design,  pri  lection  and 
quality  control  concepts,  thereby  reducing 
overall  costs.  The  chelae  of  an  FAA  certified 
freighter  al3o  insured  tnat  commercial  mainte¬ 
nance  systems  were  already  In  existence.  E; 
limiting  the  selection  to  a  derivative  of  an 
aircraft  i:.  active  commercial  service,  the  Air 
For- e  assured  that  benefits  of  spares  pools, 
exls.inr.  repair  facilities,  trained  repair 
specialist.,,  etc.,  would  be  available  to  sup¬ 
port  the  aircraft. 


The  decision  to  procure  logistics  support  con¬ 
currently  with  the  aircraft  acquisition  pre¬ 
sented  the  Air  Force  with  some  Interesting 
problems.  Contractors  were  being  asked  to 
develop  a  logistics  support  program  that 
would  provide  support  for  an  unknown  type  and 
quantity  of  airplanes  located  at  an  unknown 
base  or  bases.  At  first  glance,  the  problem 
seemed  baffling,  but  further  research  revealed 
the  task  could  be  accomplished.  The  methods 
used  co  accomplish  this  task  will  be  ex¬ 
plained  in  more  depth  later  In  this  report. 


KC-10  SYSTEM  ACQUISITION  PROCUP.ELimT 


The  KC-10  Acquisition  Contract  is  for  the  pro¬ 
duction  engineering  (nonrecurring),  cost  and 
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production  of  the  KC-10  system.  In  addition 
to  the  effort  required  to  modify  the  commercial 
DC-10-30CF  aircraft  into  a  KC-10,  the  following 
additional  tasks  will  also  be  performed: 

a.  Initial  aircrew  training. 

b.  Predelivery  test  program. 

c.  Logistics  support  for  predelivery  test 
program. 

d.  Program  management  and  systems  engi¬ 
neering. 

e.  Data,  technical  orders  and  manuals  re¬ 
quired  for  the  KC-10. 

f.  Provide  KC-10  peculiar  support  equip¬ 
ment. 

The  overall  philosophy,  as  stated  above,  was 
to  take  maximum  advantage  of  the  existing  com¬ 
mercial  wide-body  aircraft  investment,  exper¬ 
ience,  resources,  and  business  structure. 
Additionally,  a  contractual  program  was  de¬ 
sired  which  would  provide  flexibility  to  accom¬ 
modate  future  funding  fluctuations  without  re¬ 
quiring  aircraft  price  renegotiation.  There¬ 
fore,  the  following  ground  rules  were  estab¬ 
lished  for  the  KC-10  acquisition  procurement: 

a.  Existing  commercial  practices  would  be 
used  to  the  maximum  extent  possible  even  on 
the  military  modifications.  This  would  in¬ 
clude  business  as  well  as  technical  and  manage¬ 
ment  considerations. 

b.  Federal  Aviation  Administration  (FAA) 
type  certification  would  be  obtained  on  the 
total  aircraft.  This  would  include  certifica¬ 
tion  of  the  military  modifications. 

c.  Military  peculiar  modifications  to  the 
basic  commercial  freighter  would  be  made  in¬ 
line. 

d.  Military  specifications  and  require¬ 
ments  would  be  held  to  a  minimum. 

e.  All  nonrecurring  costs  would  be  incur¬ 
red  during  the  first  two  fiscal  years  of  fund¬ 
ing  with  no  cancellation  costs  remaining  at 
the  end  of  any  year.  Such  an  approach  -would 
enable  the  Air  Force  "to  bite  off"  a  little 
piece,  of  the  program  at  a  time  without  incur¬ 
ring  a  large  termination  liability.  To  do 
this,  the  contract  strategy  and  structure  pro¬ 
vided  for  discrete  efforts  for  each  fiscal 
year  with  no  obligation  to  start  the  naxt 
year's  effort. 

f.  An  aircraft  Unit  Price  Matrix  (UPM) 
would  be  included  to  provide  aircraft  prices 
accommodating  varying  fiscal  year  funding 
levels.  This  UPM  established  firm  in-base 
year  76  dollars  for  each  of  two  to  sixty 


aircraft.  Thun,  with  each  fiscal  ypnr.  the 
Government  lute  the  flexibility  to  purchase 
varying  numbers  of  aircraft  at  a  predetermined 
price. 

To  Insure  the  solicitation  provided  adequate 
opportunity  to  propose  commercial  practices, 
copies  of  the  RFP  in  draft  format  were  made 
available  to  each  contractor  for  review  and 
comment.  A  source  selection  team  subse¬ 
quently  visited  each  contractor's  facility  to 
discuss  RFP  lmprovement/ref lnemcnt  sugges¬ 
tions.  Simultaneously,  an  internal  Air  Force 
review  of  the  draft  RFP  was  conducted  to  re¬ 
solve  significant  issues.  The  result  was  the 
release  of  an  RFP  which  provided  optimum  con¬ 
tractor  flexibility  to  propose  commercial  ar¬ 
rangements  and  procedures  wh'xlc  still  retain¬ 
ing  the  integrity  of  the  Air  Force's  require¬ 
ments.  The  draft  RFP  process  also  greatly 
enhanced  the  contractor's  understanding  of  the 
overall  procurement,  resulted  in  the  submis¬ 
sion  of  complete  and  comprehensive  proposals, 
and  greatly  facilitated  the  overall  source 
selection  process. 

The  source  selection  was  conducted  following 
the  provisions  outlined  in  ATR  ?Q— 15,  "Source 
Selection  Policy  and  Procedures."  The  Secre¬ 
tary  of  the  Air  Force  was  the  Selection 
Authority  for  both  the  acquisition  and  logis¬ 
tic  support  efforts.  The  Source  Selection 
Advisory  Council  was  Jointly  organized  under 
an  Air  Force  Logistics  Command  chairman  and 
an  Air  Force  Systems  Command  deputy  chairman. 
Further,  the  Source  Selection  Evaluation 
Board  was  formed  with  resources  from  the 
Joint  Program  Office  forming  the  nucleus. 
People  were  drawn  from  many  Air  Force  com¬ 
mands  and  placed  on  the  technical,  operations, 
logistics,  management,  contracts,  test  and 
cost  panels. 

Selection  of  the  KC-10  aircraft  was  based  on 
an  Integrated  assessment  of  evaluation  areas 
set  forth  in  the  RFP  utilizing  formal  source 
selection  procedures.  The  selection  was 
based  on  the  evaluation  of  all  areas,  includ¬ 
ing  capability,  cost  (including  life  cycle 
costs),  management  and  production  systems, 
technical  risk,  supportabllity  and  schedule. 
"Terms  and  conditions"  were  also  evaluated, 
including  evaluation  items  for  each  offeror’s 
overall  business  arrangement  and  certifica¬ 
tions  and  repreaentatlons. 

An  Initial  contracting  obstacle  was  the  de¬ 
velopment  of  a  procedure  for  equalizing  the 
disparity  in  price  and  capability  existing 
between  the  two  candidate  aircraft.  It  was 
determined  that  normalcy  in  the  competition 
could  be  achieved  by  stating  "funding  bogeys” 
in  the  RFP  for  FY77-82  based  on  the  Five  Year 
Defense  Program  (FYDP) .  This  profile  vss  re¬ 
ferred  to  in  the  RFP  as  the  "green  line"  pro¬ 
file.  The  contractors  then  used  this  profile 
to  bid  the  maximum  number  of  aircraft  that 


couJd  be  provided  each  fiscal  year  after  all 
nonrecurring  engineering  and  test  effort  was 
accomplished.  The  resultant  aircraft  quanti¬ 
ties  and  their  inherent  operational  capability 
were  then  compared  in  the  performance  of  speci¬ 
fied  missions  in  the  evaluation  process. 

Baaed  on  the  fiscal  year  structure  used  in  the 
solicitation  process,  the  acquisition  contract 
was  eventually  structured  in  the  general  for¬ 
mat  graphically  summarized  below: 
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In  addition  to  the  unique  approach  of  provid¬ 
ing  a  quantity  of  aiveraf '  for  a  given  Govern¬ 
ment  investment  versus  .cleg  a  specific  air¬ 
craft  quantity,  the  soli  Ration  also  offered 
each  offeror  the  opportunity  to  propsae  com¬ 
mercial  provisions  which  were  consistent  with 
their  cxiscing  business  structure.  This  ap¬ 
proach  was  referred  to  as  the  contractor's 
"Best  Business  Arrangement"  and  vaa  an  evalu¬ 
ation  iton  in  the  source  selection  process. 

The  Government  formulated  "Best  Business 
Arrangement"  objectives  to  evaluate  the  con¬ 
tractors  '  proposals  against.  All  terms  and 
conditions  proposed  were  assessed  for  reason¬ 
ableness  and  acceptability.  Commercial  pro¬ 
visions  proposed  were  generally  accepted, 
with  negotiations  concentrating  on  tailoring 
them  so  as  to  be  acceptable  within  the  general 


framework  of  Government  procurement  rules  and 
regulations.  A  brief  summary  of  several  of 
the  more  significant  contract  provisions  and 
features  follows: 

a.  Federal  Aviation  Administration  (FAA) 
Requirements.  This  provision  stipulates  that 
the  KC-10  aircraft  must  be  FAA  certified  and 
sets  forth  the  FAA  certification  documents 
associated  with  the  aircraft's  development  and 
production  which  must  be  provided.  Another 
provision  of  the  contract,  "Configuration 
Management,"  also  requires  that  changes  in  FAA 
certification  requirements  will  be  incorpor¬ 
ated  in  each  undelivered  aircraft  at  no 
change  in  contract  price,  if  affecting  all 
wlde-body  aircraft  and  promulgated  within  18 
months  after  contract  award,  or  unique  to  the 
DC-10  regardless  of  when  promulgated.  This 
approach  is  considered  consistent  with  com¬ 
mercial  aircraft  procurements. 

b.  Special  Dsta  Provisions.  This  pro¬ 
vision  sets  forth  the  rights  that  shall  be 
provided  with  all  data  delivered  under  the 
contract.  All  data  associated  with  KC-10  pe¬ 
culiar  requirements  generated  under  this  con¬ 
tract  shail  be  provided  with  unlimited  rights. 
All  other  data  shall  be  provided  with  special 
rights  which  shall  permit  its  dissemination 
by  the  Air  Force  for  competitively  procuring 
all  future  logistics  requirements  for  any 
Government-owned  DC-10  type  aircraft,  with  the 
exception  of  parts  manufacture. 

Economic  Price  Adjustment  (EFA) .  Option 
aircraft  for  FY80-8J  are  priced  in  FY76  base 
year  dollars.  The  contractor  proposed  their 
commercial  EPA  clause  to  adjust  base  year 
prices  to  the  time  of  slrcraft  delivery.  The 
clause  adjusts  the  airframe  and  engine  prices 
individually.  The  Airframe  and  engine  base 
year  prices  are  adjusted  by  the  following  es¬ 
tablished  indexes: 

INDEX  WEICHT 

Airframe  Average  Hourly  .75 

Gross  Earnings  Per  Pro¬ 
duction  Worker  on  Pay¬ 
rolls  of  Nonagricultural 
Establishments  -  Durable 
Goods  (SIC  3721) 

Wholesale  Price  Index  of  .25 

Industrial  Commodities 

Engine  Hourly  Earnings  of  Air-  .333 

craft  Engines  and  Engine 
Parts  Production  Workers 

Industrial  Commodities  .333 

Index 

Metals  and  Metal  Pro-  .333 

ducts  Index 
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d.  Special  Progress  Payments.  All  pay¬ 
ments  for  nonrecurring  effort  shall  be  made 
pursuant  to  normal  Armed  Services  Procurement 
Regulation  (ASPR)  progress  payment  procedures. 
Production  aircraft  will  be  paid  for  pursuant 
to  a  predetermined  payment  profile  based  on 
estimated  in  lieu  of  actual  costs.  This  pro¬ 
file  is  based  on  historical  cost  accumulation 
experience  associated  with  the  fabrication  of 
a  commercial  DC-10.  The  contractor  is  re¬ 
quired  to  provide  a  certification  that  pay¬ 
ments  made  at  any  point  in  time  do  not  exceed 
802  of  costs  incurred  to  date. 

e.  Warranty  and  Service'  Life  Policy. 

Douglas  proposed  their  standard  commercial 
Warranty  and  Service  Life  Policy  to  cover  all 
aircraft  and  other  deliverable  equipment.  The 
logistics  support  contractor  can  act  on  behalf 
of  the  Government  in  using  all  warranties. 
Douglas  expanded  their  general  warranty  cover¬ 
age  from  2  years  after  aircraft  delivery  to  5 
years  to  be  compatible  with  projected  KC-10 
usage  factors,  1-1/2  hours  per  day,  540  hours 
per  year.  Design  defect  warranty  coverage  has 
also  been  provided  for  a  24  month  period  after 
aircraft  delivery,  with  all  defects  also  to  be 
corrected  in  all  undelivered  aircraft.  The 
service  life  policy  provides  coverage  on  selec¬ 
ted  airframe  components  for  10  years/30,000 
hours  and  selected  landing  gear  components  for 
10  years/30,000  hours/20,000  landings.  Ad¬ 
justments  under  the  service  life  policy  are 
made  on  a  "prorated"  cost  basis.  The  warrancy 
includes  several  KC-10  peculiar  structural 
components  in  addition  to  the  items  normally 
covered  under  their  service  life  policy  for 
the  commercial  aircraft. 

f.  Most  Favored  Customer  Warranty.  This 
warranty  is  a  contractor  coaaltment  that  the 
price  charged  the  Government  for  the  basic 
aircraft  portion  of  each  KC-10  shall  not  exceed 
the  price  charged  any  other  commercial  cus¬ 
tomer  for  the  same  basic  aircraft  model  deliv¬ 
ered  during  the  same  time  period.  The  pro¬ 
vision  also  provides  similar  price  protection 
for  catalog  spare  parts,  standard  commercial 
aircraft  changes,  and  aircraft  changes  re¬ 
quired  to  meet  FAA  certification  requirements 
in  all  undelivered  aircraft. 

g.  Follow-on  Price  Warranty.  This  pro¬ 
vision  is  a  contractor  commitment  that  the  Air 
Force  will  continue  to  receive  most  favored 
customer  status  as  defined  in  each  contract's 
Host  Favored  Customer  Warranty  provision  in  any 
future  KC-10  procurements. 

h.  Options.  This  provision  sets  forth  the 
options  provided  to  the  Government  for  pur¬ 
chase  of  production  aircraft.  It  provides 
latitude  to  purchase  aircraft  through  F283  at 
predetermined  base  year  FT76  prices.  The 
Option  clause  sets  forth  two  option  environ¬ 
ments.  The  basic  (Green  Line)  option  quanti¬ 
ties  and  prices  are  set  forth  by  fiscal  year 


and  are  based  on  the  RFP's  Green  Line  funding 
profile.  This  option  arrangement  provides 
for  the  procurement  of  20  total  aircraft.  In 
the  event  different  quantities  are  ordered  in 
any  fiscal  year,  aircraft  are  purchased  from 
the  UPM  which  results  in  different  prices  de¬ 
pendent  on  the  quantity  of  aircraft  procured. 
The  Matrix  includes  individual  base  year 
prices  for  a  quantity  of  2  to  60  aircraft. 

The  contractor  priced  each  aircraft  using  the 
following  formula:  Commercial  airframe  base 
price  +  KC-10  peculiar  base  price  -  airframe 
discount  «  net  eirf^-mc  base  price  +  engine 
base  price  •  total  net  br.3e  price.  The  pric¬ 
ing  structure  is  consistent  with  commercial 
aircraft  pricing  arrangements.  The  UPM  af¬ 
fords  the  flexibility  to  procure  varying 
quantities  of  aircraft  depending  on  fiscal 
year  funding  available.  All  options  must  be 
exercised  by  1  December  of  each  year.  They 
must  also  be  exercised  consecutively  and  for 
at  least  the  minimum  quantities  set  forth  in 
the  contract. 

i.  Ceneral  Provisions.  The  KC-10  con¬ 
tract  contains  essentially  the  general  pro¬ 
visions  required  by  the  ASPRs,  except  where 
minor  deviations  were  granted.  In  audition, 
certain  general  provisions  have  beer,  made  ao- 
pllcable  to  KC-10  peculiar  requirements  only. 
These  provisions  (e.g.,  Co3t  Accounting  Stan¬ 
dards,  Administration  of  Cost  Accounting 
Standards,  etc.)  are  not  applicable  to  arti¬ 
cles  whose  prices  arc  based  on  commerciality 
(i.e.,  DD  Form  633-7)  and  were  so  limited. 

J .  Quality  Assurance  and  Manufacturing 
Processes/Procadures.  '•jallty  assurance  and 
manufacturing  shall  be  accomplished  in  ac¬ 
cordance  with  the  contractor's  FAA  approved 
quality  and  manufacturing  systems.  It  was 
determined  that  the  existing  approved  FAA 
systems  In  both  areas  were  consistent  with 
applicable  Government  requirements. 

k.  Testing.  The  aircraft  testing  will  be 
accomplished  by  the  contractor  during  a  six 
month  period  between  April  and  October  1980 
on  the  first  KC-10.  Air  Force  ccsting  will 

be  limited  to  those  chenges  required  to  con¬ 
vert  the  DC-10  to  a  KC-10  and  Insure  that  all 
specification  requirements  are  achieved. 

l.  Spares  Acquisition  Integrated  with 
Production.  Provisions  were  included  in  the 
acquisition  contract  to  require  the  contrac¬ 
tor  to  reduce  the  acquisition  price  of  KC-10 
peculiar  spare  parts  and  improve  logistic 
support  by  (1)  concurrent  ordering  of  certain 
selected  spare  part3  with  the  end  item  to  cske 
advantage  of  quantity  and  production  econo¬ 
mies,  and  (2)  securing  proposals  for  firm 
prices  for  spare  parts  co  be  supplied  to  the 
Government  as  investment  material. 
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KC-10  LOGISTICS  SUPPORT  PROCUREMENT 


Under  the  KC-10  logistics  support  concept,  the 
contractor  is  responsible  for  the  majority  of 
Che  KC-10  aupporc  effort.  The  contract  sup¬ 
port  arrangements  are  predicated  on  operations 
being  conducted  primarily  from  a  Main  Oper¬ 
ating  Base  (KOBJ  with  short  duration  staging 
operations  possible  from  other  bases.  Longer 
duration  deployments  involving  establishment 
as  operacions/iralntenance  capabilities  at  for¬ 
ward  operating  locations  are  not  contemplated. 
The  supply  support  concept  is  for  the  con¬ 
tractor  to  support  KC-10  spares  requirements 
from  a  Contractor  Operated  and  Meintained 
Base  Supply  (COMBS)  activity  looted  on  the 
MOB.  The  r’n1 'actor  may  use  any  .callable 
commercial  3ource  when  support  foe  the  KC-10 
is  required  uwav  from  the  MOB.  The  Air  Force 
is  responsible  for  the  overall  KC-10  mainte¬ 
nance  management  effort  as  well  as  organiza¬ 
tional  and  intermediate  level  maintenance. 
Specifically,  the  work  performed  by  Air  Force 
personnel  falls  into  s.'/  categories;  pre¬ 
flight  check/ inspection,  turnaround  check/ 
inspection,  postflighc/servicing  inspection 
check,  routine  phase  check,  minor  corrosion 
control  check,  and  nonroutine/correccivc 
action  maintenance.  The  contractor  la  re¬ 
sponsible  for  all  other  intermediate  and  all 
depot  level  maintenance  functions. 


In  order  to  solve  the  uncertainty  problem 
caused  by  the  concurrent  procurement  of  logis¬ 
tics  supporC  and  Che  acquisition  of  the  air¬ 
craft,  aa  attempt  was  made  to  break  the  logis¬ 
tic  support  effort  into  les  simplest  compo¬ 
nents.  After  many  meetings  with  logisticians, 
maintenance  oeroonncl  and  operational  Air 
Force  organizations,  the  procurement  team  de¬ 
cided  the  effort  could  logically  be  broken 
down  into  lx  component  parts.  These  compo¬ 
nents  were:  (a)  a  preoperational  period,  (b) 
inlcial  lay  in  of  apare  parts  and  support 
equipment,  (c)  the  mobilization  effort  neces¬ 
sary  to  activate  the  MOB(s) ,  (d)  flight  hour 
component,  <e)  the  fixed  cost  of  operating  and 
maintaining  the  M03(s) ,  and  (f)  a  catch  all 
area  referred  to  us  over  and  above. 


The  preoperational  perio'  Jr.s  defined  ns  the 
period  of  time  from  coni  act  award  date  until 
the  delivery  of  the  f .rc'  operational  aircraft 
(approximately  33  months) .  The  effort  re¬ 
quired  of  the  contractor  during  this  period 
la  seen  as  a  planning  and  coordinating  task. 
Specific  examples  of  tasks  that  will  be  per¬ 
formed  during  this  phase  of  the  contract  are 
developing  an  Integrated  Support  Flan,  per¬ 
forming  an  analysis  and  review  of  KC-10  sup¬ 
port  equipment  requirements,  performing  an  in- 
depth  study  of  materiel  handling  equipment  re¬ 
quirements,  evaluating  the  effect  of  proposed 
aircraft  configuration  changes  on  the  support- 
ability  of  the  KC-10,  provisioning  of  both 
aircraft  and  support  equipment  spare  part3, 


and  defining  specific  maintenance  casks  that 
will  have  to  be  performed. 


The  investment  material  component  is  comprised 
of  all  spare  parte,  support  equipment  and  any 
other  materials  that  arc  needed  to  support  the 
alrcrr.ft.  Materiel  required  to  provide  for 
replenishment,  obsolescence,  etc.,  is  specif¬ 
ically  excluded  from  the  initial  Investment 
component.  Because  the  KC-10  was  expected  to 
have  a  high  degree  of  commonality  with  com¬ 
mercial  versions  of  the  aircraft  chosen,  it 
was  expected  that  the  logistics  support  con¬ 
tractor  would  be  able  to  use  cxis*  ip,  commer- 
ci..I  iioontorles  to  provide  a  por.  .on  of  the 
investment  natc-rlcl  required.  Accordingly, 
the  offerors  were  given  the  latitude  to  com¬ 
mingling  materiel  specifically  purchased  for 
the  KC-10  effort  with  existing  inventories. 

The  contractor  will  stack  Investment  materiel 
to  support  our  operational  requirements  aud 
use  the  commercial  base  as  the  situation  dic¬ 
tates. 


The  MOB  activation  component  is  comprised  of 
the -'nonrecurring  effort  necessary  to  activate 
th*  contractor's  operations  at  the  MOB(s) . 

The  efforts  include  moving  employees  to  the 
MOB  site,  provH-'-ig  the  necessary  communica¬ 
tions,  furnishings,  shelving  and  warehouse 
material  handling  equipment. 


The  flight  hour  component  encompasses  the 
labor  effort  and  material  necessary  to  oper¬ 
ate  the  aircraft  on  a  aally  basis.  In  per- 
inrounce  of  this  tffort,  die  contractor  pro- 
ides  replenishment  spares,  spares  mainte¬ 
nance,  periodic  aircraft  Inspections  and  the 
maintenance  effort  for  all  support  equipment, 
except  that  drawn  from  USAF  Inventories.  The 
costs  assoclnted  with  this  effort  arc  a  func¬ 
tion  of  aircraft  flying  hours.  Accordingly, 
this  effort  is  seen  as  the  variable  cost  per 
flight  hour  portion  of  the  maintenance  effort. 


The  fifth  category  of  effort  consists  of  all 
fixed  cosc  activities  necessary  to  maintain 
and  operate  the  contractor's  activities  at 
the  MOB.  This  effort  consists  of  3uch  activ¬ 
ities  as  providing  supply  and  clerical  per¬ 
sonnel  necessary  to  manage  the  spar,  pacts 
operation,  providing  contractor  field  service 
representative  to  act  as  advisors  to  the  All 
Force  performed  on  aircraft  maintenance  effort, 
and  pro-  /.ding  the  housekeeping  supplies  and 
services  necessary  to  operate  the  MOB. 


A  sixth,  Cmprlced  area  called  "over  and  above” 
was  added  to  the  contract.  This  category  in¬ 
cludes  all  work  required  by  the  contractor 
hat  not  included  in  the  previous  five  cate¬ 
gories.  This  category  is  seen  as  emergency  or 
special  contingency  type  work.  The  p'*ces 
and  performance  periods  for  over  And  above 
work  will  be  negotiated  at  a  time  when  spe¬ 
cific  over  and  above  work  in  identified. 

Over  and  above  work  includes  such  things  as 
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field  team  crash  damage  repair,  unscheduled 
heavy  maintenance,  aircraft  modifications  re¬ 
sulting  from  service  bulletins  or  engineering 
change  proposals  after  the  aircraft  are 
placed  in  service  and  flying  hours  in  excess 
of  those  provided  for  in  the  flying  hour  com¬ 
ponent  of  the  contract. 

In  order  to  contractually  accommodate  this 
breakdown  of  the  effort  required,  the  logis¬ 
tics  support  contract  made  liberal  use  of  re¬ 
curring  options.  The  basic  contract  served 
as  the  procurement  vehicle  for  the  preoper- 
ational  phase  effort,  an  unpriced  line  item 
was  incorporated  to  provide  the  over  and  above 
capability  and  four  options  were  established 
to  provide  the  capability  to  procure  the  re¬ 
mainder  of  the  effort. 

The  option  to  provide  the  returnable  invest¬ 
ment  material  is  a  recurring  option.  It  con¬ 
sists  of  a  matrix  of  ceiling  prices  which 
allow  the  Air  Force  to  procure  returnable  in¬ 
vestment  material  for  1  to  16  aircraft  at  from 
1  to  3  MOBs.  The  Air  Force  has  freedom  to 
control  both  the  number  of  aircraft  and  the 
number  of  MOBs.  There  is  no  requirement  to 
completely  fill  one  MOB  with  16  aircraft  be¬ 
fore  activating  another  MOB. 

It  is  stressed  that  the  matrix  is  composed  of 
celling  prices.  The  matrix  contained  in  the 
contract  appears  below: 
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This  matrix  operates  as  follows.  Suppose 
that  the  Air  Force  has  a  projected  KC-10 
fleet  of  three  aircraft .  For  the  first  year, 
Option  one  would  be  exercised  for  three  air¬ 
craft,  with  a  ceiling  price  of  15.3  million 
dollars.  Upon  option  exercise,  the  contractor 
begins  his  provisioning  process  and  determines 
the  kinds  and  quantities  of  returnable  invest¬ 
ment  material  required  to  support  three  air¬ 
craft.  The  contractor  then  compiles  a  priced 
listing  of  the  required  material  and  submits 
the  listing  to  the  Air  Force  for  review.  The 
Air  Force  then  reviews  the  listing  for  the 
purpose  of  determining  if  some  listed  items 
may  be  available  from  existing  Air  Force  in¬ 
ventories.  If  items  are  available,  then  the 
Air  Force  can  remove  them  from  th«  listing 
submitted  by  the  contractor  and  provide 
Government  equipment  to  perform  the  required 
tasks.  In  the  event  of  such  substitution, 
the  ceiling  price  is  reduced  by  an  amount 
equal  to  the  corresponding  amount  on  the 
priced  listing  originally  submitted.  The  con¬ 
tractor  is  then  paid  for  equipment  purchased 
au  it  is  delivered  up  to  the  ceiling  price 
amount.  The  contractor  is  required  to  provide 
investment  material  in  sufficient  quantities 
to  support  a  1200  hour  per  year  flying  program 
for  each  aircraft.  If  the  provisioning  model 
used  by  the  contractor  does  not  provide  in¬ 
vestment  material  adequate  to  meet  the  per¬ 
formance  parameters  set  forth  in  the  contract, 
the  contractor  is  obligated  to  procure  addi¬ 
tional  investment  material.  Should  this  be 
necessary,  however,  the  contract  price  will 
only  be  Increased  to  the  ceiling  price.  Any 
material  required  after  the  ceiling  price  has 
been  reached  must  be  provided  at  contractor 
expense. 

If,  at  some  time  in  the  future,  the  KC-10 
force  size  would  be  increased  to  10  aircraft, 
the  option  ceiling  price  would  be  increased 
to  31. A  million.  At  this  point,  the  con¬ 
tractor  would  start  the  process  over  by  sub¬ 
mitting  a  proposed  list  of  equipment  to  be 
purchased  with  the  additional  16.1  million 
dollars  to  support  the  7  additional  aircraft. 

Contractual  coverage  for  the  site  activation, 
flying  hour  program,  and  MOB  operation  por¬ 
tions  of  the  logistics  support  effort  was 
also  provided  through  the  use  of  options. 
Option  2  for  site  activation  is  exercised 
once  for  each  MOB  on  a  fixed  price  basis. 
Option  3  (flying  hour  program)  and  Option  4 
(MOB  operation)  are  exercised  on  a  recurring 
fiscal  year  basis.  Option  3  prices  are  fixed 
prices  on  a  flying  hour  dependent  matrix  and 
Option  A  prices  are  fixed  prices  on  an  air¬ 
plane  per  MOB  dependent  matrix. 

The  requirement  for  an  exercise  of  Options  3 
and  A  each  fiscal  year  places  a  requirement 
on  the  Air  Force  to  take  positive  action  each 
year  in  order  to  continue  the  effort  under 
this  contract.  In  the  absence  of  this 
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positive  action,  the  contract  simply  expires, 
all  returnable  Investment  material  procured 
through  Option  1  is  retained  by  the  Air  Force, 
and  no  termination  liability  is  incurred  by 
the  Government.  The  end  result  is  a  contract 
with  built-in  flexibility  to  allow  the  Air 
Force  wide  latitude  in  the  area  of  contractor 
logistics  support. 

The  use  of  contractor  logistics  support  re¬ 
sults  in  a  significant  reduction  of  facilities' 
investment  cost  to  the  Air  Force.  These  sav¬ 
ings  were  realized  because  the  logiatics  sup¬ 
port  contractor  chose  not  to  invest  in  any  new 
repai.  or  maintenance  facilities,  but  to  use 
existing  excess  capacity  in  the  hands  of  the 
commercial  airlines.  Although  no  single  air¬ 
line  has  reserve  capacity  great  enough  to 
handle  all  of  the  KC-10  requirements,  the 
total  of  this  excess  capacity  is  more  than 
adequate  to  meet  the  KC-10's  reeds.  The 
logistics  support  contractor  is  able  to  take 
advantage  of  this  excess  capacity  by  the  use 
of  extensive  subcontracting. 

When  a  part  or  defective  item  of  support 
equipment  is  turned  over  to  the  logistics 
support  contractor,  he  turns  it  over  to  a 
commercial  FAA  certified  repair  facility. 

'The  details  of  accomplishment  such  as  modifl- 
cationo,  improvements  or  configuration  stan¬ 
dards  will  be  managed  by  the  contractor. 

The  repair  agency  will  be  tasked  with  pro¬ 
viding  ull  the  effort  required  to  complete 
the  repair.  There  will  be  no  exchange  of 
components  at  the  repair  facility.  The  same 
part  will  be  returned  to  the  logistic  support 
contractor  upon  completion  of  the  repair. 

This  feature  assures  that  KC-10  components 
will  all  retain  the  name  configuration  status. 

Another  savings  advantage  accrues  to  the  Air 
Force  in  the  area  of  provisioning.  At  the 
time  of  KC-10  provisioning,  a  cumulation  of 
data  compiled  over  three  and  one  half  million 
flying  hours  of  commercial  DC-10  will  have 
been  umassed.  Employment  of  a  contractor 
originated  computer  program  utilizing  Mean 
Time  Between  Failure  (MTBF) ,  removal  rates, 
flight  frequency,  minimu'-  protection  level, 
aircraft  utilization,  :  mir  turn-around  time, 
and  procurement  lead  tiue  help  to  insure  that 
only  the  minimum  number  of  spares  required  to 
do  the  Job  will  be  purchased. 

Compounding  this  savings  is  the  advantage 
gained  by  not  having  to  procure  high  dollar 
low  usage  spare  parts  (Insurance  Spares) . 
Insurance  ItemB  are  always  expensive  and  are 
usually  not  actually  used.  They  are  gener¬ 
ally  procured  and  stored  in  a  warehouse.  If 
they  are  used,  It  Is  generally  only  for  the 
period  of  tlraa  that  it  takes  to  repair  the 
damaged  unit.  If  and  when  there  is  a  nerd 
for  such  lleran  on  the  KC-10,  we  will  ho  able 
to  rent  an  icom  for  the  period  of  time  it 
rakes  co  got  live  damaged  item  repaired  from 


the  logistic  support  contractor's  inventory 
of  such  items  that  is  maintained  in  support 
of  the  commercial  users  of  the  DC-10. 

Because  the  contractors  were  asked  to  quote 
firm  or  vedeterminable  price  arrangements  for 
logistics  support  extending  to  September  of 
198A,  it  was  felt  that  the  contractors  would 
build  in  an  excessive  hedge  against  inflation 
unless  an  economic  price  adjustment  provision 
was  included  in  the  contract.  Since  the  pre- 
operational  support  effort  called  for  by  the 
basic  contract  will  be  completed  in  October 
lvbu,  we  didn't  feel  the  risk  of  inflation 
on  the  coct  01  this  effort  would  be  too  great 
for  the  contractor  to  assume.  For  "this 
reason,  the  economic  price  adjustment  clause 
negotiated  and  included  in  the  contract  is 
applicable  to  the  Option  provisions  only. 

The  economic  price  adjustment  clause  in¬ 
cluded  in  the  logistics  support  contract 
adjusts  the  Option  prices  in  accordance 
with  the  movements  of  the  Department  of  Labor 
Index  of  Employment  and  Earnings,  SIC  3721, 
and  the  Wholesale  Price  and  Price  Index  for 
industrial  commodities.  For  Option  1,  which 
contains  a  great  many  spare  aircraft  parts, 
the  movements  of  the  metal  and  metal  pro¬ 
ducts  classification  of  the  Wholesale  Price 
and  Price  Index  have  also  been  factored  into 
the  economic  price  adjustment  formula 
During  the  proposal  evaluation  the  movements 
of  these  indexes  were  gathered  for  the  lest 
ten  years  and  were  analyzed  for  any  indica¬ 
tion  of  abnormal  movement.  This  analysis 
revealed  that  the  indexes  acted  as  a  reason¬ 
able  predictor  of  actual  economic  conditions 
and  that  no  significant  advantage  would  have 
been  gained  by  the  contractor  over  this 
period  of  time  if  an  agreement  identical  to 
the  contractual  economic  price  adjustment 
provision  had  been  in  effect. 

In  the  operational  aspect  of  this  contract, 
the  contractor  has  been  given  physical  con¬ 
trol  over  the  resources  required  to  support 
the  KC-10.  This  may  not  sound  like  a  great 
achievement,  but  it  is  in  the  area  that  a 
tremendous  "hidden  savings"  can  be  realized 
by  the  Government.  By  placing  the  property 
under  the  control  of  the  contractor  and  by 
not  entering  the  purchased  equipment  into 
the  Government  property  control  system  until 
such  time  as  the  contractor  logistics  support 
is  discontinued,  the  Air  Force  relieves  it¬ 
self  of  a  gigantic  record  keeping  task  ord 
the  associated  overhead  costs  that  go  with 
It.  FroblcmG  of  inventory  control,  config¬ 
uration  management,  procurement  of  small  lot 
sizes,  product  shelf  life,  pilferage,  etc., 
are  new  problems  that  must  be  handled  by  the 
contractor.  Although  the  costs  for  these 
function!!  must,  by  necessity,  be  included  in 
Che  contract  price,  the  logistics  support 
contractor  hi  working  with  a  specialized  sys¬ 
tem  designed  for  the  task  at  hand.  This 
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specialized  system  allows  Che  contractor  to 
manage  and  control  valuable  resources  in  a 
very  efficient  manner  that  is  not  obtainable 
in  the  large  cumbersome  omnibus  system  estab¬ 
lished  for  the  control  of  Government  inven¬ 
tories. 


At  the  same  time,  the  substitution  capability 
in  Option  1  allows  the  Air  Force  to  take  ad¬ 
vantage  of  the  Government  supply  system  for 
those  items  that  are  currently  in  the  Govern¬ 
ment  Inventory  and  are  being  efficiently  man¬ 
aged  by  Che  Government  system.  As  can  be 
seen,  the  Air  Force  derives  the  best  of  both 
worlds  in  the  area  of  resource  management. 
Items  which  will  be  used  on  the  KC-10  which 
are  not  readily  available  through  the  exist¬ 
ing  Government  supply  system  will  be  con¬ 
trolled  and  managed  by  a  small  system  custom 
designed  for  specific  applications.  Items 
required  for  logistics  support  of  the  KC-10 
that  have  a  broader  application  will  be  man¬ 
aged.  and  controlled  through  the  existing  sys¬ 
tem  allowing  the  Air  Force  to  take  advantage, 
of  the  economics  of  scale  inherent  in  a  re¬ 
source  control  system  designed  for  large 
quantities  of  material  and  equipment. 


SUMMARY 


The  KC-10  procurement  la  a  unique  attempt  to 
convert  a  commercially  proven  aircraft  into 
an  advanced  strategic  weapon  system  and  pro¬ 
vide  contractor  logistics  support.  These  in¬ 
novations,  such  as  simultaneous  award  of  ac¬ 
quisition  and  logistics  support,  the  Green 
Line,  and  the  Unit  Price  Matrix,  combined 
wltn  the  inherent  flexibility  provided  by  the 
contracts,  permit  the  Government  to  take  ad¬ 
vantage  of  Douglas'  commercial  structure  and 
system  while  remaining  within  the  confines  of 
acceptable  Government  procurement  practices. 


This  procurement  avoids  the  expense  of  devel¬ 
opment  costs  for  a  program  with  a  great  deal 
of  commonality  with  a  commercial  program.  It 
further  emphasizes  an  early  consideration  of 
total  program  costs  by  the  simultaneous  award 
of  the  logistics  support  contract.  This  had 
the  dual  benefit  of  forcing  early  consider¬ 
ation  of  support  costs  in  the  acquisition, 
and  working  in  a  more  competitive  environment 
for  the  logistics  support  contract  itself. 


Finally,  and  most  important,  the  Government 
is  acquiring  a  greatly  Improved  capability  at 
a  reasonable  cost  by  using  procurement  tech¬ 
niques  which  provide  the  flexibility  to  best 
satisfy  the  Government's  needs. 
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MISSION  MANAGEMENT:  THE  KEY  RESPONSIBILITY  OF  PROJECT  MANAGERS 

Robert  Judson,  Sterling  Institute 
(Former  Executive  Director,  Navy  Center  for  Acquisition  Research) 


EXECUTIVE  SUMMARY 


This  research  suggests  the  critical  decisions 
that  must  be  controlled  to  assure  a  successful 
major  systems  acquisition.  The  research  was 
based  on  an  evaluation  of  the  revised  stat¬ 
utes,  policies  and  regulations  dealing  with 
major  systems,  including  OMB  Circular  A-109, 
DOD's  revised  5000  series,  and  counterpart 
changes  in  statutes  dealing  with  budget  pre¬ 
sentation. 

Research  suggests  a  clear  opportunity  to  pro¬ 
tect  the  integrity  of  major  system  acquisi¬ 
tions  by  the  timely  Introduction  of  project 
management  into  critical  "front-end"  decision¬ 
making,  i.e. ,  mission  management. 

Past  studies  dealing  with  major  system  acqui¬ 
sitions  have  suggested  that  a  project  manager 
Inherited  critical  problems  based  on  early  de¬ 
cisions  related  to  requirements  determination. 
Often  it  was  too  late  for  a  project  manager  to 
eliminate  or  significantly  modify  these  prob¬ 
lems.  In  such  circumstances,  the  problems 
loomed  as  dominant  characteristics  affecting 
the  success  of  major  systems. 

This  research  suggests  that  the  project  manager 
should  be  a  vital  contributor  to  early  de¬ 
cision-making  which  can  be  designed  to  avoid 
or  mitigate  the  typical  project  management 
problems  of  schedule  slippage,  performance 
shortfall  and  cost  growth. 

Specific  guidance  for  a  project  manager  and 
specific  actions  that  can  be  taken  in  terms  of 
mission  management  to  assure  the  success  of  a 
program  must  be  set  forth  as  the  basis  for 
"problem  avoidance"  decision-making. 

A  unique  concept  of  staffing  early  project 
management  responsibilities  is  suggested  to 
cover  key  new  responsibilities  in  project 
management,  at  Milestone-0,  "Program 
Initiation."  This  concept  proposes  a  mission 
management  team  whose  responsibilities  embrace 
an  entire  mission  area  as  the  best  assurance 
for  consistent  decisions  on  Individual  mission 
elements. 

Practical  problems  of  complying  with  revised 
policies,  including  budget-related  issues,  must 
be  addressed.  Changed  requirements  are  sum¬ 
marized  along  with  potential  pitfalls  in  com¬ 
plying  with  new  policies  and  ways  to  cope  with 
the  full  range  of  new  project  manager  respon¬ 
sibilities. 


A  basic  illustration,  manpower  and  training 
needs,  is  utilized  throughout  this  study. 


MANPOWER  CONSIDERATIONS 


Manpower  considerations,  like  other  key  con¬ 
cerns  in  weapon  system  procurements,  have  suf¬ 
fered  in  the  past  because  of  the  requirements 
determination  process.  A  premature  lock-in  to 
a  single  system  answer  to  meet  assumed  needs 
also  locked  in  manpower  costs  and  resources. 
This  was  not  the  result  of  a  rational  decision¬ 
making  process  but  often  done  by  default.  Cost 
and  resource  characteristics  are  implicit  in 
early  preconceived  specifications  of  a  system. 
Frequently  the  results  of  this  premature  lock- 
in  could  not  be  appreciated  until  years  later 
when  it  was  too  late  to  modify  basic  systems 
decisions  to  consider  adverse  manpower  or  other 
impacts  (e.g.,  maintainability,  reliability, 
operability,  etc.). 

Two  basic  problems  are  involved.  First  is  the 
lack  of  an  explicit  recognition  of  manpower 
and  training  implications  In  early  systems  de¬ 
cisions.  The  determination.  Identification  and 
program  establishment  for  manpower  resources 
typically  have  not  occurred  until  late  In  hard¬ 
ware  development.  There  is  no  assurance  that 
services  will  have  the  number  of  qualified  per¬ 
sonnel  to  meet  operational  requirements  on  a 
timely  basis  for  systems  that  are  produced 
under  such  a  requirements  determination  pro¬ 
cess. 

A  second  and  most  important  problem  is  that 
manpower  considerations  have  been  responsive 
to,  rather  than  determinative  of,  equipment 
designs. 

We  have  been  able  for  a  long  time  to  recognize 
the  implication  of  manpower  costs  and  the  re¬ 
duction  in  the  size  of  the  labor  force  as  con¬ 
stituting  issues  of  crisis  proportion  in  terms 
of  affordability  and  availability  of  major 
systems.  What  we  have  not  been  able  to  do  is 
link  these  "crisis  issues"  to  incorporation  in 
an  acquisition  strategy  that  would  permit  us 
to  address  manpower  considerations  in  a 
logical  and  timely  manner  and  minimize  the  ad¬ 
verse  characteristics  of  the  manpower  crisis. 
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DETERMINING  MANPOWER  REQUIREMENTS  REVISED  SYSTEM 


There  are  two  key  levels  of  consideration  re¬ 
lating  to  the  determination  of  manpower  re¬ 
quirements.  The  first  might  be  designated  as 
a  "general"  concern  with  basic  manpower  stan¬ 
dards  and  profiles  of  the  type  of  operating 
personnel  that  a  Service  can  expect  to  have 
generally  available  to  operate  equipment  in 
che  future.  This  sort  of  idealized  profile 
should  become  an  important  design  parameter  to 
be  traded  off  against  other  design  considera¬ 
tions.  In  the  past  we  have  never  had  such  ex¬ 
plicit  design  concerns  and  hence  manpower  con¬ 
sider  itions  were  simply  those  that  "fell  out" 
from  the  design  chat  was  finally  produced. 

A  second  level  of  manpower  concerns  has  to  do 
with  a  specific  equipment  design.  For  these 
two  levels  of  concern  we  need  a  manpower  in¬ 
formation  system  which  suggests:  (1  general 
design  considerations  (what  standard  profiles 
of  personnel  might  be)  2)  detailed  manpower 
information  which  derives  from  the  specifics 
of  a  given  system. 

This  is  not  a  proposal  to  do  one  or  the  other, 
it  Is  an  admonition  to  do  both.  The  first 
protects  the  Integrity  of  the- second. 


MANPOWER  STUDY 


The  recent  Navy  manpower  vs.  hardware  study 
makes  a  great  point  about  the  absence  of  timely 
manpower  considerations  in  past  acquisitions. 
The  study  does  not  adequately  identify  the 
reasons  for  this.  The  lack  of  opportunity  be¬ 
cause  of  the  late  timing  of  manpower  considera¬ 
tions,  and  because  of  the  design  turbulence 
which  characterizes  decision-making  in  major 
systems,  upset  any  chance  for  orderly  con¬ 
sideration  of  manpower  requirements.  No  matter 
how  sensitive  an  information  system  is  built, 
unless  there  Is  a  timely  and  solid  design  base 
for  che  application  of  the  system,  the  infor¬ 
mation  system  is  meaningless.  No  matter  how 
highly  motivated  the  Services  are  to  consider 
manpower  need3,  the  Services  will  not  have 
success  unless  the  equi-  at  design  evolution 
is  on  an  orderly  basis  .  :d  incorporates  the 
general  parameters  of  manpower  profile  con¬ 
siderations  for  the  purposes  of  making  basic 
design  tradeoffs. 

The  Services  do  not  lack  for  the  talent  to 
mil (•‘Ipittp,  Identify  and  model  man|..:'’br  end 
training  requirement a  hh  much  as  they  lack  the 
opportunity  for  this  talent  to  make  a  timely 
contribution  ngainat  a  firm  design  base. 


Under  the  revised  system  of  decision-making 
inherent  i:,  OMB  Circular  A-109  and  DOD’s  5000 
series  revisions,  considerations  for  manpower 
and  training  -equirerocncs  should  be  an  inte¬ 
gral  part  of  a\  acquisition  strategy.  More¬ 
over,  manpower  -epresentatives  should  be  in¬ 
volved  in  the  ml  slon  area  analysis  so  that 
the  general  stand,  rds  and  concerns  for  man¬ 
power  and  training  needs  would  condition  the 
search  to  be  perfon  ed  by  the  private  sector 
through  the  technolop)  base  for  conceptual  or 
Qfceitr.  alternatives.  Thls  is  an  argument  for 
a  more  aggressive  use  t,c  our  manpower  exper¬ 
ience  in  conditioning  ea  -ly  decisions  which 
determine  what  the  manpower  and  ir lining  re¬ 
quirements  are  anyway.  Th  s  is  an  argument 
for  addressing  manpower  corn lderations  m 
early  designs  in  the  search  lor  competitive 
system  alternatives. 


THE  FUNCTIONAL  MANAGER  AND  THE  PROGRAM  MATRIX 


Lieutenant  Colonel  Martin  D.  Martin,  Air  Fore*  Logistics  Command 


INTRODUCTION  TABLE  1 


In  an  environment  of  declining  reaource 
availability,  program  management  has  been 
advocated  as  a  technique  which  can  be  of 
assistance  In  obtaining  better  resource 
utilization.  Program  management  as  contrasted 
with  functional  management  will  in  this  paper 
be  considered  as  synonomoua  with  project  and 
product  management,  even  though  a  case  can  be 
made  for  definitional  differentials.  For  each, 
the  ultimate  objective  is  the  development  and 
production  of  an  item  to  satisfy  a  specific 
operational  requirement. 


BACKGROUND 


In  the  Department  of  Defense  (DOD)  the  end 
result  is  generally  the  production  of  a 
specific  weapon  system  for  introduction  into 
the  operational  inventory.  With  the 
functional  organization  structure  (See  Figure 
1) ,  each  program  would  be  the  responsibility 
of  each  functional  manager  in  terms  of 
accomplishing  a  given  function,  such  as 
procurement  or  manufacturing.  The  difficulties 
of  using  this  type  of  organizational  structure 
for  weapon  system  acquisition  are  many.  The 
difficulties  are  reflected  in  Table  1  as 
advantages  for  .program  management  and  vice 
versa. 


ADVANTAGES  AND  DISADVANTAGES  OF  PROGRAM 
MANAGEMENT  AS  AN  ORGANIZATIONAL  STRUCTURE 


Advantagea 

Planning  is  facilitated  by  using  Program 
Evaluation  Review  Techniques  (PERT) , 

Critical  Path  Method  (CFM),  etc. 

Financial  Control  is  improved. 

Organizational  flexibility  is  enhanced. 

Better  Integration  of  system  components  la 
possible. 

More  flexibility  for  trade-offs  between 
system  parameters. 

Higher  visibility  for  problem  identlflcetion 
and  correction. 

Resource  accountability  is  Improved. 

Leverage  for  subordinate  cooperation  and 
motivation. 

Independence  to  resist  unwarranted  change 
(gold  plating). 

Independence  to  facilitate  change,  when 
warranted. 

More  efficient  use  of  specialized  personnel. 

Provides  continuity,  stability  and  consistency 
for  the  accomplishment  of  the  assigned 
mission. 

Provides  a  life-cycle  coat  horizon  for  plan.-, 
ning. 

Appeal  machanlsm  through  accessibility  to  top 
management. 


FIGURE  1 

REPRESENTATIVE  FUNCTIONAL  ORGANIZATION 
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Facilitates  and  improves  communication. 

Provides  managerial  trailing  to  cover  manage¬ 
ment  succession. 

Fosters  a  spirit  of  competi:ion  for  better 
resource  use. 

Permits  management  focus  for  mission  comple¬ 
tion. 


Disadvantages 

Requires  high  level  of  coordination  between 
the  Program  Manager  and  other  functions. 

People  can  become  too  committed  to  the  program. 

Specialization  gives  narrow  perspective  -  can 
have  a  problem  of  obsolete  technical  skills. 

Creates  high  potential  for  organizational 
conflict. 

Dedication  of  resources  to  specialized  task 
gives  resource  inflexibility. 

Introduces  complexity  into  the  overall 
organization. 

Tendency  is  for  the  program  to  become  a 
permanent  organization. 


Thus,  the  three  product  divisions  in  the 
Air  Force  Systems  Command  are  established 
organizationally  in  a  specific  system  program 
office  (SPO)  configuration.  At  the  Aero¬ 
nautical  System  Division  (ASD) ,  the  matrix 
structure  hao  been  adopted.  (See  Figure  2). 


Several  varlatlone  for  program  management; 
i.e.,  matrix,  projectized,  etc.,  depending  on 
your  frane  of  reference,  as  contrasted  with 
the  overall  organization  exist  at  ASD.  For 
example,  the  Deruty  for  Propulsion  has  been 
established  to  manage  engine  acquisition.  The 
organization  operates  in  o  multidimensional 
matrix  comprised  of  the  ASD  functional  staffs, 
6uch  as  procurement  and  manufacturing,  the 
airframe  system  program  offices,  such  as  the 
F-15,  F-16,  and  the  A-10,  and  the  engine 
manufacturers,  such  as  General  Electric, 
Williams  Research  Corporation,  Fairchild 
Republic  and  Pratt  and  Whitney. 

The  organizational  problem  arises  in  the 
conceptual  phase  of  the  weapon  acquisition 
process.  A  SPO  cadre  is  selected.  The 
Program  Manager  assisted  by  this  staff  and 
the' ASD  functional  staffs,  then  organizes 
and.  staffs  the  program  office.  Personnel 
from  the  functional  areas  of  procurement, 
manufacturing,  engineering,  etc.,  are 
colocated  with  the  program  office  on  an  as 
required  and  later  as  validated  by  a  workload 
assessment  study  basis.  Research  Indicates 
that  competition  for  manpower  resources  is 
greatest  in  this  phase  (1).  From  the  stand¬ 
point  of  the  overall  organization  (ASD),  the 
rain  value  of  this  structure  is  the  mobility 
and  utilization  of  manpower  resources  which 
can  theoretically  be  shifted  to  neet  mission 
requirements.  The  purpose  of  this  paper  is 
to  examine  the  role  of  the  functional  manager, 


FIGURE  2 

REPRESENTATIVE  MATRIX  ORGANIZATION 
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specifically,  the  procurement  and  manufacturing 
manager.  In  thla  matrix  organization. 


EXPERIENTIAL  ANALYSIS 


The  anlysls  of  the  procurement  and  manufactur¬ 
ing  manager's  (hereafter  referred  to  as  the 
procurement  manager)  role  will  be  conducted 
using  pertinent  factors  from  Table  1.  These 
advantages  were  developed  as  teiatt-d  to  the 
perspective  of  the  program  manager,  however, 
many  of  them  should  accrue  to  the  procurement 
manager,  as  the  specialist  who  manages  a 
specific  area  for  the  program  nnnager. 

Flannlng  as  envisioned  for  the  program  manager 
is  not  in  the  decision  realm  of  the  procure¬ 
ment  manager.  The  planning  responsibilities 
of  the  procurement  manager  primarily  lie  in 
the  areas  of  procurement  planning  (6) .  These 
plans  include  type-of-contract  to  be  used, 
negotiation  strategy  and  tactics,  cost 
considerations,  delivery  quantities  and 
schedules,  quality  requirements,  and  other 
business  matters.  If  the  procurement  manager 
does  not  have  to  obtain  detailed  guidance 
from  the  home  functional  staff,  then  the 
planning  function  is  not  affected  too  much  by 
the  matrix. 

Financial  control  in  the  SPO  is  primarily  the 
responsibility  of  the  program  control  activity. 
In  this  respect  the  procurement  manager  is 
required  to  coordinate  financial  matters  with 
the  program  control  activity.  These  same 
types  of  checks  and  balances  exist  under  the 
functional  organizational  format  and  are  a 
necessity  for  the  maintenance  of  the  integrity 
of  the  fiscal  aystem. 

The  organization  of  the  procurement  activity 
la  generally  controlled  in  detail  by  the  home- 
office  functional  staff.  The  number  of 
officers  and  civilians  in  the  various  grades 
arc  limited.  Organization  structure  and 
staffing  have  an  impact  on  the  grades  of  both 
supervisors  and  workers.  Consequently,  if 
changes  are  made  in  one  part  of  the  functional 
matrix  system,  such  as  an  upgrading,  then 
basically,  reductions,  within  limits,  must  be 
made  in  some  other  SPO.  Thus,  the  flexibility 
principle  is  negated.  Organizational  changes 
most  often  occur  with  changes  in  mission  and 
the  associated  workload,  rather  than  based  or. 
a  management  decision  by  the  procurement 
manager.  Organizational  structures  once 
established  aeem  to  persist  over  time.  Change 
when  it  does  occur  la  initiated  at  top  manage¬ 
ment  levels. 

Prom  the  standpoint  of  the  overall  organiza¬ 
tion,  the  program  matrix  supposedly  facilitates 
resource  utilization  based  on  the  concept  of 
•ability.  The  home-office  functional  manager 
is  able  to  shift  resources  in  the  matrix  by 


rescinding  a  colocation  assignment  and  issuing 
a  new  letter  assigning  a  specific  resource  to 
a  different  location.  However,  the  system  does 
not  work  in  this  manner.  The  colocated 
functional  manager  does  not  like  to  uce  his 
resources  diminished  by  reaasignments .  He  is 
aware  of  the  difficulty  in  obtaining  manpower 
resources,  and  is  conseo"ently  not  willing  to 
release  them,  since,  after  all,  his  workload 
may  increase  and  then  where  will  he  get  people 
to  do  the  Job.  Also,  the  release  of  manpower 
resources  may  well  affect  the  grades  of  the 
people  who  work  for  him  and  possibly  his  own 
grade,  thus  a  flexible  system  becomes  rigid 
and  inflexible.  Each  organization  must  now  be 
subjected  to  a  manpower  assessment  review  in 
order  to  free  resources  and  in  this  situation, 
elements  of  power  and  negotiation  will  often 
determine  the  ultimate  allocation  of  resources. 
The  program  matrix  has,  in  other  words,  assumed 
the  nature  of  a  bureaucracy  and  no  longer 
fosters  those  concepts  which  gave  it  birth. 

The  bureaucratic  rigidity  seems  most  intense 
during  the  validation,  full  scale  development 
and  production  phases  (1). 

In  theory,  the  procurement  manager  should 
benefit  from  increased  communication  through 
the  matrix  system.  However,  he  finds  that  his 
loyalty  is  in  question  by  both  the  program 
manager  and  the  home-office  functional  manager. 
If  he  communicates  details  of  plans  which  the 
program  manager  has  made,  he  may  find  that  his 
functional  supervisor  possibly  is  not  in  favor 
of  the  contemplated  course  of  action.  The 
functional  staff  takes  action  to  block  the 
program  manager.  Thu3,  in  some  cases, 
thwarted,  the  program  manager  wants  to  know 
why  the  procurement  manager  relayed  the 
information  to  his  functional  supervisor. 

This  situation  may  occur  in  reverse  order. 
Assuming  a  defensive  posture,  the  procurement 
manager  is  now  in  the  position  of  selective 
information  transmission.  Thus,  the  free  flow 
of  ideas  and  information  is  restricted  and 
sifted  based  on  a  careful  analysis  of  the 
pof  jible  reactions  of  all  the  parties 
concerned. 

The  program  matrix  structure  should  focus  the 
attention  of  the  procurement  manager  on 
critical  problams  so  as  to  enhance  mission 
accomplishment.  While  this  condition  occurs 
in  some  cases,  in  many  others,  it  does  not. 
Rather,  the  procurement  manager  and  his  staff 
spend  excessive  time  on  coordination  of 
letters,  charts  and  other  documents.  These 
coordinations  must  generally  involve  the  other 
functional  activities  of  the  SPO,  in  some  cases 
other  SPOs  and  the  home-office  functional 
staffs  depending  on  the  final  destination  and 
nature  of  the  document  being  processed.  Many 
documents  are  lost  in  the  coordination  process, 
and  effort  must  be  expended  in  trying  to 
locate  them  and  if  not  located,  then  in 
preparing  them  anew.  Another  activity  which 
fragaMnts  the  activities  of  the  functional 


manager  is  frequent  and  long  meetings.  Someone 
must  attend  to  protect  the  Interests  of  the 
procurement  activity.  In  many  cases  the 
meetings  are  not  well  organized.  For  example, 
no  one  knows  for  sure  why  the  meeting  was 
called.  As  the  meeting  progresses,  the  actual 
reason,  J3  compared  to  the  stated  purpose  of 
the  meeting  becomes  apparent.  Little  can  be 
accomplished  as  no  one  has  had  an  opportunity 
to  do  adequate  staff  work,  however,  no 
individual  la  willing  to  admit  this  and  so  the 
meeting  drags  on.  At  the  end  very  little  has 
been  accomplished.  A  subsequent  meeting  is 
necessary  to  deal  with  the  problem  which 
caused  all  of  the  activity  in  the  first  place. 
Hie  procurement  manager  can  usually  choose  his 
meetings.  Hie  own  personnel,  the  program 
manager,  other  functional  activities  and  the 
home-office  functional  people  ;  re  all  schedul¬ 
ing  meetings.  Often  several  meetings  are 
scheduled  for  the  same  time  period.  Naturally, 
the  importance  of  the  meeting  precludes  its 
being  rescheduled,  therefore,  substitutes  are 
dispatched  and  doclsione  made  as  to  the 
relative  importance  of  the  various  meetings. 

A  wrong  choice  can  put  one  in  a  disadvanta¬ 
geous  position  relative  to  the  power  hierarchy 
in  the  SPO  and  the  matrix. 

Conflict  is  an  accepted  characteristic  of  the 
program  management  environment.  The  condition 
arises  from  many  activities,  including  the 
inevitable  competition  for  resources,  the 
selective  communication  transmissions  and 
receipts  of  the  procurement  and  other  managers, 
the  exponential  coordination  requirements,  and 
the  generally  defensive  posture  assumed  by  many 
of  the  individuals  on  the  program  manager's 
staff.  The  key  for  the  resolution  and 
minimization  of  the  conflict  is  for  the 
respective  managers  to  convert  dysfunctional 
to  functional  conflict  (1) .  The  procurement 
manager  must  be  aware  of  and  accept  the  fact 
that  conflict  la  natural  to  the  program 
matrix.  Then  by  Judicious  use  of  meetings  and 
other  actions  which  are  carefully  planned,  he 
should  use  the  problem-solving  approach  to 
make  conflict  work  for  him  so  that  organiza¬ 
tional  goals  can  be  attained. 

The  procurement  manager  has  limited  control 
over  hla  resources  and  .as  difficulty  in 
obtaining  feedback  "roc  his  people  relative 
to  the  effectiveness  of  mission  accomplishment. 
This  situation  deriveo  from  the  relationship 
between  the  primary  workers  and  the  program 
manager.  The  scalar  chain  from  the  program 
manager  through  the  procurement  manager  to 
the  primary  worker  Includes  the  reward  and 
penalty  system.  This  environmental  given,  as 
perceived  by  the  primary  worker,  leads  to  the 
Informal  pledging  of  loyalty  to  the  procurement 
manager  and  Indirectly  to  the  program  manager, 
rather  than  to  the  home-office  functional 
supervisor.  This  condition  generally  exists, 
even  though  the  home-office  functional  manager 
docs  hove  some  reward  and  penalty  power  by 


virtue  of  assignments,  etc.  Loyalty  to  the 
program  manager  is  tempered  by  the  fact  that 
many  individuals  see  him  ns  a  remote, 
inaccessible  figure,  whereas,  they  have  more 
frequent  contact  with  the  procurement  manager. 
The  program  manager,  however,  in  his  role  as 
his  people's  representative,  must  spend  much 
of  his  time  looking  at  variables  external  to 
the  SPO,  thus,  this  alienation  is  to  be 
expected.  However,  few  program  managers  under¬ 
stand  this  situation  and  have  taken  aggressive 
action  to  correct  it.  As  a  result  of  the  above 
factors,  group  cohesion  usually  does  not 
develop  as  a  consequence  of  managerial  action, 
rather  it  develops  in  specific  situations  in 
response  to  other  environmental  variables.  The 
procurement  manager's  control  is  further  eroded 
by  the  Influence  of  the  home-office  functional 
staff  who  often  contact  colocated  personnel  and 
issue  operational  and  policy  instructions  with¬ 
out  proper  coordination  with  senior  colocate 
functional  managers.  Feedback  efforts  are 
complicated  by  tnese  same  considerations  and 
others.  The  functional  manager  wants  to  look 
good,  performancewlse,  and  to  stay  out  of 
trouble.  Consequently,  there  is  often  a 
tendency  to  play  the  program  manager  against 
the  home-office  functional  manager  and  vice 
versa.  In  many  cases,  the  result  is  conflict 
and  degradation  of  mission  accomplishment. 


CONCLUSIONS 


Where  the  program  matrix  organization  structure 
is  used,  there  appears  to  be  a  tendency  for 
the  involved  organizations  to  become  increas¬ 
ingly  more  and  more  bureaucratic.  The 
procurement  manager  finds  that  the  advantages 
of  the  program  matrix  are  negated  over  time. 
Indeed,  the  studies  analyzed  by  Adams  and 
Bamdt  support  this  conclusion  (1) .  These 
problems  are  not  unique  to  procurement  and 
manufacturing,  but  seem  to  occur  relative  to 
engineering,  logistics,  program  control  and 
other  colocated  functions.  A  difficulty 
encountered  in  this  study  effort  was  the  lack 
of  research  which  relates  to  the  role  of  the 
colocsted  functional  manager.  As  s  result, 
much  of  the  analysis  is  based  on  experiential 
observations  and  impressions.  Host  of  the 
research  in  the  area  of  the  functional  inter¬ 
face  in  program  management  relates  to  the  role 
of  the  procuring  contracting  officer,  the 
Industrial  specialist,  and  the  program  manager 
(2,  3,  A,  5,  7).  For  example,  the  authority 
grid  surrounding  the  procuring  contracting 
officer  has  been  examined;  his  value  system 
has  beer,  explored;  and  the  program  manager, 
his  role,  qualifications,  etc.,  have  been 
studied.  The  need  is  for  lu-dcpth  studies  of 
the  colocsted  functional  manager,  t.  vclf lcally, 
what  can  he  do  to  cope  with  resource  and 
organizational  inflexibility,  excessive  meet¬ 
ings  and  coordination  requirements,  dilution 
of  control,  and  the  resolution  of  conflict. 


At  present  the  majority  of  colocated  functional  Managers •"  Unpublished  Master's  thesis, 

managers  are  doing  their  jobs  in  an  excellent  Air  Force  Institute  of  Technology,  Wright- 

and  competent  manner.  However,  this  condition  Patterson  Air  Force  Base,  Ohio,  January, 

is  occurring  in  spite  of  the  program  matrix,  1975. 

not  as  a  consequence  of  its  effectiveness. 

Certainly,  many  of  these  problems  are  also 
applicable  to  functional  management  and  are 
not  amenable  to  easy  solutions,  however,  it  is 
time  for  management  to  come  to  grips  with  the 
paralyzing  Influences  of  systematized 
bureaucracy,  masquerading  as  a  program  matrix, 
and  the  researchers  should  conduct  studies 
which  .will  provide  knowledge  to  assist  in 
obtaining  Improved  mission  effectiveness  and 
efficiency. 
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THE  SCOPE  OF  THE  BUSINESS  MANAGEMENT  JOB  IK  DEFENSE  PROGRAMS 


Thomas  Y.  L.  Dunlap,  Hughes  Aircraft  Company 


INTRODUCTION 


Greater  emphasis  on  business  management  of 
programs  Is  evolving  In  recognition  of  Indus¬ 
try's  need  for  profit  and  return  on  investment 
in  on  evermore  complex  defense  market-  Design 
to  Cost  and  Life  Cycle  Cost  considerations,  new 
initiatives  in  system  acquisition  policy  result¬ 
ing  from  OMB  Circular  A-109  and  NATO  Standardi¬ 
zation  and  Interoperability  requirements  are 
current  examples  of  how  the  market  is  changing. 
Industry  mut.;  ,*h..nge  too,  to  be  more  able  to 
respond  to  DoD's  needs  for  weapon  systems  per¬ 
formance  within  a  more  highly  controlled  cost, 
schedule  and  contractual  environment. 

This  paper  gives  a  new  perspective  on  the 
extreme  complexity  of  the  defense  business  man¬ 
agement  Job  through  a  cross-sectionRl  view  of 
an  Industry  business  management  training  pro¬ 
gram.  After  three  years  developing  this  train¬ 
ing  program,  we  have  been  led  to  the  conclusion 
that  careful  analysis,  considered  judgement, 
patience  and  understanding  are,  perhaps  more 
than  brilliant  new  policy  measures,  the  basic 
requirements  for  improving  the  defense  systems 
acquisition  process. 

The  training  program  was  initiated  in  response 
to  needs  expressed  several  years  ago  by  program 
managers  of  Hughes  Aircraft  Groups.  At  that 
time  a  conference  of  more  than  forty  program 
managers  was  held  to  share  experiences  on  pro¬ 
grams  ranging  in  size  from  a  few  million 
dollars  to  over  a  billion,  and  in  scope  from 
advanced  development  to  high  rate  production. 
During  the  conference,  attention  vas  focused  on 
common  problems  and  exchange  of  ideas  for 
effective  solutions.  Better  integration  of  the 
several  business  management  functions  essential 
to  program  management,  and  increased  applica¬ 
tion  of  analytical  skills  in  business  manage¬ 
ment  were  perceived  ns  growing  oteadily  in 
importance.  Aa  a  result,  a  broad  scope  of 
skills  and  activities  has  been  defined  that 
comprise  the  program  bus'  .as  manager's  Job. 

A  270-hour  training  cour  :  has  been  established 
to  cover  that  scope.  Interfaces  with  technical 
management  and  the  non-technical  areas  such  as 
finance,  procurement,  contract  negotiation  and 
administration  are  emphasized  in  the  course. 

How  the  training  course  was  developed  and 
implemented,  and  concrete  examples  of  the 
issues,  activities,  and  information  covered  in 
the  course  illustrate  the  scope  of  business 
management  challenges  now  and  in  Che  future. 
More  than  sixty  Hughes  executives  and  managers 
have  participated  In  preparing  the  course  and 
giving  Instruction.  Now,  midway  through  the 
first  class,  experience  is  shoving  that  an  even 


broader  scope  of  skills  and  subjects  needs  to 
be  addressed.  So  now,  join  with  me  in  entering 
the  world  of  the  Hughes  Aircraft  Company's 
Aerospace  Groups,  to  look  at  a  program  whose 
purpose  is  to  cope  with  the  very  complex  acqui¬ 
sition  management  process. 


THE  BUSINESS  MANAGEMENT  DEVELOPMENT  PROGRAM 


The  world  of  the  Hughes'  Aerospace  Groups  is 
familiar  to  many  of  you;  the  world  of  the 
Phoenix,  Maverick  and  TOW  missiles,  the  AKG-9 
Weapon  Control  System,  the  APG-63  and  APG-65 
radars,  and  many  other  electronic  and  clectro- 
optical  defense  systems  and  subsystems.  It  is 
Che  world  of  exploratory  and  advanced  develop¬ 
ment,  full-scale  development,  production  and 
integrated  logistics  support.  Most  surely, 
today  it  is  the  world  of  mission  need  analysis 
and  alternate  concept  development  with  a  heavy 
emphasis  on  NATO  standardization  and  inter- 
operal llity.  In  short,  your  world,  our  world 
of  defense  systems  acquisition. 

You  are  an  industry  program  manager.  You  are 
responsible  for  the  complete  technical,  cost 
and  schedule  performance  of  your  program, 
including  bottom  line  contract  earnings  deliv¬ 
ered  to  your  corporation. 

As  a  means  to  improve  program  management  within 
your  corporation,  you  are  invited  to  attend  an 
off-site  conference  to  talk  over  program  man¬ 
agement  problems  with  forty  of  your  peers.  In 
two  days  of  discussions  you  have  renewed  your 
perception  of  the  st*ndily  growing  complexity 
of  the  defense  business  management  Job.  You 
agree  with  your  colleagues,  some  of  whom  have 
business  managers  in  their  program  offices, 
that  you  too,  could  use  a  right-hand  man  for 
business  management.  Someone  to  provide  better 
analysis  and  integration  of  functions  such  as 
program  planning  Bnd  control,  contract  admin¬ 
istration,  material  procurement  ar.d  control, 
finance,  data  management  and  administration. 

From  this  kind  of  thinking  came  an  action  item 
from  Hughes  Aerospace  Groups  executives: 
Initiate  a  program  to  accelerate  the  develop¬ 
ment  of  business  managers  for  assignment  to 
major  program  offices.  Title  action  item  was 
assigned  to  an  ad  hoc  Executive  Council  con¬ 
sisting  of  three  major  program  managers,  a 
group  controller,  director  of  contr,._.,s,  and 
director  of  materiel.  The  Executive  Council 
has  four  jobs: 

1.  Develop  course  data 
2  Select  candidates 


3.  Provide  qualified  inatructors 

4.  Coach  trainees 

The  Council  is  supported  by  a  program  adminis¬ 
trator  from  the  Manages'ist  scarf  and  a 

program  consultant  from  the  Management  Develop¬ 
ment  staff. 

The  process  of  developing  the  course  data  has 
served  to  outline  the  extremely  broad  and 
complicated  defense  systems  acquisition  manage¬ 
ment  Job.  The  course  content  is  a  true  reflec¬ 
tion  of  the  complexity  of  the  management 
challenge  for  both  industry  and  government  in 
working  with  the  defense  systems  procurement 
and  acquisition  system  today. 


CURRICULUM 


The  term  “course  data”  quickly  converted  to 
"curriculum”  as  the  Executive  Council  turned 
professionally  to  its  first  task.  An  early 
indication  of  the  scope  of  the  task  came  with 
selection  of  the  core  subjects  to  be  covered. 
Sixteen  subjects  were  finally  selected  with  the 
course  limited  to  270  hours.  The  course  ia 
conducted  over  a  nine-month  period,  20Z  after 


hours  and  80Z  during  working  hours.  The  six¬ 
teen  chosen  topics  are: 


Total 

Sublect 

Hours 

1. 

Manufacturlrg 

34.2 

2. 

Management  Concepts  &  Techniques 

32.0 

3. 

Contracts 

21.4 

4. 

Program  Control. 

20.0 

5. 

Written  Communications 

20.0 

6. 

Materiel 

18.4 

7. 

Finance 

18.2 

8. 

Oral  Presentations 

17.5 

9. 

Engineering 

16.1 

10. 

Proposal  Preparation  &  Source 

Selection 

16.0 

11. 

Cost  Estimating  &  Cost  Analysis 

15.4 

12. 

Team  Building 

10.0 

13. 

Systems  Support 

9.6 

14. 

Group  Executive  Sessions 

8.0 

15. 

Design  to  Cost  &  Value  Engineering 

7.2 

16. 

Data  Management 

6.0 

270.0 

To  illustrate  the  breadth  o'  the  course,  the 
outline  of  one  of  the  sixteen  core  subjects  is 
shown  bnlow. 


PROCRAM  BUSINESS  MANAGEMENT  DEVELOPMENT  CONTRACTS  -  COURSE  OUTLINE 


Session 

No. 

Speaker/Guest 

25 

Course  Introduction 

C.  W.  Lefever 

C.  P.  vor.Lunenschloss 

26 

The  Customer's  Acquisition  Cycle 

J.  F.  Drake 

J.  V.  Ferrero,  Jr. 

27 

The  Request  for  Proposal 

L.  A.  Enstedt 

D.  R.  Capps 

28 

The  897  (Hughes'  Proposal  Kick-off  Fora) 

J.  P.  Kopley 

29 

Pricing  the  Effort 

L.  A.  Buckley 

J.  R.  Rohllnger 

H.  Siegel 

30 

Negotiation  of  the  Contract 

J.  H.  Lelmert 

G.  D.  Rowland 

L.  E.  Molnar 

31 

Legal  Issues  of  the  Contract 

R.  P.  Wiley 

C.  S.  Kaughey 

J.  K.  Haskell 

32 

Management  of  the  Program 

S.  J.  Brookins 

J.  R.  Glacoletto 

M.  P.  Lawton 

33 

Contracting  for  Logistics  6  Support  Services 

D.  L.  Cassidy 

Contract  Tarslnatlona  6  Closures 

H.  R.  Cranston 

C.  P.  Eason 

34 


Wrap-Up 


C.  W.  Lefsver 


Outlines  of  topics  covered  in  each  of  the  other 
fifteen  course  segments  are  equally  as  exten¬ 
sive.  Ir.  addition,  a  formal  syllabus  has  been 
developed  covering  the  obleccive,  content  and 
teaching  cethodu  for  each  subject.  However, 
this  paper  is  necessarily  limited  to  soce 
observations  of  lntcrejt  and  examples  high¬ 
lighting  complexities,  paradoxes  and  difficult 
trade-offs  that  have  become  evident. 

First,  some  observations  from  your  viewpoint  as 
a  program  manager.  The  subjects  listed  above 
clearly  show  that  your  business  manager  must  be 
broadiv  grounded  and  able  to  understand,  ana¬ 
lyze  and  Integrate  many  different  functions  and 
shills.  He  is  essentially  a  program  manager  in 
every  respect,  except  for  the  requirement  to 
give  technical  <j .  action.  Many  times  the  indus¬ 
try  or  service  program  manager  is  likened  to  a 
general  manager  or  commanding  officer.  The 
business  manager  Is  clearly  a  close  deputy  - 
almost  in  your  image.  Ir.  ocher  words,  he  is 
highly  skilled  and  critically  important  to  the 
success  of  your  program. 

Notice  Che  emphasis  given  in  the  course  cur¬ 
riculum  to  communication  skills.  Ten  hours  on 
Oral  Presentations,  luenty  hours  on  Written 
Communications,  oluo  additional  hours  within 
Che  Team  Building,  Management  Concepts  and 
Techniques,  and  the  Proposal  Preparation  end 
Source  Selection  segments.  Communication  is 
the  essence  of  management  and  as  such  is  fea¬ 
tured  throughout  the  course.  This  is  an 
important  perspective  for  all  of  ue  in  industry 
and  government. 

You  cay  notice  that  Manufacturing  is  allotted 
twice  the  time  allocated  to  Engineering.  On  the 
one  hand  there  Is  necessarily  a  very  strong 
dependence  on  management  systems  in  dealing 
with  manufacturing.  On  the  other  hand,  there  is 
usually  a  strong  system  engineering  branch  in 
cost  program  management  organizations  which 
contributes  greatly  to  the  orderly  management  of 
engineering  activity.  Ia  addition,  most  of  our 
program  managers  have  an  engineering  background. 
Accordingly,  wc  have  placed  great  emphasis  or 
the  interface  between  Manufacturing  and 
Engineering. 

The  shorrer  tine  allottc  .o  Systems  Support 
does  not  indicate  lack  c  emphasis  of  Integrated 
Logistics  Support  (ILS)  nor  of  design  for  Reli¬ 
ability,  Maintainability  and  tow  Life  Cycle 
Cost.  (All  subjects  that  seed  to  be  well  under¬ 
stood  by  anyone  seriously  proposing  improvements 
in  the  acquisition  process.)  Rather,  this 
reflects  that  within  Hughes  Aerospace  Croups, 
support  function*  arc  managed  in  a  fully  inte¬ 
grated  Support  Systems  Divicior.  which  performs 
ILS  program  management  and  business  management 
tasks  as  delegated  by  the  program  manager.  ILS 
factors,  ot  course,  are  also  covered  within  the 
Cost  Analysis,  Design  to  Cost,  Engineering  and 
Manufacturing  segments  of  the  course. 


A  final  important  observation  pertains  to  the 
selection  of  the  instructors  for  each  subject. 
Top  management  support  of  the  program  has  been 
such  that  outside  experts  and  professional  edu¬ 
cators  could  have  been  brought  aboard  to 
develop  and  conduct  a  professional  educational 
program.  However,  the  Executive  Council  chose 
to  call  upon  others  like  themselves  -  experi¬ 
enced,  effective,  extremely  busy  executives  and 
managers  -  in  order  to  expose  the  trainees  to 
the  real  people  in  the  real  world,  as  well  as 
to  train  them  in  the  sulject  matter.  For 
example,  the  Contracts  action  outlined  above 
is  led  by  the  Associate  ul.  ctor  of  Contracts 
for  a  7,000-nember  operating  group.  Every 
speaker  at.  ’  guest  listed  holds  a  responsible 
management  position  at  Hughes. 

This  has  an  analogy  in  the  overall  defense 
acquisition  environment,  related  to  the  "belt 
way  bandit*, "  "congressional  staffers”  and 
elected  or  appointed  officials.  These  are 
well-meaning  people  but  they  often  impatiently 
overlook  Che  wealth  of  experience  and  knowledge 
of  industry,  service  »nd  DoD  career  personnel. 
They  sometimes  turn  to  easy  answers  and  miss 
the  Invaluable  lessons  learned  by  the  career 
managers  on  the  firing  line.  It  is  possible 
that  some  of  our  instructors  m3y  not  be  too 
professional  in  their  teaching  techniques.  But 
the  moral  for  the  trainee  is.  It  will  pay  you 
handsomely  to  extend  youraelf  to  learn  from 
them.  Nov,  for  us  to  try  to  learn  from  them 
too,  let  us  look  at  some  of  the  core  difficult 
subject  matter  brought  out  in  our  course. 


CPT 


CPT:  "Complexities,  Paradoxes  and  Trade-offs." 
No  paper  on  the  defense  business  should  fall 
to  use  a  new  acronym!  ("CPT  was  chosen  because 
Oddities,  Frailties  and  Procurement  Peculiar¬ 
ities"  has  already  been  taken.)  In  this  con¬ 
cluding  section,  X  have  browsed  through  the 
five-foot  high  stack  of  illustrations,  exposi¬ 
tory  charts,  narratives,  regulations,  specifi¬ 
cations,  and  standards  given  to  the  Program 
Business  Kcnager  Development  trainees,  and 
extracted  a  small  sample  of  the  knotty  problems 
we  sll  must  deal  with  in  the  acquisition 
process.  This  is  not  a  complete  compilation  of 
research  information,  but  examples  of  the  gold 
one  can  mine  from  the  data  bank  this  course 
has  caused  us  to  put  together.  If  I  have  left 
out  a  p  jblen  of  your  own,  I  apologize.  In  the 
inteiest  of  time  and  space,  let  us  proceed 
rapidly  through  these  items  ir.  shotgun  fashion: 

Make  or  Bjy-1:  Industry  and  Service  managers 
are  advised  to  always  use  available  capabili¬ 
ties  which  are  better  than  their  own  (but  don't 
give  away  the  Company  -  or  agency.) 

Make  or  Buy-2:  In  subcontracting  work  out. 
industry  must  make  the  absolute  best  buys  (but 
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use  minority,  female  and  small  business  enter¬ 
prises  and  use  sources  In  labor  surplus  areas  to 
the  fullest). 

Personnel-1 :  See  Make  or  Buv-2  above.  Add 
veterans  and  handicapped. 

Personnel-! A;  Each  government  program  manager 
demands:  ’’Put  your  best  people  on  program!" 

Design:  Value  Engineering  is  truly  effective 
in  reducing  costs... some  say  by  doing  over  what 
you  did  wrong  the  first  time.  One  of  our  cus¬ 
tomers  has  saved  over  $70  million  via  VECP's. 

In  contrast,  another  uses  VECP's  if  at  all,  to 
try  to  negotiate  future  prices  down. 

Design  to  Cost:  Iterate  the  design  several 
times  (but  do  not  increase  the  engineering 
budget) . 

Finance:  Comply  with  Cost  Accounting  Standards 
(but  do  not  increase  administrative  staff  or 
cost). 

A- 109:  Take  all  the  tic.e  you  need  in  source 
selection  (but  select  the  right  horse  in  the 
beginning  -  maybe  even  a  Belgian  -  and  get  him 
out  on  the  track  and  running  in  leas  time  tnan 
before) . 

NATO  RSI-1:  Improve  other  countries'  economies 
at  the  expense  of  our  own.  (This  can  be  a 
double  whammy.  Within  Germany,  for  example, 
production  of  six  identical  new  frigates  is 
spread  through  five  different  shipyards  to  bene¬ 
fit  five  local  economies.) 

NATO  RSI-2:  Procure  potentially  lean  effective 
defense  systems  and  equipment  yet  be  fully 
responsible  for  the  national  defense.  (Many 
are  sworn  to  this  responsibility.) 

NATO  RSI- 3:  The  government  is  responsible  for 
implementing  standardization  and  interoperabi¬ 
lity  (but  should  accomplish  it  through  industry 
competition  with  minimum  control). 

Production  Engineering-1:  You  must  motivate 
your  beat  designers  to  solve  your  production 
line  Problems  (but  you  must  not  let  them  make 
any  unnecessary  design  improvements.  In  other 
words,  do  "fool  with  human  nature"). 

Production  Englneerlng-2 :  You  must  motivate 
manuf6cturing  to  incorporate  critical  changes 
In  the  production  line  as  early  as  possible 
(but  you  must  not  allow  the  schedule  to  slip  or 
budget  to  overrun) . 

Cost:  Even  though  your  total  coat  is  competi¬ 
tive,  your  1)  GAA,  2)  overhead,  or  3)  labor 
rate  is  judged  too  high. 


Life  Cycle  Cost3:  Plan  and  control  Life  Cycle 
Costs  without  the  benefit  of  actual  program 
cost  visibility  during  the  operational  phase. 

Materiel:  Keep  your  vendors  making  those  small 
lots  of  special  parts  fot  a  few  more  years, 
even  if  no  one  else  buys  them  any  more. 

Organization--  dach  government  program  mana- 
ger  demands:  "lour  program  manager  on  pro¬ 
gram  must  report  to  the  Company  President." 

Organlzatlon-2:  "Your  Quality  Assurance  mana¬ 
ger  on  m^.  program  must  report  to  the  Company 
President." 

Organizatlon-3:  You  need  a  fully  projectized 
organization  to  get  the  Job  done  (but  you  also 
need  strong  functional  organizations  to  be 
able  to  employ  and  deploy  th'  *.ey  functional 
specialists  economically) . 

Management- 1:  Don't  ask  for  help  neediest- .y 
(but  never  surprise  your  booB  with  a  problem 
that* 8  beyond  you). 

Management-2:  Always  uce  contractors  with 
solid  records  of  proven  performance  (but  pro¬ 
long,  extend,  promote,  expand  competition). 

Management-3:  Focus  on  the  important  thing 
like  major  cose'  drivers  (but  withstand  audits 
at  the  detail  cost  level) . 

Government  Management:  Achieve  long  term 
stability  and  efficiency  (with  incremental 
funding  by  annual  appropriations  and 
authorizations). 

People  in  the  defense  acquisition  business  have 
to  wrestle  with  such  complexities,  seeming 
paradoxes  and  trade-offs  as  the  preceding 
twenty-four  items  continuously.  The  problems 
are  not  facetious,  but  real.  They  exist  and 
must  be  dealt  with  honestly.  They  are  diffi¬ 
cult  and  typify  what  constitutes  the  heart  of 
the  Hughes  business  management  development 
course... end  this  complicated  business  we  are 
all  striving  to  improve. 


CONCLUSION 


The  intent  of  this  paper  has  been  to  give  a 
new  perspective  on  the  extreme  complexity  of 
the  defense  business  management  job  by  analogy: 
A  cross-section  view  of  one  defense  contrac¬ 
tor’s  business  management  development  program. 
Much  has  been  left  out:  Not  only  topics  and 
problems,  but  tools  of  the  trade  like  the 
standard  Glossary  of  Acronyms  and  Abbrevia¬ 
tions  (hundreds,  thousands);  an  index  of  sped* 
flcstions  and  standards  (for  what  specific 
area?);  the 


E,  t 


i  i 


table  of  rules  and  regulations  (which  service, 
please!). 

How  about  the  complexity  of  our  organizations, 
illustrated  by  this  typical  chart: 

MAJOR  MISSILE  PROGRAM 


And  this  classic  chart,  here  illustrating  a 
point  about  life  cycle  cost,  but,  like  Pareto's 
principle,  a  part  of  our  business  in  every  area: 
The  biggest  decisions  must  often  be  made  when  we 
have  the  least  information. 


LIFE  CYCLE  COST  COMMITMENT 


A  corollary  to  this  is:  We  have  to  learn  to 
live  with  a  lot  of  problems  and  try  very  hard 
to  make  a  lot  of  small  lr'  "ovements. 


There  are  many  reasons  to  be  impatient  with  the 
defense  acquisition  process,  the  time  it  takes 
to  effect  improvement,  the  loss  in  translation 
from  top-level  policy  to  bottom-level  practice 
...and  back.  It  is  only  natural  that  we  some¬ 
times  say  "Off  with  the  old!". ..Contract  Defi¬ 
nition?.  .  .and  "On  with  the  new", . .Prototyping? 
...but  in  point  of  fact,  viewing  the  very  broad 
scope  of  the  defense  business  manager's  job, 
and  the  myriad  problems  which  must  be  faced,  it 
must  be  concluded  that  careful  analysis,  con¬ 
sidered  judgement,  patience  and  understanding 
are  thq  watchwords  for  improving  the  defer<.c 
acquisition  process  in  any  substantial,  effec¬ 
tive  manner. 
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ACHIEVING  EFFECTIVE  ACQUISITION  THROUGH 
ORGANIZATION  DESIGN  AND  LEADERSHIP  INTERVENTION 
Bonita  H.  Melcher,  Cleveland  State  University 


INTRODUCTION 


In  the  development  of  need  stage,  the  ac¬ 
quisition  process  is  simple  as  profiled  by 
organizational  variables  such  as  size  of 
group  involved,  workflow  among  groups,  spa¬ 
tial  proximity  of  members  involved,  and  the 
complexity  of  the  task.  The  size  is  limited 
to  those  individuals  establishing  the  need, 
the  workflow  is  independent  as  the  individuals 
have  a  defined  autonomous  task,  Individuals 
involved  in  the  initial  stage  typically  are 
proximate  to  each  other' through  the  process 
of  regularly  scheduled  meetings  and  the  task 
that  is  performed  is  relatively  simple  ss  the 
procedure  is  spelled  out  and  there  is  avail¬ 
able  help  in  performing  the  task. 

Once  the  decision  is  made  to  explore  alter¬ 
natives  a  program  manager  is  selected  who  is 
responsible  for  recruiting  a  tean  with  the 
requisite  skills  and  experience  to  manage 
the  acquisition.  The  acquisition  process  new 
begins  to  increase  in  complexity.  Siza  of 
the  group  involved  Increases,  workflow  be¬ 
comes  more  interdependent,  tasks  become  more 
complex  as  the  acquisition  process  moves 
toward  the  soliciting  of  competetive  bids, 
and  members  of  the  acquisition  team  become 
more  spatially  dispersed.  As  the  process 
moves  through  the  stages  of  exploration  of 
alternatives,  competitive  demonstrations, 
testing  and  evaluation,  production,  deployment 
and  operation  and  goal  analysis,  the  problems 
of  coordination  and  control  Increase.  Work- 
flow  becomes  increasingly  complex  as  more 
operations  have  to  be  Interfaced.  The  task 
becomes  more  unprograamed  as  the  project 
moves  into  areas  where  no  previous  experience 
exists.  Individuals  of  the  team  become  geo¬ 
graphically  dispersed.  As  each  of  these 
dimensions  of  the  organization  becomes  more 
complex,  they  adversely  affect  the  acquisition 
process  in  terms  of  increased  stress,  tension, 
and  conflict  upon  end  among  the  participants. 

If  the  acquisition  process  is  to  be  effective, 
it  is  necessary  to  adapt  and  adjust  the 
organization  to  offset  the  dysfunctional  ef¬ 
fects  of  increased  complexity.  Two  strategies 
are  available  to  the  program  manager  for 
adaptation  to  increased  complexity.  One 
strategy  Involves  designing  the  managerial 
system  of  the  acquisition  team  to  deal  with 
the  Increased  problems  of  coordination  and 
control.  It  is  necessary  for  the  managerial 
system  to  be  restructured  as  the  acquisition 
cycle  becomes  more  complex.  Standards  and 
objectives  must  be  clearly  defined.  Measuring 


instruments  must  be  developed  to  determine  if 
standards  are  being  met.  The  communication 
system  must  be  more  formalized  and  the  decision 
making  process  more  centralized  to  achieve 
coordination  and  control.  Activities  must  be 
regrouped  to  facilitate  coordination.  The 
managerial  system,  then,  which  constats  of 
delegetion  of  decision  making,  departmen¬ 
talizing  activities,  establishing  a  formal 
communication  system,  and  designing  a  control 
system  of  standards  and  rewards  must  be 
designed  by  the  program  manager  to  achieve  an 
effective  acquisition  program. 

A  supplement  to  managerial  system  design  is 
direct  leadership  intervention.  As  the  ac¬ 
quisition  process  becomes  increasingly  complex, 
the  program  manager  should  assume  a  more 
directive  style  of  leadership  to  achieve  the 
necessary  coordination  and  control.  The  use 
of  leadership  intervention  requires  that  the 
program  manager  be  continually  involved  in 
every  stage  of  the  cycle,  but  increasingly  so 
as  the  project  moves  through  the  final  stages. 

The  purpose  of  this  research  is  to  determine 
the  influence  of  design  and  leadership  on 
three  levels  of  organization  effectiveness; 
individual,  intragroup  and  vertical  intra¬ 
group.  It  is  assumed  there  is  a  causal  link 
between  these  types  of  effectiveness  and 
measures  of  productivity  and  profitability. 

The  conceptualization  used  follows  the  model 
proposed  by  A.  Melcher  [6],  Exceptions  are 
the  inclusion  of  an  operational  measure  of  the 
information  system. 


THE  MODEL 


The  model  (Figure  1)  embraces  a  broad  defini¬ 
tion  of  design  and  identifies  a  set  of  struc¬ 
tural  factors  and  leadership  styles  that  exert 
Influence  over  individual,  intragroup  and 
intergroup  effectiveness.  The  structural 
variables  are  of  two  types,  contextual  and 
managerial.  Contextual  structure  consists  of 
size,  workflow,  spatial  physical  barriers  and 
task  complexity.  Managerial  structure  con¬ 
sists  of  the  formal  authority  system,  the 
control  system  and  the  information  system. 

The  formal  authority  system  is  measured  by  the 
degree  of  departmentatlon  and  delegation. 

The  control  system  is  measured  by  standards 
and  reward-penalties  and  the  information  system 
is  determined  by  communication  networks  and 
channel  density.  Each  of  these  dimensions  can 
assume  a  range  of  values;  workflow,  for 
example,  can  range  from  Independent  to  inter- 
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dependent.  An  organization  can  be  profiled  as 
simple  to  complex  depending  on  the  profile 
generated  from  describing  each  of  the  structure 
variables.  As  the  contextual  variables  move 
from  simple  to  complex  they  Influence  the  be¬ 
havioral  processes  in  the  organization;  for 
example,  as  workflow  changes  from  independent 
to  interdependent  conflict  and  stress  occur. 

The  managerial  system  can  mediate  the  effects 
of  context  if  it  moves  toward  complexity  in  a 
compensating  manner.  Seven  dimensions  of 
leadership  measure  the  style  cf  the  leader 
which  ranges  from  democratic  to  directive. 

These  include  representation.  Interaction, 
participation,  goals  emphasis,  direction,  rule 
adherence  and  inducements.  The  leadership 
style  can  influence  the  effectiveness  by 
interacting  with  the  structural  variables. 
Leadership  is  viewed  as  a  mediating  variable 
which  car.  operate  to  Increase  the  dysfunctional 
effects  of  structure  or  to,  ideally,  off-aet 
these  effects.  The  effectiveness  dimensions 
of  the  model  are  divided  into  three  levels: 
individual  effectiveness  measured  by  motiva¬ 
tion,  commitment  and  initiative;  Intragroup 
effectiveness  measured  by  lateral  relations 
within  groups;  and  intragroup  effectiveness 
measured  by  vertical  relations  of  group 
members  with  supervisors. 

The  Organization  is  viewed  as  a  system.  The 
contextual  factors  contribute  to  dysfunctional 
processes  as  they  move  from  simple  to  complex. 
These  forces  may  be  offset  by  changes  in  the 
managerial  variables.  If  the  managerial 
system  is  poorly  designed  it  will  add  to  the 
disintegration  of  the  organization.  Simi¬ 
larly  leadership  Interacts  with  the  structural 
facto: s  to  enhance  or  offset  the  negative  in¬ 
fluence  on  effectiveness. 
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FIGURE  l 

STRUCTURE  PROCESS  MODEL 
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THE  STUDY 


The  study  was  designed  to  test  the  relation¬ 
ship  between  structure,  process  and  effective¬ 
ness  in  organizations.  Initial  investigation 
focuses  on  significance  and  direction  of  in¬ 
fluence  of  interaction  effects  between  con¬ 
textual  and  managerial  structure,  and  between 
structure  and  leadership. 


HYPOTHESES 


The  following  hypotheses  were  tested: 

1.  As  context  moves  from  simple  to  complex, 
and  managerial  structure  moves  from  simple 
to  complex  individual.  Intragroup  and 
vertical  effectiveness  will  move  from  low 
to  high.  The  interaction  effect  is  posi¬ 
tive. 

2.  As  context  moves  from  simple  to  complex 
and  leadership  style  moves  from  demo¬ 
cratic  to  directive  individual,  intragroup 
and  vertical  effectiveness  moves  from  low 
to  high.  The  interaction  effect  is  posi¬ 
tive. 

3.  As  managerial  structure  moves  from  simple 
to  complex  and  leadership  style  moves  from 
democratic  to  directive  individual,  intra¬ 
group  and  vertical  effectiveness  moves 
from  low  to  high.  The  interaction  effect 
is  positive. 

4.  Aa  context  and  managerial  structure  move 
from  simple  to  complex  and  leadership  style 
moves  from  democratic  to  directive  indi¬ 
vidual,  intragroup  and  vertical  effective¬ 
ness  move  from  low  to  high.  The  inter¬ 
action  effect  As  positive. 


leadership  were  measured  on  Likert-type  nine 
point  interval  scales.  The  dependent  vari¬ 
ables  of  individual  behavior,  intragroup  be¬ 
havior  and  vertical  intragroup  behavior  were 
also  measured  on  nine  point  scales.  Behavior 
questions  are  worded  to  assess  the  frequency 
of  occurrence  of  activities  and  feelings  in 
the  organization.  For  example.  "What  per¬ 
centage  of  the  time  do  you  think  about  leaving 
your  job?"  Structure  questions  are  directed 
at  observable  dimensions  such  as,  "The  number 
of  people  assigned  to  your  formal  unit."  For 
a  detail  development  of  the  questionnaire  see 
A.  Melcher  [6]. 

Subdimensions  of  primary  and  secondary  struc¬ 
ture,  leadership,  individual  behavior,  intra¬ 
group  behavior  and  vertical  Intragroup  be¬ 
havior  were  aggregated  to  arrive  at  the  main 
dimensions  (see  Figure  1).  The  dimensions 
were  then  entered  in  multiple  step  wise  re¬ 
gressions  for  each  of  the  three  dependent 
variables. 

Interaction  effects  were  assessed  by  entering 
a  new  variable  generated  by  the  multiplication 
of  the  two  or  three  interacting  variables  as 
discussed  in  Neter  and  Vasserman  [8].  The 
interpretation  of  the  interaction  effect 
follows  from  this  new  variable. 


RESULTS 


The  product  moment  correlations  between  the 
independent  variables  and  each  of  the  three 
dependent  variables  are  shown  in  Table  1 . 


SAMPLE 


The  sample  consists  of  772  individual  responses 
collected  in  32  organizsf-ms.  There  is  a 
heterogeneous  mix  of  or;  ..lzatlons  including: 
'aleoho.  e  companies,  chemical  manufacturing, 
schools,  data  processing  firms,  retail  stores, 
community  service  organizations,  hospitals, 
machine  manufacturing,  rubber  manufacturing, 
steel  foundaries,  plastics  manufacturing, 
restaurants,  supermarkets  and  city  government 
units.  At  least  four  different  groups  within 
rn  organization  were  sampled.  Data  was  col¬ 
lected  by  questionnaire  and  interview. 


METHODOLOGY 


The  independent  variables  of  structure  and 
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TABLE  1 


CORRELATIONS  BETWEEN  ALL  VARIABLES  (n-772) 


1 

2 

3 

4 

5 

6 

7 

1. 

Context 

_ 

2. 

Context  X  Managerial 

.81 

— 

3. 

Leader  X  Context 

.81 

.69 

— 

4. 

Leader  X  Managerial 

.03 

.45 

.43 

— 

5. 

Lead  X  Context  X 

Manager 

.68 

.89 

.86 

.73 

— 

6. 

Individual 

-.05* 

-.05* 

-.24** 

-.24** 

-.20** 

— 

7. 

Intragroup 

-.06* 

-.02 

-.26** 

-.22** 

-.18** 

.22 

— 

8. 

Vertical 

-.02 

-.04 

-.33** 

-.39** 

-.29** 

.46 

.42 

♦Significant  at  .10  level  **  Significant  at  .001  level 


SIMPLE  CORRELATIONS 


F'r  the  simple  correlation  run  context  la 
negatively  correlated  with  Individual,  intra¬ 
group  and  Intragroup  vertical  effectiveness. 
The  relationship  is  significant  only  for  in¬ 
dividual  and  Intragroup.  The  results  of  the 
simple  correlation  support  the  hypothesis  that 
contextual  structure  has  a  negative  effect  on 
organizational  effectiveness. 

The  interaction  variable  of  context  managerial 
structu/e  is  negatively  correlated  with  all 
three  tyoes  of  effectiveness  but  is  only 
significant  for' individual.  In  this  simple 
correlation  the  negative  effect  does  not 
support  the  hypothesis. 

The  effects  of  leadership  X  contextual  struc¬ 
ture  are  negative  and  significant  for  all 
three  types  if  effectiveness.  The  hypothesis 
of  a  positive  effect  is  not  supported. 

The  combination  of  leadership  with  managerial 
structure  is  tie  same  as  with  contextual 
structure.  The  three-way  interaction  effect 
also  produces  negative  effects. 

Simple  correlations  were  reported  to  show 
single  effects  of  direction  and  significance. 
These  are  useful  for  an  initial  analysis.  The 
variables  occur  in  reality  as  a  multivariate 
system  of  effects.  To  determine  how  the  total 
aystem  Influences  brhavior  a  multiple  re¬ 
gression  was  used. 


MULTIPL.'.  REGRESSION 


The  main  effects  of  managerial  structure, 
contextual  structure  anc  leadership  were  in¬ 
cluded  in  the  list  of  in  lependent  variables 


as  well  as  the  interaction  variables  for  the 
multiple  regression  runs.  The  results  are 
summarized  in  Tables  2,3  and  A. 


TABLE  2 

THE  EFFECTS  OF  STRUCTURE  AND 
LEADERSHIP  ON  INDIVIDUAL  BEHAVIOR 


Variable 

Beta 

F-test 

R2 

Leadership 

Context  X 

-1.18 

60.49* 

0.12650 

Leadership 
Context  X  Mana¬ 
gerial  X  Leader- 

0.86 

4.87* 

0.12984 

ship 

Managerial 

-1.36 

3.49* 

0.13081 

Structure 

Contextual 

-1.10 

2.82* 

0.13377 

Structure 
Managerial  Struc¬ 
ture  X  Leader- 

-0.96 

1.29 

0.13455 

ship 

Context  X 

1.39 

2.16 

0.13503 

Managerial 

1.43 

1.79 

0.13709 

♦Significant  at  .05  level 


The  F-ratio  for  the  regression  equation  was 
17.04  significant  at  the  .001  level.  The  re¬ 
sults  indicate  that  context  has  a  negative 
effect  but  is  not  significant.  The  interaction 
effect  of  contextual  and  managerial  structure 
is  positive  and  significant.  Simillarly  the 
interactions  of  context  and  leadership  are 
positive  and  significant  supporting  the  hypoth¬ 
esis  that  leadership  offsets  the  negative 
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TABLE  4 


effects  of  context.  The  three-way  Interaction 
is  however  negative,  Indicating  that  the  nega¬ 
tive  effect  of  directive  leadership  overwhelms 
the  Interaction  of  the  structure  variables. 
Leadership  la  a  powerful  variable,  as  It  ex¬ 
plains  the  moat  variance.  The  effects  of  the 
independent  variables  on  intragroup  effective¬ 
ness  are  summarized  In  Table  3. 


TABLE  3 

THE  EFFECTS  OF  STRUCTURE  AND 
LEADERSHIP  ON  INTRAGROUP  EFFECTIVENESS 


Variable 

Beta 

F-teat 

R2 

Leadership 

-0.49 

59.79* 

0.13137 

Context  X 
Leadership 

0.36 

14.68* 

0.13689 

Context  X 
Managerial 

1.34 

10.67* 

0.14778 

Managerial  X 
Leadership 

0.47 

5.72* 

0.15304 

Context  X 
Managerial  X 
Leadership 

-0.84 

1.53 

0.15477 

Context 

-0.85 

1.04 

0.15499 

Significant  at  .05  level 


The  F-ratio  for  the  regression  equation  is 
19.82  significant  at  the  .001  level.  The 
interaction  effect  of  context  and  managerial 
structure  is  positive  and  highly  significant. 
Both  interactions  of  structure  with  leader¬ 
ship  are  positive  and  significant.  The 
three-way  interaction  is  again  negative  but 
not  significant.  The  interaction  effect  of 
context  and  managerial  structure  is  more  im¬ 
portant  for  explaining  intragroup  than  in¬ 
dividual  effectiveness.  The  effects  of  the 
independent  variables  on  vertical  intragroup 
effectiveness  are  summarized  in  Table  4. 


THE  EFFECTS  OF  STRUCTURE  AND  LEADERSHIP 
ON  VERTICAL  INTRAGROUP  EFFECTIVENESS 


Variable 

Beta 

F-test 

R2 

Leaderehlp 
Context  X 

-0.58 

143.10* 

0.30997 

Leadership 
Context  X 

0.32 

3.95* 

0.31085 

Managerial 
Managerial  X 

0.71 

3.27* 

0.31156 

Leadership 

0.15 

2.68* 

0.31371 

Context 

Context  X 
Managerial  X 

-0.47 

0.65 

0.31407 

Leaderehlp 

Managerial 

-0.57 

0.26 

0.31430 

Structure 

-0.22 

0.14 

0.31442 

♦Significant  at  .05  level 


The  F-r«tio  tor  the  regression  equation  was 
49.20  significant  at  the  .001  level.  The  same 
result  is  obtained  for  the  three-way  inter¬ 
action  as  was  found  for  Intragroup  effective¬ 
ness.  The  interaction  effects  of  structure 
and  leadership  and  context  and  managerial 
structure  support  the  hypotheses. 

Again,  leadership  is  an  important  variable  as 
would  be  expected  since  vertical  behavior 
measures  behavioral  processes  between  leaders 
and  subordinates.  Structure  alone  is  not  im¬ 
portant  but  in  combination  with  other  variables 
rises  to  significance. 

The  results  cf  the  regression  analysis  give  us 
different  insights  into  the  effects  than  the 
simple  correlation  results.  We  see  the  model 
operating  as  a  total  system.  It  is  difficult 
to  determine ,how  the  multicolinearity  of  the 
variables  effects  the  R/-  values,  for  this 
reason  we  cannot  attach  much  importance  to  the 
final  size  of  the  R  .  Even  if  we  set  this 
consideration  aside  the  values  are  affected 
by  the  heterogeneity  of  the  data.  If  we  can 
explain  31%  of  the  variance  in  vertical  be¬ 
havior  over  a  cross-section  of  organizations 
the  results  would  certainly  be  very  encouraging 
if  the  data  were  parcialed  out  by  type  of 
organization. 

For  purposes  of  this  piece  of  research  the 
sign  of  the  beta  and  the  F-test  are  important. 
The  results  obtained  re  encouraging  espe- 
lally  since  the  data  is  heterogeneous 
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SUMMARY  AND  CONCLUSION 


The  purpose  of  this  research  wan  to  test  the 
effects  of  organization  design  on  three  levels 
of  effectiveness  within  the  organization.  A 
large  data  base  consisting  of  a  cross-section 
of  organizations  was  used.  Four  hypotheses 
tested  the  interaction  effects  of  contextual 
and  managerial  structure  and  the  interaction 
of  structure  and  leadership.  Results  showed 
that  leadership  interacts  with  structure, 
supporting  a  contingency  theory  of  leadership. 
A  directive  style  of  leadership  offsets  the 
negative  effects  of  both  increasing  contextual 
and  managerial  complexity.  This  finding  pro¬ 
vides  a  new  insight  into  how  leadership  can 
be  used  in  an  effective  organization. 

The  positive  interaction  effect  of  context  and 
managerial  structure  is  of  Interest  to  the 
organization  designer.  It  supports  the  im¬ 
portance  that  should  be  given  to  the  design 
of  the  formal  authority  system,  control 
system  and  information  system.  There  is 
little  that  can  be  done  to  change  context  in 
the  short  term.  This  is  not  true  of  the 
managerial  system  which  gives  management  an 
effective  means  of  offsetting  contextual 
variables.  This  study  contributes  to  the 
development  of  a  contingency  theory  of 
organizational  effectiveness  and  has  im¬ 
portant  implications  for  the  management  of  the 
acquisition  process.  As  the  process  moves 
toward  increased  complexity  greater  effective¬ 
ness  of  individuals  and  groups  can  be 
achieved  by  designing  the  organization 
to  compensate  for  the  breakdown  in  processes 
that  occur  or  by  employing  a  directive  style 
of  leadership  on  the  part  of  the  program 
manager,  or  some  combination  of  both  techniques 
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CURRENT  PROBLEMS  IN  THE  ACQUISITION  OF  MAJOR  WEAPON  SYSTEMS 


Barry  R.  Lenk 

The  George  Washington  University 


ABSTRACT 


This  paper  analyzes  the  impact  of  several  pro¬ 
curement  policies  employed  In  the  acquisition 
of  majcr  weapon  systems.  The  Inadequacies  of 
the  traditional  approach  to  competitive  pro¬ 
curement  are  examined,  and  alternative  stra¬ 
tegies  to  increase  the  level  of  competition 
throughout  the  life  of  the  system  are  described. 
Barriers  to  competition  created  by  the  Armed 
Services  Procurement  Regulations  are  also  dis¬ 
cussed. 

The  policy  of  Design- to-Cost  Is  analyzed,  with 
emphasis  upon  the  ramifications  of  this  pro¬ 
cedure  for  cost  control  and  innovation.  Also 
considered  are  several  deficiencies  In  data  and 
methodology  by  which  cost  constraints  and 
estimates  are  derived. 
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THE  EFFECTIVENESS  OF  INCENTIVE  CONTRACTS:  THAT  RESEARCH  TELLS  US* 

Richard  P.  DeMong,  n.D.A.** 

Assistant  Professor  ol  Commerce 
Mclntire  School  of  Commerce 
University  of  Virginia 


INTRODUCTION 


Incentive  contracts  are  now  a  part  of  DOD  con¬ 
tracting  officers  repertoire.  The  present 
incentive  environment  can  be  directly  traced 
back  to  the  early  sixties  (see  Exhibit  i) , 
specifically  to  the  efforts  of  the  former  Sec¬ 
retary  of  Defense,  Robert  S.  McNamara  (1:4-7). 
However,  limit:  e  contracts  are  by  no  means 
a  recent  innovation.  Both  the  Monitor  of  the 
Civil  War  and  the  Wright  brothers’  "heavler- 
than-air-machlne"  were  purchased  with  an  in¬ 
centive  contract  (1:8-9).  The  Monitor  had  to 
be  floated,  attain  a  specified  minimum  speed, 
and  win  its  first  battle  before  the  contractor 
was  paid.1  The  Wright  brothers  received  a 
$5,000  bonus  added  to  their  $25,000  contract 
when  their  flying  machine  exceeded  the  target 
speed  by  two  miles  an  hour  (1:8-9). 

Given  our  recent  experience  with  incentive  con¬ 
tracts,  three  questions  need  to  be  asked:  (1) 
are  these  contracts  effective?  —  that  is,  do 
they  accomplish  the  government’s  goals  and 
objectives?  (2)  are  these  contracts  efficient? 
—  that  Is,  do  che  benefits  outweigh  the 
costs?  and  (3)  can  the  government's  use  of 
these  contracts  be  enhanced.  This  paper  will 
attempt  to  find  the  answer  to  these  questions 
by  reviewing  completed  research  projects. 

These  research  projects  range  from  consultants' 
reports  to  I’ll . D  dissertations.  However,  this 
paper  will  limit  itself  to  research  projects 
that  studied  DOD  incentive  contracts  and  to 
projects  that  are  currently  readily  available 
to  any  contracting  officer  that  wants  to  inves¬ 
tigate  a  particular  point,  raised  in  this  paper. 


DEFINITIONS 


This  paper  will  focus  on  *  3  following  contract 
types: 

(1)  firm  fixed  prite  (FFP) ; 

(2)  fixed  price  plus  incentive  (FPI); 

(3)  cost  plus  incentive  fee  (CPIF) ;  and 

(4)  cost  plus  award  fee  (CPAF). 

When  the  firm  fixed  price  the  contractor  re¬ 
ceives  only  the  original  price  negotiated  prior 
to  the  awarding  of  the  contract,  unless  for 
some  reason  the  contract  is  changed  during  its 
duration.  The  fixed  price  plus  incentive  has 
a  target  cost  and  profit,  a  ceiling  price,  and 
a  share  ratio  (which  defines  the  percentage  of 
cost  under-  or  overruns  for  which  the  govern¬ 
ment  and  contractor  are  responsible).  The 


CPIF  has  a  target  cost  and  fee,  a  minimum  and 
maximum  fee,  and  a  share  ratio.  The  CPAF  has 
an  estimated  cost,  base  fee,  variable  award 
fee  (which  is  subjectively  determined  fol¬ 
lowing  evaluation  of  performance  as  measured 
against  the  performance  criteria  set  forth  in 
the  ..m.t-rict,  a  maximum  fee  (base  fee  plus 
award  fee  pool.) ,  performance  criteria,  and 
fee  payment  plan.* 


The  contracts  may  be  designed  to  give  a  con¬ 
tractor  an  incentive  to  decrease  costs,  in¬ 
crease  performance  of  the  end-product,  or  some 
other  governmental  goals,  such  as  a  prompt 
delivery.  The  incentives  that  this  paper  will 
deal  with  will  be  only  the  contractual  incen¬ 
tive  within  the  contracts.-1 


*  Opinions,  views  or  conclusions  expressed 
by  the  authors  in  this  document  are  their 
own  and  are  not  to  be  considered  or  in¬ 
terpreted  as  official  expression,  opinion, 
or  policy  of  The  Department  of  the  Air 
Force. 

**  The  research  assistance  by  the  Air  Force 
Business  Research  Management  Center  is 
gratefully  acknowledged. 

1.  The  first  two  conditions  were  met  and  al¬ 
though  the  Monitor  only  fought  the  Merri- 
mac  to  a  draw,  the  contract  was  paid  (1:8). 

2.  The  characteristic  of  each  of  these  con¬ 
tracts  and  the  proper  use  of  each  type 
of  contract  is  adequately  covered  in  the 
Armed  Services  Procurement  Regulation 
(ASPR)  (7:Section  3,  Part  4)  and  in  the 
DOD  and  NASA's  Incentive  Contracting  Guide 
(8)  and  therefore  will  not  be  covered  in 
detail  in  this  paper. 

3.  Other  authors  uake  a  destinction  between 
these  contractual  Incentives  and  "internal 
incentives"  such  as  the  Design-to-Cost 
system.  See  for  example,  Robert  W.  Blan- 
ning,  Paul  R.  Kleindorfer,  and  Oreet  Zohar, 


erature  Pertaining  to  Int- T*al  Financial 
Incentives  in  System  Acquisition  --e- 
pnred  for  The  Office  of  Naval  Research. 
Contract  number  N00014-77-C-0I71 
(February  1978). 


EXHIBIT  l 

AWARDS  BY  TYPE  OF  CONTRACT  PRICING  PROVISION  (By  ri.c.l  Yc«r)  (.) 


Type  of 

Fiscal  Year 

Pricing  Provision 

ITOJ 

T753 

mu 

T575 

1977 

“TOTAL  (b) 

100. OX 

100.01 

mo.  ox 

ICO. ox 

100  ox 

FIRM  PRICE  TYPE  (SUB-TOTAL) 

57  4 

76.5 

74.0 

72.3 

77  9 

Fin* 

31.4 

52.8 

47.5 

41.1 

39  4 

Redeterulneble 

6.1 

2.2 

0.7 

1.0 

l  5 

Incentive 

13.6 

16.6 

20.9 

17.8 

20.1 

Escalation 

6.3 

4.9 

4.9 

12.4 

12  0 

COST  REIMBURSEMENT  AND  OTHER 

TYPES  (SUB-TOTAL) 

42.6 

23.5 

26.0 

27.7 

27.1 

Ho  Fee 

2.2 

2.4  ! 

1.9 

2.C 

2  2 

Fixed  Fee 

36.6 

9  4 

10.4 

10.6 

10. 6 

Incentive  Fee 

3.2 

11.2 

9.8 

12.1 

11  4 

Award  Fee 

0.0 

0.0 

3.1 

1.6 

1.9 

Other  (c) 

0.4 

0.5 

0.8 

0.6 

0  8 

(•) 
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Petrolcie*  Purchasing  Agency  (ASPPA)  fra*  July  1950  through  Deceoher  1958.  but  Include* 
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Exclude*  Any  Procurement  overeee*  prior  to  flcccl  veer  1958  end  el»o  exclude*  core  N*vy 
letter*  of  Intent  In  fiecel  yeer*  1951  And  1952  for'whlch  type  of  pricing  provleton  we*  i 
determined 
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<c> 

Source-  MlUtery  Prime  Contract  Auerd*.  (Fltcol  yeer  I9?7>.  Uohlngton.  D.C.j 
Secretery  or  Oden*?!  pp.  6'-65. 


Repreeent*  procurement  Action*  of  $10,000  or  more  excluding  Intregovermentel ,  except  for  fiecel 
yeer  1951  which  Included  Nevy  Action*  of  $5,000  or  more  end  Army  Action*  of  $100,000  or  more. 
Include*  Time  end  mcterlel*  end  Lebor  Hour  contrecte. 


Office  of  the 


Although  both  the  Armed  Services  Procurement 
Regulation  (7:Sectlon  3,  Part  401)  and  the 
D0D  ard  NASA  Incentive  Contracting  Guide 
(8: 1-2)  recognize  that  the  contractor  is  mo¬ 
tivated  by  more  than  just  a  profit,  the  profit 
motive  is  considered  essential  to  successful 
implementation  of  an  incentive  contract.  As 
the  Incentive  Contracting  Guide  states: 

The  profit  motive  is  the  essence 
of  Incentive  contracting.  Incentive 
contracts  utilize  the  drive  for  fin¬ 
ancial  gain  under  risk  conditions 
by  rewarding  the  contractor  through 
Increased  profit  for  attaining  cost 
(and  sometimes  performance  and  sched¬ 
ule)  levels  more  beneficial  for  the 
Government  than  expected  (target) 
and  by  penalizing  him  through  reduced 
profit  for  less  than  (target)  expected 
levels.  In  stressing  the  profit 
making  aspects  of  a  company's  exis¬ 
tence*  however,  there  is  no  lntenr- 
tlon  to  discount  the  Importance  of 
extracontractusl  incentives... 

(8:102). 

Logistics  Management  Institute  found  the  fol¬ 
lowing  four  primary  justifications  for  the 
govertsaent'e  use  of  incentive  contracts: 

(X)  Incentives  motivate  efficient  con¬ 
tract  management  and  achievement 
of  a  high  performance  product. 

(2)  Incentives  enable  the  government 
to  reward  contractors  on  the 
basis  of  demonstrated  management 
ability  and  product  performance. 


(3) 


Incentives  assign  to  the  con¬ 
tractor  a  larger  portion  of  con¬ 
tract  risk  than  he  would  bear 
with  a  cost  plus  fixed  fee 
(CPFF)  contract. 

(4)  Incentives  provide  explicit  com¬ 
munication  of  the  government's 
contracting  objectives  (20:3). 


INCENTIVE  CONTRACTING:  RESEARCH  FINDINGS 


The  early  incentive-contracting  research  stud¬ 
ies  were  on  a  theoretical  level  or,  because 
of  limited  data,  exploratory.  As  more  data 
became  available,  more  empirical  testing 
was  possible.  Thus,  the  later  studies  have 
tended  to  be  largely  empirically  based. 

Rather  than  cover  the  research  In  the  typical 
chronological  fashion,  this  author  proposes 
to  discuss  the  findings  in  the  six  following 
areas:  incentives  as  motivators,  incentives 
as  a  means  to  reduce  costs,  incentives  for 
better  scheduling.  Incentives  for  better  per¬ 
formance,  award  fees,  and  improving  the  use 
of  incentives  and  future  research  needed. 


INCENTIVES  AS  MOTIVATORS 


As  earlier  noted,  both  the  ASPk  ar.d  the  D0D 
and  NASA  Incentive  Contracting  Guide  consider 
the  profit  motive  of  the  contractor  essential 
to  the  successful  use  of  incentive  contracting 
An  "incentive  is  not  a  motivator  if  it  does 
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not  satisfy  a  need  of  the  recipient.  Thus, 
the  first  question  that  needs  to  be  addressed 
is  whether  profit  is  a  primary  goal  of  the 
contractors  in  today's  environment. 

When  Jones  and  fierre  asked  fifty  contractors 
to  rank  the  n03t  important  motive  of  their 
industry,  a  plurality  selected  profit  max¬ 
imization  over  firm  perpetuation,  sales  max¬ 
imization,  and  socio-economic  considerations 
(19:44).  Forty-six  percent  of  the  contractors 
selected  profit  maximization  as  the  most  im¬ 
portant  morive,  as  compared  to  only  41  percent 
thot  selected  firm  perpetuation.  However,  the 
30  government  contracting  officers  that  re¬ 
sponded  to  the  survey  reversed  the  order  of 
the  coutro.  -or.--  (19:44).  Only  43  percent  of 
the  officers  selected  profit  maximization  as 
the  primary  motive  and  47  percent  selected 
firm  perpetuation  (19:44).  Thus,  there  was  an 
apparently  different  perception  of  the  impor¬ 
tance  of  profit  naxinizatlon  between  contrac¬ 
tors  and  government  contracting  officers. 

This  study  yas  limited  both  by  its  sample 
size  and  by  the  oversimplified  questionnaire. 

The  nost  through  ar.d  rigorous  analysis  of  the 
economic  motivations  of  contractors  was  con¬ 
ducted  by  Professor  Raymond  G.  Hunt  of  the 
State  University  of  New  York  at  Buffalo. 

After  on  extensive  review  of  the  literature, 
a  questionnaire,  and  interviews.  Hunt  con¬ 
cluded  that: 

If  we  had  to  identify  a  single  o  -er- 
arching  company  motive. . . (at  least 
che  R  &  D  corporation  participating 
in  this  research)  it  would  not  be 
profit-seeking;  we  would  probably 
call  it  'mastery'  —  a  desire  to 
be  in  control  of  one's  own  fate, 
to  be  able  to  conduct  affairs  as 
one  wished  and  to  be  good  at  it. 

This  motivational  orientation 
subsumes  coat  other  'needs’  as 
instruments  for  its  achievement. 

Profit,  for  example.  Is  a  way  of 
accumulating  capital  resources 
allowing  an  organization  to  make 
decisions  partially  independent 
of  its  customers  '  ’:151). 

In  general ,  Hunt  conclut  ;a  that  R  &  D  contrac¬ 
tors  were  basically  a  "risk  averse  group  of 
firms. .. (that  could)  best  (be)  described  as 
'profit  satlsflcers"'  (17:297).  tn  an  experi¬ 
ment  with  sixteen  undergraduates,  Feeney, 
McGlothlln,  and  Wolfson  of  The  RAW)  Corpora¬ 
tion  also  found  that  the  profits  sought 
increased  with  uncertainty  (11 :v),  which  again 
implies  risk  averse  behavior.  It  should  be 
noted,  however,  that  the  motives  of  an  organi¬ 
zation  can  only  be  determined  by  inference — 
by  studying  its  behavior  or  surveying  the 
component  neabers  of  the  organization. 

Thus,  it  is  the  individual  members 
that  collectively  define  the  motives 


of  an  organization.  Consequently,  an  incen¬ 
tive  must  be  perceived  as  a  reward  to  the 
decision-makers  of  the  organization. 

Hunt's  work  implies  that  incentive  contracts 
can  be  written  to  accomplish  that  goal. 
However,  Hill  and  Shepard's  Naval  Post¬ 
graduate  School’s  thesis  questions  whether 
incentive  clauses  really  motivate  middle 
managers  (16:41).  Since  they  found  no  profit 
maximization  scheme  in  the  seven  companies 
they  survey,  they  questioned  whether  profit 
incentives  could  be  motivators  (16:41) 

Hc.-over ,  this  study,  like  that  of  Jones  and 
Pierre,  was  !>-iJtcd  by  3m«ll  sample  size  and 
by  the  wording  of  the  questions. 

Thus,  we  are  left  with  the  comprehensive 
study  of  Hunt  (17618)  that  concludes  that  the 
motives  of  contractors  are  most  complex,  but 
amenable  to  Incentive  contracting. 


INCENTIVES  AS  A  MEANS  TO  REDUCE  COSTS 


Peck  and  Scherer  found  tliat  government  buying 
agencies  controlled  program  costs  less 
effectively  than  schedule  and  quality  factors 
(24:440).  Fox  quotes  former  chief  contract 
negotiator  of  the  Navy,  Gordon  Rule,  that 
cost  controlling  programs  were  resisted  by  che 
contractor  and  by  the  government  personnel 
(12:435).  The  late  Professor  John  F.  Gorgol, 
formerly  of  Rutgers  University,  stated  chat 
government  contractors  were  hampered  by  their 
lack  of  knowledge  of  what  the  actual  cost  of 
a  product  should  be  (14:44645).  It  was  with  this 
background  the  government  attempted  to  give 
contractors  ns  on  incentive  to  control  costs. 

One  initial  problem  with  the  incentive  type 
contract  is  the  difficulty  in  distinguishing 
between  the  high-  and  low-coat  firms  on  the 
basis  of  the  submitted  bids  or  target  costs 
(21:48).  As  John  J.  McCall  of  The  RAND  Cor- 
proatlon  points  out,  the  sharing  of  excess 
cost  and  profits  efficient  (low-cost)  firms 
are  Induced  to  submit  target  costs  higher 
than  the  expected  cost,  thereby  reducing  the 
amount  of  profits  they  would  have  to  share 
(21:48).  On  the  other  hand,  Inefficient 
(high-cost)  firms  are  encouraged  to  submit 
lower  target  c-itts  chan  expected  costs,  since 
the  government  will  share  their  losses  (21:48). 
McCall  hypothesizes  that  this  problem  will 
become  less  severe  as  the  sharing  proportion 
of  the  corporation  rises  (71:48).  However, 
when  Deavers  and  McCall  tested  the  hypothesized 
correlating  hetween  sharing  rates  and  cffl  . 
clcncv  (cfflclentv  is  the  difference  between 
target  and  .-.ctunl  costs)  ■  t-...  ,  femul.  no  -3tar_.. 
tlsticnily  slgnit leant  relationship  .74) . 
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There  have  been  a  series  of  empirical  studies 
suggesting  that  incentive  contracts  have  not 
been  effective  in  controlling  costs.  As 
Fisher  points  out,  the  efficiency  (in  con¬ 
trolling  cout3j  of  types  of  contracts  can 
no.  '  ■  -—'ted  unless  type  of  product 
produced  was  held  constant  (12:79).  That  is, 
the  uncertainty  of  the  cost  of  the  end  pro¬ 
duct  was  typically  higher  in  cost  type  con¬ 
tracts  than  fixed  price  contracts.  Fisher 
found  no  significant  difference  in  cost 
growth  of  contract  that  could  be  attributed 
to  contract  type  (12:79).  However,  he 
found  significant  differences  between  con¬ 
tractors;  some  contractors  consistently  had 
larger  underruns  than  others  (12:79). 

Besides  the  difference  in  uncertainty  of  the 
various  types  of  contracts,  there  was  also 
the  problem  of  contract  changes.  A  contract 
could  be  changed  for  some  engineering  reason 
to  avoid  reporting  a  cost  overrun  (12:Ch.l9). 
However,  Belden  was  not  able  to  "conclude 
(in  his  study)  that  target  costs  were  increas¬ 
ed  in  order  to  reduce  potential  overruns  or 
increase  potential  underruns"  (1:95). 

In  the  same  study  of  834  contracts,  Belden 
found  that  the  overrun/underrun  contract  out¬ 
come  was  Independent  of  the  size  of  the  shar¬ 
ing  ratio  and  of  the  type  of  contract  (1:96). 
However,  the  size  of  the  overrun/underrun  was 
predicted  by  the  type  of  work  (production  or 
R  &  D)  (1:V6).  These  conclusions  were  re¬ 
tested  by  Parker  using  a  much  larger  sample 
size  (2,683  contracts)  and  a  longer  time  per¬ 
iod.  His  results  differed  slightly  from 
Belden' s  as  can  be  seen  in  Exhibit  2,  R  &  D 
contracts  still  had  higher  changes  and  over¬ 
runs  123:42).  However,  contrary  to  his  ex¬ 
pectations  overruns  tended  to  increase  as 
the  contractors  share  ratio  increased  (23:43). 
Furthermore,  £PIF  contracts  had  substantially 
larger  overruns  than  FPl  or  Cp'fr  contracts 
(23:42).  Again  there  vos  the  problem  of 
controlling  for  the  difference  in  risk  factors 
of  contract  type  of  work.  Thus,  the  risk  of 
the  underlying  work  nay  be  more  responsible 
for  the  overruns/underruns  than  the  type  of 
contracts. 

Both  Belden  and  Parker  found  contractors  act¬ 
ing  in  a  risk  averse  manner.  As  the  risk  of 
the  type  of  contract  increased,  -,o  did  the 
"going-ln"  (target)  profit  (1:114;  23:56-59). 
Parker  also  found  that  going-ln  profit  rates 
were  slightly  higher  with  R  &  D  contracts 
than  production  contracts  (23:5*7) .  However, 
both  3elden  and  Parker  found  higher  "coming- 
out"  (actual)  profit  rates  for  production 
contracts  than  R  &  D  contracts  (1:114;  23:59- 
60) .  Ccning-out  profit  rates  remained  higher 
for  FP1  than  the  CPIF  or  CPFF  in  both  studies 
(1:214;  23:59). 

Belden  and  Parher  found  that  there  was  a 
relationship  between  delivery  dates  and 
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overruns.  The  more  closely  the  schedule  Was 
met,  the  lower  the  cost  overruns  (1:96;  23:43). 

According  to  Hunt,  the  real  advantage  to 
cost  incentives  is  that  they  act  as  a  counter¬ 
weight  to  the  performance  bias  of  high  tech¬ 
nology  organizations  (17:306).  As  he  states, 
"They  can  say  quite  simply,  'go  ahead  and  do 
good  work  --  right  on!  —  but  try  to  hold 
down  the  costs,  too,  and  we'll  pay  you  if  you 
do.'"  (17:306). 


INCENTIVES  FOR  BETTER  SCHEDULING 


Hunt  simply  states,  "schedule  incentives 
probably. .. (were)  superfluous"  (17:306). 
However,  both  Belden  and  Parker  found  that 
there  was  a  significant  tendency  for  schedule 
delays  and  overruns  to  occur  together  (1:96; 
23:43).  Conversely,  Parker  found  that  early 
delivery  and  underruns  were  apt  to  occur 
together  (23:43).  Belden  found  that  schedule 
Incentives  tend  to  be  at  least  partially  lost 
rather  than  earned. 

Thus,  we  find  that  If  schedules  were  met, 
cost  incentives  were  earned.  However,  we  do 
not  know  whether  schedule  incentives  were 
redundant  with  cost  incentives  or  whether 
they  have  an  information  valu.  their  own. 

If  incentives  were  designed  par..  .Ily  as  a 
means  of  conveying  explicit  information  from 
the  government  contracting  officer  and  the 
contractor  as  the  LK1  Study  (20:3)  suggests, 
then  schedule  incentives  were  not  superfluous, 
even  if  unearned.  Furthermore,  if  schedule 
incentives  are  not  included,  then  the  con¬ 
tractor  may  make  an  "undesirable”  (from  the 
government's  point-of-view)  trade-off  to  earn 
a  performance  or  cost  incentive. 
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INCENTIVES  FOR  BETTER  PERFORMANCE 


Hunt  concludes  that  most  organizations  were 
oriented  more  toward  performance  than  toward 
cost-reduction  (17:306).  Thus,  he  states 
performance  incentives  were  probably  re¬ 
dundant  with  the  "natural"  organizational 
tendencies  and  therefore  contribute  little 
to  program  management  and  performance  control 
(17:306). 

Both  the  studies  of  Belden  and  Parker  came 
to  the  same  conclusion  that  performance 
incentives  wore  typically  earned  regardless 
of  cost  overrun/underrun  outcomes  (1:96; 
23:63). 

In  a  study  exclusively  of  civil  engineering 
service  contracts,  Ehnert  and  Kaiser  found 
no  statistically  significant  relationship 
between  contract,  type  (fixed  or  incentive) 
and  performance  (10:47-68).  They  studied 
35  service  contracts  where  performance  was  a 
measure  of  the  number  of  complaints,  the  few¬ 
er  complaints  the  better  the  performance 
racing.  These  findings  supported  Hunt's 
conclusion  that  there  was  a  performance  bias 
of  organizations. 

However,  just  as  with  schedule  incentives, 
not  including  performance  incentives  may  send 
a  negative  message  to  the  contractor.  That 
is,  a  lack  of  performance  incentive  may  be 
interpreted  by  the  contractor  as  a  message 
that  the  government  has  no  real  interest  in 
performance. 


AWARD  FEE 


In  contrast  to  the  numerous  studies  that  have 
focused  on  incentive  fee  contracts,  there  has 
been  little  research  on  award  fee  contracts. 
That  may  he  a  function  of  the  fact  that  few 
contracts  used  the  award  fee  provision.  As 
can  be  seen  on  Exhibit  1 ,  less  than  2  percent 
of  all  contracts,  as  measured  by  dollar 
amounts,  used  award  fee  contracts  in  1977. 

The  other  reason  that  award  fee  contracts 
may  .not  have  been  more  '  unsively  researched 
is  that  they  are  a  reiat  vely  new  type  of 
contract.  Although  they  have  been  applied 
by  NASA  since  the  early  sixties,  they  have 
been  used  only  on  an  experimental  basis  by  the 
Army,  Navy,  and  Air  Force  until  1968  when 
the  award  fee  contract  type  was  included  in 
the  ASPR  (1:30). 

An  early  study  of  Navy  and  NASA  contracts,  by 
Douglas  Egan,  concluded  that  the  major  "in¬ 
centive"  in  the  award  fee  system  may  "arise 
from  the  fact  that  a  formal  record  of  eval¬ 
uated  performance  is  maintained,"  rather  than 
from  the  immediate  fees  turned  (d;24). 


Dr.  Hunt  theorized  that  award  fee  contracting 
should  be  structurally  simpler,  but  more 
demanding  to  administer,  than  other  types 
of  incentive  contracting  (18:158).  Hunt 
also  points  out  that  CPAF  comes  closer  than 
other  contract  types  to  fulfilling  the 
principle  that  profits  should  be  earned,  not 
awarded  in  advance  (18:153).  The  CPAF  thus 
meets  one  of  the  Logistics  Management  In¬ 
stitute's  four  justifications  of  incentive 
contracts  better  than  the  other  incentive  fee 
contracts.  Specifically,  "incentives  enable 
the  government  to  reward  contractors  on  the 
basis  of  demonstrated  management  ability  and 
product  performance"  (20:3).  However,  as 
he  points  out,  CPAF  does  not  hinge  on  the 
primacy  of  the  profit  motivation;  rather  it 
enhances  performance,  because  award  fee  con¬ 
tracting  improves  the  communication  between 
the  government  and  contractor  (18:154-57). 
Thus,  CPAF  acts  as  a  management  tool  of  the 
government  on  the  contractor.  As  Hunt  states, 
"award  fee  is  best  regarded  as  a  method  of 
management,  not  as  a  contract  type"  (17:164). 

If  CPAF  is  to  be  considered  a  management  tool, 
then  there  should  be  a  learning-curve  effect 
over  the  life  of  the  contract.  That  is,  if 
partial  awards  are  made,  the  contractor  Is 
able  to  discern  what  is  important  to  the 
government.  In  a  study  of  13  CPAF  contracts, 
Mel  D.  Byers  of  the  USAF  found  such  a  rela¬ 
tionship.  He  found  that  the  "percentage  of 
award  fee  the  contractor  earned  seemed  to 
increase"  as  the  contract  progressed  (4:86). 

A  study  done  by  two  Air  Force  officers,  Jack 
R.  Runkle  and  Gerald  D.  Schmidt,  further 
supported  the  conclusion  that  an  award  fee 
contract  was  a  management  tool.  In  a  study 
of  56  contracts  they  found  that  if  the  fee 
determination  officer  (FDO)  was  five  super¬ 
visory  levels  above  the  buyer,  then  the 
percentage  awards  fee  the  contractor  earned 
was  higher  than  if  the  FDO  was  only  four 
levels  over  the  buyer.  They  also  found  that 
the  satisfaction  of  the  government  (as  mea¬ 
sured  by  the  percentage  award  fee  paid)  was 
higher  as  the  frequency  of  evaluations  was 
increased.  Moreover,  they  found  that  a  pure 
CPAF  was  superior  to  a  combined  CPIF  and  CPAF 
but  Inferior  to  a  combined  FPI  and  CPAF 
contract  (25:52). 

Byers  found  no  statistically  significant  re¬ 
lationship  between  the  relative  magnitude  of 
the  award  fee  and  the  level  of  contractor 
performance  (4:81-82).  In  a  study  of  19 
DARC0M  contracts,  Shirley  H.  Carter  found 
that  the  following  factors  were  not  signifi¬ 
cantly  related  to  the  level  of  award  fees: 
size  of  contract,  magnitude  of  absolute 
potential  award  fee,  and  relative  size  of  the 
potential  award  fees  (potential  awar„  ,cc  as 
a  percentage  of  the  estimated  contract  costs) 
(5:30-35).  However,  she  found  that  the  level 
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of  award  fees'  had  a  statistically  significant 
negative  relationship  to  the  relative  size  of 
the  fixed  fee  (as  a  percentage  of  estimated 
contract  cost)  (S: 35-36).  Similarly,  the 
level  of  award  fees  had  a  statistically  signi¬ 
ficant  positive  relationship  to  the  relative 
size  of  award  fees  to  total  fees  (5:36-37). 
Thus,  Carter  concluded  that  award  fees  are 
more  effective  motivators  of  contractor  per¬ 
formance;  however,  relatively  large  fixed 
fees  acted  as  a  disincentive  (5:36640). 

If  one  accepts  the  percentage  of  potential 
award  fee  earned  as  a  surrogate  for  govern¬ 
ment  satisfaction  with  a  contractor's  perfor¬ 
mance,  then  research  has  shown  that  award 
fees  are  an  effective  motivator.  The  use- 
fullness  can  be  increased  by  taking  the 
following  steps:  make  award  fees  a  greater 
part  of  tot-1  fees  in  a  cost  type  contract; 
combine  i  with  an  FP1,  rather  than  a  CPIF; 
increase  tne  frequency  of  evaluation;  select 
an  FDO  that  is  five,  rather  than  four  super¬ 
visory  levels  above  the  buyer;  and  use  it  on 
service  contracts  rather  than  hardware  con¬ 
tracts. 

Although  CPAF  may  be  effective  motivators,  are 
they  efficient?  That  is,  do  the  benefits  of 
contractors'  enhanced  performance  outweigh 
the  costs  of  administering  an  award  fee  con¬ 
tract?  This  question  has  not  been,  and  may 
never  be,  answered.  For  as  Carter  points  out, 
"It... (is)  quickly  learned  that  it... (is)  im¬ 
possible  to  Isolate  the  administrative'  costs 
(of  CPAF  contracts)  with  a  reasonable  amount 
of  resources"  (5:28). 


IMPROVING  THE  USE  OF  INCENTIVES 
AND  NEEDED  RESEARCH 


Most  of  the  research  reports  surveyed  in  this 
paper  included  recommendations  for  improving 
incentive  contracting.  In  this  section  some 
of  the  most  commonly  suggested  recommendations 
will  be  listed.  It  must  be  added  that  all  the 
questions  about  incentive  contracting  have 
not  yet  been  formulated;  thus,  much  is  still 
unknown.  For  example,  we  still  do  not  know 
whether  Incentive  contracts  provide  for  any 
true  economic  benefit  —  do  they  return  more 
than  they  cost?  Nor,  do  we  truly  understand 
the  best  methods  of  motivating  management.  If 
contractors'  primary  motivation  is  to  control 
their  own  fate,  as  Hunt  suggests  (17:151),  then 
how  do  we  provide  Incentives  that  complement 
this?  If  the  contractor’s  primary  motivation 
is  risk  reduction,  can  the  government  reduce 
the  contractor's  risk  and  save  meney  at  the 
same  time?  Those  questions,  albeit  fundamen¬ 
tal,  must  remain  for  future  research  projects. 

Several  researchers  have  recommended  that  the 
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types  of  contracts  to  use  for  a  given  procure¬ 
ment  be  more  selective  (for  example,  see 
1:132).  Incentive  contracting  will  be  more 
effective  if  it  is  selectively  applied  to  the 
type  of  work  and  conditions  that  are  amenable 
to  profit  incentives  (20) .  A  study  may  be 
undertaken  to  determine  how  closely  the  guide¬ 
lines  of  ASPR  and  the  Incentive  Contracting 
Guide  are  followed  and  whether  they  should 
be  revised. 

Another  method  recommended  to  improve  con¬ 
tracting  in  general,  and  incentive  contrac¬ 
ting  specifically,  is  to  look  at  the  inter¬ 
contract  dependencies  (1:133).  That  is, 
broaden  the  outlook  of  the  government  from 
a  contract-to-contract  view  to  a  more  long¬ 
term  perspective.  That  was  a  company's 
long-run  return  and  risk  relationship  with 
government  can  be  examined  in  a  meaningful 
manner.  This  approach  seems  to  support 
Professor  Hunt's  view  that  we  are  dealing 
with  "fluid  operational  environment  with 
static  and  rigid  contracts"  (17:306). 

Runkle  and  Schmidt,  Parker,  and  Belden 
recommend  that  a  6tudy  be  initiated  to 
determine  the  outcomes  of  incentive  con¬ 
tracting  for  small  firms  (1:133;  23:66;  26: 
63r64) .  One  of  the  strongest  recommendations 
comes  from  Runkle  and  Schmidt.  They  maintain 
that  when  using  award  fee  contracting,  fre¬ 
quent  evaluations  be  made  from  a  supervisory 
position  that  is  five  levels  above  the  buyer 
(26:62-63).  Carter  implies  that  the  perfor¬ 
mance  evaluation  conversion  schemes  should  be 
analyzed  with  the  possible  aim  of  devising 
a  unitary  system  (5:41). 


CONCLUSION 


Professor  Hunt  warned  us  against  "replacing 
one  set  of  over-simplifications  (  the  'con 
ventional  wisdom')  with  a  new  set"  (17:296). 
However,  that  is  what  was  attempted  in  this 
paper.  Volumes  of  extensive  research  were 
distilled  into  a  few  pages  and  in  some  cases, 
a  single  sentence.  This  distillation  process 
will  not  be  fair  to  the  authors  of  the  re¬ 
search  or  to  the  readers  of  this  paper,  un¬ 
less  the  latter  group  goes  back  and  reads  the 
complete  reports  of  the  former  group.  This 
paper  can  be  used  to  quickly  locate  the 
important  research  projects  pertaining  to 
his  or  her  area  of  curiosity.  This  saves 
the  reader  a  time-consuming  and  tedious 
search  through  the  literature.  Thus,  this 
paper  is  designed  as  a  means  of  locating 
the  answers,  rather  than  as  the  answer  it¬ 
self.  Furthermore,  the  reader  should  always 
keep  in  mind  that  research,  by  its  very 
nature,  is  a  dynamic  process.  Many  of  the 
conclusions  reached  in  this  paper  may  be  up¬ 
dated,  revised,  or  reversed  in  the  future. 


If  one  wants  to  explore  incentive  contracting 
in  general,  I  would  recommend  that  the  two 
Hunt  studies  (17&18),  and  the  dissertations 
of  Berhold  and  Beldun  be  read  for  a  thorough 
understanding  of  the  theoretical  foundations 
of  incentive  contracting.  Peck  and  Scherer's 
Economic  Analysis  (24)  and  J.  Ronald  Fox's 

(12)  book  should  also  be  read  for  a  background 
to  the  economic  environment  of  contracting. 
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FACTORS  THAT  INFLUENCE  ORGANIZATIONAL  PERFORMANCE 


Raymond  C.  Hunt,  Janet  P.  Near,  Ira  S.  Rubin 
State  University  ol'  New  York  at  Buffalo 


This  study  approached  the  question  of  what  de¬ 
termines  performance  by  organizations  from 
three  directions:  (1)  perceptions  or  beliefs 
of  managers  about  what  determines  organization 
performance;  (2)  Interrelations  of  measures  of 
those  beliefs  with  other  measures  of  motiva¬ 
tion;  and  (3)  managers'  views  about  what  makes 
for  effective  RM>  performance. 


THE  STUDY 


As  part  of  a  'arper  NASA-funded  study,  ques¬ 
tionnaires  wire  obtained  by  mail  from  1283  re¬ 
spondents  employed  by  one  or  another  NASA/DoD 
RAD  contracting  agency,  or  by  a  private  RAD 
contractor.  In  addition,  ersonal  interviews 
were  done  with  64  technical  managers  in  the 
same  kinds  of  organizations.  Respondents  gen¬ 
erally  held  middle-  to  upper-level  management 
positions;  all  were  males  [2). 


MEASURES  OF  PERFORMANCE 


Performance  influence.  On  a  six-point  scale, 
respondents  rated  ten  Items  which  "may  affect 
contractor  performance  of  RAD  contract." 

Means  of  cheso  ratings  are  In  Table  1,  with  the 
item  rank  orderings.  As  can  be  seen,  most  of 
ihe  items  are  judged  to  express  conditions 
having  relatively  strong  effects  on  KAD  per¬ 
formance.  Only  three  items  are  rated  toward 
the  "weak"  side  of  the  scale.  These  are: 
"contractual  possibilities  for  profit  trade¬ 
offs"  (by  consensus  the  weakest  of  the  ten 
influences),  "quality  of  interpersonal  rela¬ 
tions  within  contractor  organization"  (which 
contractors  think  is  more  important  than  do 
government  respondents),  and  "nature  of  pro¬ 
curement"  (which  government  people  think  is 
more  important  than  do  contractors). 


Government-contractor  agreement  in  the  ordering 
of  the  individual  items  is  quite  close.  (The 
rank  correlation  between  the  sets  of  ratings 
is  .94.)  Hence,  the  "All  " •>spondents"  column 
of  Table  1  conveys  a  con;  .sus  on  the  relative 
importance  of  the  10  itemized  performance  in¬ 
fluences.  It  will  be  seen  that  the  three  most 
Important  perceived  Influences  Include  two 
"structural"  considerations  (clarity  of  job 
specs  and  contractor's  work  plan)  and  a  "moti¬ 
vational"  one  (prospects  for  production  follow- 
on)  .  The  three  least  important  Influences 
were  two  "contractual"  elements  (nature  of  the 
procurement  and  contractual  possibilities  for 
profit  trade-offs)  and  one  "human  relations" 
consideration  (quality  of  interpersonal  rela¬ 
tions  within  contractor  organization).  It 
seems  fair  to  say  that  project-particular 
"structural"  influences  were  seen  as  weightier 


influences  on  RAD  performance  than  were  other 
kinds,  and  that  important  "motivational"  ori¬ 
entations  were  long-term  rather  than  short  (cf. 
ratings  on  production  follow-on  vs.  contract¬ 
ual  profit  trade-offs). 


To  explore  the  structure  of  the  ratings  on  the 
ten  RAD  performance  Influence  items  they  were 
factor  analyzed  with  an  orthogonal  (varimax) 
rotation.  Three  factors  resulted,  explaining 
48Z  of  the  /<>•  •  '*.r»c  k  before  rotation. 


The  first  factor  reflects  a  tack  orientation, 
referring  to  planning  and  specification  as¬ 
pects  of  the  project  itself.  The  second 
factor  refers  to  the  contract  as  an  Influence 
on  project  performance.  The  third  factor 
concerns  interpersonal  relations,  both  within 
the  contractor  organization  and  between  it  and 
the  government  sponsor.  Factor  scores  were 
computed  on  each  of  these  three  factors,  re¬ 
flecting  perceptions  of  factors  which  influ¬ 
ence  performance.  These  are  found  in  Table  3. 
The  tendency  just  noted  for  contractors  to 
regard  the  influence  of  contract  per  se  as 
lower  than  government  people  is  evidenced 
there  in  a  significant  difference  between 
their  scores  on  the  pertinent  factor. 


Environmental  Constraints.  Presented  with  ten 
pairs  of  items,  respondents  were  asked  their 
"views  about  the  factors  controlling  contrac¬ 
tor  project  performance."  Each  item  pair  in¬ 
cluded  one  statement  claiming  that  organiza¬ 
tional  factors  Influenced  some  aspect  of  per¬ 
formance  and  another  arguing  that  environmen¬ 
tal  factors  Influenced  that  aspect  of  perform¬ 
ance.  Respondents  were  asked  to  check  the  one 
item  they  "more  strongly  believe  to  be  the 
case.” 


Table  2  shows  pronounced  asymmetries  in  the 
relative  popularity  of  some  of  the  two  re¬ 
sponse  alternatives.  For  example,  the  great 
majority  of  our  respondents  felt  that  "most 
prolect  difficulties  result  from  mistakes 
made  by  people;"  they  did  not  believe  that 
they)  are  produced  by  essentially  uncon¬ 
trollable  events  and  really  are  nobody's 
fault."  Corresponding!) ,  respondents  said 
that  "project  outcome  is  mainly  a  result  of 
operational  decisions  made  along  the  way"  in¬ 
stead  of  saying  that  "once  a  contract  has  been 
structured  and  s  project  initiated  its  ojtcomc 
Is  pretty  well  determined,"  thereby,  once  a- 
gnin, downgrading  the  perceived  importance  of 
contract  as  a  determiner  of  performance. 


Some  other  items  divided  our  respond-  s  more 
evenly.  For  instance,  roughly  equal  numbers 
of  them  said  "for  the  most  par!  my  operational 
decisions  are  prescribed  by  regulations  and 
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other  higher-level  policies,"  as  claimed  that 
"by  and  large  I  have  a  good  deal  of  lattitude 
in  making  operational  decisions  as  I  see  fit." 
However,  this  pair  of  items  shows  the  only 
clear  reversal  of  endorsement  as  between  gov¬ 
ernment  and  contractor  respondents;  two-thirds 
of  the  former  endorse  the  first-mentioned  al¬ 
ternative,  whereas  two-thirds  of  the  latter 
endorse  the  second-mentioned  one. 

Intercorrelations  among  these  ten  items  were 
extremely  low.  But,  rather  than  treat  them  as 
separate  perceptions,  an  "environmental  con¬ 
straints"  scale  was  constructed  by  coding  items 
as  either  environmental  ("1")  or  organizational 
("2")  and  summing  the  scores.  Scores  could 
thus  range  from  a  low  of  ten  to  a  high  of 
twenty.  A  low  score  reflects  a  perception 
that  environmental  factors  constrain  prolect 
performance.  A  high  score  reflects  a  percep¬ 
tion  that  factors  within  the  organization's 
control  exert  greater  influence  on  project 
performance.  This  measure  reflects  the  amount 
of  uncertainty  perceived  in  the  organization's 
environment,  as  opposed  to  its  capacity  to 
control  this  uncertainty,  and  the  effect  on 
performance. 

Mean  scores  on  this  scale  are  shown  in  the 
first  row  of  Table  3.  In  general,  they  indi¬ 
cate  that  our  respondents  favored  a  belief  in 
organizational  ability  to  control  its  own  per¬ 
formance,  or  to  control  uncertainty  in  its 
environment.  Government  respondents,  however, 
were  less  convinced  of  this. 


MOTIVATION  AND  PERFORMANCE 

A  common  assumption  in  organization  theory, 
procurement  and  project  management  alike  is 
that  an  organization's  performance  reflects 
something  about  it  and  its  members'  "motives" 
[1).  Yet  the  relationship  between  motivation 
and  performance  haa  been  studied  much  more 
often  at  the  individual  than  at  the  organiza¬ 
tional  level  [51.  Therefore,  in  this  study  we 
explored  the  structural  linkages  of  motivation 
and  organizational  performance  as  these  are 
Implied  by  the  relevant  perceptions  of  organi¬ 
zation  members.  Thus  we  used  perceptual 
proxies  for  actual  motivational  and  performance 
variables,  and  examined  their  patterning. 

The  dependent  variable  for  this  part  of  the 
study  was  respondents'  perceptions  of  what 
factors  Influence  the  performance  of  a  parti¬ 
cular  R&D  project.  Predictor  variables,  in 
hierarchic  regression  analyses,  Included 
respondents’  perceptions  of  their  organiza¬ 
tions'  motives  and  goals,  their  perceptions  of 
their  own  personal  goals,  and  their  perceptions 
of  environmental  constraints  which  affect 
performance  (measures  of  which  we  have  just 
described).  "Objective"  predictor  variables 
concerning  background  characteristics  of  the 
respondent  and  his  organization  also  were  used; 
it  remains  to  specify  these  variables  and  to 


describe  our  measures  of  individual  and  corp. 
ate  motivation. 

Corporate  Goals.  Contractor  respondents  rated 
40  items  on  a  six-point  scale  as  to  "how  im¬ 
portant  an  influence  upon  policy  or  operational 
decision-making  in  the  company  for  which  you 
iresently  work  do  you  believe  it  is."  Govern- 
•ent  respondents  rated  the  same  40  goals  "for 
the  typical  firms  with  which  you  have  had  ex- 
p  rience."  The  40  ratings  were  subjected  to  a 
pt Incipal  components  analysis  with  an  ortho- 
go,  al  (varimax)  rotation.  Nine  factors 
app aared,  explaining  S8X  of  the  variance  before 
rot,  tion  [3]. 

Indl  ’ldual  Goals.  Respondents  also  rated  their 
perstnal  work  goals  on  a  six-point  "importance" 
scale  They  rated  them  in  the  context  of 
making  "the  decision  as  to  whether  to  accept  a 
new  po 'ition  open  to  you."  A  principal  com- 
ponentt  analysis  of  these  ratings,  using  an 
orthogonal  (varimax)  rotation,  yielded  seven 
factors  explaining  56Z  of  the  variance  before 
rotation 

Table  3  displays  factor  scores  by  group  for 
each  goal.  As  can  be  seen,  contractors  see 
"effective  performance"  and  "image-making"  as 
more  imporant,  and  "risk  aversion"  as  a  less 
Important  t  >rporate  goal  than  do  government 
people.  Coiiplementnrily ,  government  respon¬ 
dents  describe  "safety-comfort"  as  a  more  im¬ 
portant,  and  "esteem"  and  "power-responsibility 
as  less  lmpot tant  individual  goals  than  do 
contractors.  Overall,  there  was  some  relation¬ 
ship  between  ( orporate  goals  and  individual 
goals,  but  it  'as  not  as  strong  as  might  per¬ 
haps  have  been  expected  (3). 

Organization  ant  Respondent  Variables. 
Characteristics  of  the  organization  and  the 
respondents  were  also  used  as  predictor  vari¬ 
ables.  These  included:  whether  or  not  R 
(respondent)  worked  for  the  government  or  a 
contractor;  and,  .'or  contractors,  sales  volume, 
percentage  of  government  and  RAD  work.  Also 
included  are  R's  elucation  and  Job  function. 

Findings  from  Regre  islon  Analyses.  The  basic 
question  under  inve> tigatlon  was  whether  per¬ 
ceptions  of  factors  Influencing  organizational 
performance  may  be  psedicted  from  three  other 
perceptual  measures  t.id  six  measures  of 
characteristics  of  th  •  respondent  and  his  or¬ 
ganization. 

A  series  of  one-way  an:  lyses  of  variance  on  the 
dependent  variable  was  clrot  completed  to  check 
whether  differences  in  ,'erccptior.s  were  sys¬ 
tematically  determined  ly  differences  in  the 
background  of  the  respon lent  or  hlo  organiza¬ 
tion.  No  substantial  dl  ferences  in  managerial 
perceptions  of  organizats  >nal  performance  could 
be  attributed  to  such  bac  ground  differences. 

Following  this,  hierarchic  ll  regression  analy¬ 
ses  were  done,  taking  managerial  perceptions 
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of  organizational  performance  as  the  dependent 
variable,  with  the  ocher  perceptual  and  back¬ 
ground  measures  (created  as  dummy  variables)  as 
predictor  variables.  (Intercorrelation  among 
predictor  variables  was  minimal.) 

The  large  number  of  predictor  variables  (14 
perceptual  measures,  19  respondent  and  organ¬ 
ization  characteristics  variables)  probably 
make  the  regression  coefficients  produced  by 
the  regression  analyses  unreliable.  As  an  al¬ 
ternative  method  of  assessing  the  relative  im¬ 
portance  of  groups  of  predictor  variables,  the 
increment  in  variance  explained  (multiple  R^) 
may  be  examined  at  each  step  of  a  stepwise 
hierarchical  regression  analysis. 

Each  ol  the  three  performance  influence  factors 
was  taken  as  the  dependent  variable,  in  turn. 
All  respondent  characteristics  variables  were 
entered  in  the  analyses  on  the  first  step, 
followed  by  the  organization  characteristics 
variables.  Together  these  "objective"  measures 
explained  very  little  variance  in  the  perform¬ 
ance  Influence  factors  (R^”.00-.03). 

The  perceptions  of  environmental  constraints 
variable  was  entered  on  the  third  step  of  the 
analyses.  This  variable  does  not  add  much  to 
the  variance  explained  in  the  performance  in¬ 
fluence  factors  (r2~.00-.03). 

The  individual  goals  factors  were  entered  on 
the  fourth  step  of  the  analyses  and  the  cor¬ 
porate  goals  factors  on  the  fifth  step.  To¬ 
gether  they  add  about  ten  percent  additional 
variance  explained  to  the  total  (R^-.10-.12). 

The  order  in  which  variables  are  entered  in  a 
stepwise  regression  analysis  affects  the  amount 
of  variance  they  explain.  The  order  of  en¬ 
trance  used  here  reflects  an  attempt  to  assess, 
the  effect  of  the  three  predictor  variables 
which  are  perceptual  In  nature  on  the  dependent 
variable,  once  the  effects  of  objective  vari¬ 
ables  have  been  accounted  for.  The  results 
suggest  that  the  perceptual  variables  contri¬ 
bute  most  to  the  total  variance  explained, 
even  beyond  the  variance  explained  by  the  ob¬ 
jective  variables,  but  the  overall  amount  of 
variance  they  explain  (between  tvn  and  twelve 
percent)  still  Is  not  substantial. 

With  respect  to  the  qucs  on  of  what  these 
perceptions  reflect  about  the  actual  operating 
organization  and/or  its  members  we  con¬ 
clude  ’.hat  the  evidence  here,  though  not  ex¬ 
tensive,  suggests  that  the  perceptions  are  not 
mere  cplphenomeno,  not  simply  an  expression  of 
the  perccivor'3  viewpoint;  Instead  they  re¬ 
flect  the  literal  everyday  life  of  the  organi¬ 
zation.  And,  they  Indicate  that  life  to  be 
rather  disjointed:  goals  of  the  organization 
and  lta  subsystems,  as  well  as  perceptions  of 
environmental  constraints,  appear  to  be  only 
weakly  related  to  conceptions  about  what  fac¬ 
tors  Influence  project  performance.  Some 
analysts  have  suggested  that  organizations  are 


at  worst  Irrational  and  at  best  satlsflclng(4] , 
but  the  portrayal  of  organization  decision¬ 
making  implied  by  these  results  is  somewhat 
surprising. 

Assume  that  an  organization's  operations  are 
the  product  of  decision-making  in  multiple 
areas:  the  picture  presented  by  the  data  at 
hand  is  that  this  decision-making  is  not  at  all 
Integrated.  Organization  goals  seemingly  are 
determined  without  reference  to  environmental 
constraints  on  the  meeting  of  those  goals,  or 
how  those  broad  goals  are  related  to  the 
factors  which  influence  the  performance  of  a 
particular  project.  The  integration  may  not  in 
prince  ho  so  poor  as  is  depicted  by  aggregat¬ 
ing  discrete  perceptions  of  members  of  the  or¬ 
ganizations  involved,  but  the  fact  that  the 
imagery  of  these  members  suggest  it  to  be  so 
poor  is  noteworthy  in  itself. 


EFFECTIVE  PERFORMANCE 

Our  survey  data  dealt  with  the  kinds  of  things 
that  influence  performance  in  general.  There¬ 
fore,  although  one  would  expect  overlap,  in  our 
Interviews  with  projecL  management  personnel  we 
raised  the  more  particular  question  of  what  it 
took  to  produce  effective  performance.  Space 
allows  us  only  to  summarize  certain  of  our 
findings. 

We  asked  each  Interviewee  (N«64)  what  he  be¬ 
lieved  to  be  "the  essential  conditions  for 
effective  [RAD]  project  performance,"  and 
coded  their  responses  into  five  classes  of 
categories:  (1)  understanding  of  work  state¬ 
ments,  specifications  and  the  like;  (2)  avail¬ 
ability  of  resources  (financial,  technical,  and 
other);  (3)  modes  of  project  organization;  (4) 
relations  between  the  contractor  and  the  pro¬ 
curement  agency;  and  (5)  the  effects  of  con¬ 
tracts. 

By  and  large,  our  interviewees  emphasized  as 
contributors  to  effective  performance  such 
things  as  clear  work  statements  and  specifica¬ 
tions,  along  with  the  availability  of  re¬ 
sources;  they  deeaphaslzed  modes  of  project 
organization,  contractor-customer  relations, 
and  contracts,  per  se.  However,  of  all  the 
specific  conditions  for  effective  performance, 
the  one  most  prominently  mentioned  was  "having 
capable  technical  personnel." 


CONCLUSIONS 

A  need  for  capable  technical  people  to  assure 
effective  RAD  project  performance  may  seem 
obvious.  But  the  Idea  may  also  have  a  less 
obvious  Implication.  Placed  in  juxtaposition 
with,  on  one  side,  our  interviewee's  secondary 
emphasis  on  clarity  ond  rationality  *  work 
statement,  and,  on  the  other  side,  with  the 
somewhat  disorderly  or  unintegrated  view  of 
organizational  decision-making  suggested 


earlier.  It  encourages  speculation  that  die 
effective  technical  manager  is  valued  not  only 
for  his  operational  skill,  but  also  for  his 
ability  to  sort  out  "by  hand,"  so  to  speak,  the 
disparate,  poorly  organized  flow  of  messages 
relevant  to  R&D  project  performance. 

At  any  rate,  clearly  it  is  time  to  develop 
more  systematically  the  basic  theory  of  how 
perceptions  of  members  of  organizations  relate 
to  the  behavioral  reality  of  organizational 
structures.  No  matter  how  interesting  and 
suggestive  may  be  dat3  such  as  those  reported 
here,  they  leave  essentially  unanswered  some 
basic  questions  of  validity.  Furthermore,  in 
order  to  Improve  practical  methodologies  of 
project  management  and  the  procurement/acqui¬ 
sition  process,  more  descriptive  research  is 
also  needed  to  Illuminate  just  how  organiza¬ 
tions  really  function. 
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CONTRACT  DISPUTES  AND  APPEALS:  RESPONSIVE  PROCEDURES  ARE  NEEDED 

Captain  Thomas  L.  Alexander 
Air  Cormand  and  Staff  College 


Introduction 

Administrative  procedures  for  resolution 
of  Government  contract  disputes  have  been  a 
subject  of  controversy  for  many  years. 

Recently,  however,  demands  for  procedures 
improvement  have  been  voiced  by  almost  all 
segments  of  the  Government  contract  arena. 

Contractors  have  become  frustrated  with 
the  time-consuming  expensive  procedures.  At 
the  same  time,  economic  conditions  have 
forced  contractors  to  saturate  the  appeals 
boards  with  claims  involving  relatively 
small  monetary  amounts.  In  turn,  the 
increased  number  of  snail  claims  adds  to  the 
existing  appeals  backlog  and  thereby 
lengthens  the  overall  time  Involved  in  the 
appeals  process.  As  a  result,  competition 
suffers  as  more  and  more  contractors  become 
disgusted  with  the  Inefficiency  and  expense 
of  the  system.  (5:2-3) 

This  study  reviews  administrative  proce¬ 
dures,  workload  data,  and  processing  time- 
frames  for  contract  disputes  and  appeals  to 
determine  if  revisions  are  needed.  The 
problems  examined  Include  the  contracting 
officer's  dilemma  and  the  Armed  Services 
Board  of  Contract  Appeals  process  for  appeals 
involving  $25,000  or  less.  Perspectives  of 
several  possible  solutions  to  the  problems 
are  described.  The  study  concludes  that  new 
procedures  should  be  implemented  to  restore 
flexibility  and  responsiveness  to  contract 
disputes  and  appeal  procedures.  Several 
specific  solutions  are  recommended  for 
implementation  in  developing  responsive 
administrative  procedures. 

Disputes 

Government  contract  dispute  procedures 
have  been  defined  as  the  adminsltrativo 
resolution  of  controversies  arising  under  a 
Government  contract,  the  final  stages  of 
which  are  adjudicative  in  nature.  The  primary 
purpose  in  using  administrative  procedures 
has  been  to  provide  an  expeditious  and 
inexpensive  mechanism  for  settling  disputes 
between  contractors  and  the  Government  with¬ 
out  resorting  to  the  court  syscem.  When  a 
contract  controversy  in  defined  a3  a  dispute 
subject  to  the  administrative  procedure,  the 
contractor  acquires  an  avenue  for  prompt 
settlement  and  forgoes  the  breach  of  contract 
remedy.  (6:1)  Thar  avenue  for  prompt 
settlement  begins  with  the  Government's 
contracting  officer. 

A  contracting  officer's  authority  to 
resolve  disputes  is  one  of  the  most  challeng¬ 
ing  and  yet  one  of  the  most  unregulated  of  the 


authorities  granted.  The  Armed  Services  Pro¬ 
curement  Regulation  only  briefly  covers  dis¬ 
putes  and  appeals  procedurally  in  ASPR  1-314. 
The  failure  of  the  regulation  to  provide 
adequate  guidance  and  to  fully  address  the 
extent  of  negotiation  and  adjudication  of  dis¬ 
putes  at  the  contracting  officer  level  has 
been  responsible  for  an  increased  volume  of 
appeals.  (3:2)  In  addition,  the  contracting 
officer  confronts  a  dual-role  dilemma. 

In  most  disputes  there  have  been  attempts 
to  negotiate  a  compromise  mutual  agreement  in 
an  effort  to  resolve  the  problem.  If  un¬ 
resolved,  the  controversy  deepens  and  becomes 
static  as  each  side  becomes  more  firm  in  its 
own  position.  The  contracting  officer  repre¬ 
sents  the  Government  and  protects  what  is 
believed  to  be  the  Government's  interest.  The 
contractor  protects  his  own  interest  in  this 
adversary  stage  of  the  dispute.  In  this  stage, 
the  contracting  officer  is  reflecting  his 
responsibility  to  the  Government,  his  employer, 
as  required  by  regulation.  Assuming  that  the 
Government's  position  is  based  on  good  faith 
and  sound  Judgement,  it  is  the  contracting 
officer's  duty  to  enforce  the  position.  It 
is  also  natural  for  the  contracting  officer 
to  associate  very  closely  with  the  Government 
position  since,  ir  fact,  it  is  the  result  of 
his  personal  conclusions  based  on  a  review  of 
'’vailable  information  and  staff  coordination. 
Regardless  of  advice,  assistance,  or  support 
obtained,  the  decision  is  the  personal 
responsibility  of  the  contracting  officer. 
Therefore,  from  the  contracting  officer's 
perspective,  there  is  something  nkin  to  "pride 
of  authorship"  that  may  reinforce  the  con¬ 
tracting  officer's  position  and  increase  the 
adversary  nature  of  the  dispute.  (1:73-74) 

When  the  contractor  requests  a  final 
decision  from  the  contracting  officer,  the 
contracting  officer's  role  changes.  The  role 
changes  from  one  Involving  discussion  and 
negotiation  of  positions  to  one  of  the  quasi- 
judicial  nature.  In  this  new  role,  the  con¬ 
tracting  officer  is  required  to  render  a  fair 
and  impartial  decision,  based  on  the  available 
facts  and  legal  advice,  and  the  contractor  is 
required  to  proceed  with  contract  performance 
in  accordance  with  the  contracting  officer's 
decision.  One  author  has  compared  the  dual 
role  as  analogous  to  a'  lawyer  arguing  a  cose, 
and  then  putting  on  the  Judicial  robes  and 
rendering  the  decision  on  the  case  just 
argued.  The  personal  equation  is  difficult 
to  exclude  from  the  official  position  of  a 
contracting  officer.  The  problem,  then,  is 
that  the  aane  individual  Is  making  a  final 
decision  as  to  Che  validity  of  his  own  pre¬ 
vious  arguments  and  conclusions.  Human 
nature  normally  dictates  the  outcome  of  this 
dual  role  dilemma.  (1:75) 
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process  of  law.  (5:15-17) 


One  perspective  of  this  problem  Is  that, 
despite  the  best  of  Intentions,  integrity, 
and  talent,  contracting  officers  are,  like 
everyone  else,  human,  and  therefore  subjecc 
to  human  fallibility.  (1:76)  A  second 
perspective  states  that  contracting  officers 
do  not  render  decisions  In  a  fair  and  impar¬ 
tial  manner  and  have  Ignored  their  judicial 
role  in  most  disputes.  This  is  attributed 
to  lack  of  motivation  to  settle  the  dispute 
at  any  point  less  than  completely  favorable 
to  the  Government.  This  perspective  con¬ 
tends  that  contracting  officers  must  pursue 
an  adversary  role  In  order  to  protect  them¬ 
selves;  realistically,  shifting  roles  is 
difficult.  In  short,  this  perspective  states 
chut  the  contracting  officer  would  prefer  to 
shift  the  dispute  to  ASBCA  without  Judicial 
consideration  n  his  port.  (3:1-7) 

In  summary,  contracting  officer's  duties 
require  that  they  be  prepared  to  change  roles 
in  contract  dispute  situations,  and  the  dual 
roles  are  perceived  as  a  dilemma  which 
requires  expanded  procedures  for  proper 
resolution.  However,  this  dilemma  is  only 
the  first  problem.  A  second  problem  area 
arises  when  an  appeal  of  the  contracting 
officer's  final  decision  is  filed  with  the 
Armed  Services  Board  of  Contract  Appeals 
(ASBCA) . 

Appeals  and  the  ASBCA 


Several  other  factors  effect  the  proce¬ 
dures  problem  in  addition  to  the  increased 
due  process  factor.  Among  them  are  inflation 
and  the  increasing  complexity  of  Government 
procurements.  With  the  shift  to  increased 
use  of  fixed  price  contracts,  inflation  and 
defective  specifications  have  forced  contrac¬ 
tors  to  file  appeals  and  claims  or  face 
financial  losses  on  many  Government  contracts. 
Therefore,  the  Board  wor.’tload  began  to 
increase  significantly.  Thi3,  coupled  with 
the  additional  time  and  expense  caused  by  due 
process  requirements,  created  the  present 
situation  in  which  appeals  are  time-consuming, 
expensive,  and  frustrating  for  both  the  con¬ 
tractor  and  the  Government.  In  short,  the 
procedures  are  no  longer  responsive  to  the 
need  for  efficient,  economical,  settlement  of 
appeals.  (4:354-358) 

The  following  tables  are  intended  to 
illustrate  the  workload  and  time  problems 
involving  appeals  under  the  existing  proce¬ 
dures.  The  information  was  furnished  by  the 
ASBCA.  (9:1-6) 

Table  1 
Appeals  Data 

Armed  Services  Board  of  Contract  Appeals 
During  FY's  1974-1977 


The  problem  presented  here  deals  with  the 

FY74 

FY75 

FY76 

FY77 

current  process  of  appealing  a  final  decision 
and  the  lack  of  responsive,  inexpensive  pro¬ 

1. 

Method  of  Award: 

cedures  for  appeals  under  $25,000. 

Advertised 

558 

669 

544 

462 

An  appeal  to  the  Board  is  initiated  by  a 

Negotiated 

429 

387 

374 

371 

notice  of  appeal  which  is  filed  with  the  con¬ 
tracting  otficer.  Within  30  days  after  the 
appeal  is  docketed  at  the  Board,  the  appel¬ 

2. 

Contract  Type: 

lant  must  file  the  formal  complaint  setting 

Firm  Fixed  Price 

768 

777 

757 

713 

forth  clearly  the  basis  of  each  claim  and  the 
dollar  amounts  involved.  The  Government  must 

All  Other 

198 

259 

161 

120 

file  an  answer  to  the  complaint  and  the 

3. 

Time  of  Docket 

various  claims.  F.lther  party  pay  submit  a 

(Days  from  date 

pre-hearing  brief.  Also,  either  party  can 

of  docketing  to 

request  a  hearing  or  may  submit  its  case  on 
the  basis  of  the  record.  Testimony  and  other 

date  of  decision) 

: 

evidence  may  be  introduced  and  the  proceedings 

All  cases: 

are  recorded  as  a  crar  .-ipt  of  record.  The 

Average 

442 

420 

387 

451 

procedures  have  becomt  >ighly  Judicial  in 
nature  because  of  several  landmark  court 

lied  lan 

345 

300 

284 

344 

decision  and  Congressional  legislation  which 

P.ule  12  cases: 

affected  the  Board  procedures.  (6:41-43) 

Average 

224 

205 

217 

241 

The  incorporation  of  the  court  decisions  and 

Med lan 

180 

193 

179 

211 

Federal  legislation  has  forced  the  Board  to 
provide  more  due  process  constraints  in  their 
proceedings.  As  a  result,  the  Board  proce¬ 
dures  became  more  formal,  more  expensive, 
and  more  time-consuming.  The  contractor 
normally  obtains  an  attorney  and  spends  time 
in  hearings,  etc.  Part  of  the  problem 
revolves  around  the  contractor's  need  for 
speed  and  economy  versus  the  need  for  due 
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Table  2 


Dispersion  of  ASBCA  Claims 


*  July  1971  -  April  1974 


0  -  $  25,000 

317-50.42 

$  25,000  -  $100,000 

147 

$100,000  -  $500,000 

99 

$500,000  and  up 

66 

629 

*  May  1974  -  April  1 

1975 

0  -  $  25,000 

360*52.62 

$  25,000  -  $100,000 

168 

$100,000  -  $500,000 

104 

$500,000  and  up 

52 

684 

*  May  1975  -  April  ! 

1976 

0  -  $  25,000 

381-54.62 

$  25,000  -  $100,000 

134 

$100,000  -  $500,000 

131 

$500,000  and  up 

51 

697 

*  May  1976  -  April 

1977 

0  -  $  25,000 

311-51.02 

$  25,000  -  $100,000 

150 

$100,000  -  $500,000 

91 

$500,000  and  up 

58 

610 

(317 
(629  “ 


50.42) 


(360 

(686 


52.62) 


(381 

(697 


S4.62) 


(311 

(610 


51.02) 


*  Period  covered  does  not  correspond  to 
Fiscal  Year:  data  was  not  provided  on  a 
fiscal  basis. 

It  Is  apparent  that  the  Board  currently 
has  a  backlog.  Also,  appeals  are  substan¬ 
tially  higher  for  advertised  awards  when  com¬ 
pared  to  negotiated  awards.  Likewise,  firm- 
fixed  price  (FFP)  contracts  are  appealed  a 
much  greater  percentage  of  the  time  than 
other  type:;  of  contracts. 

The  "Tine  on  Docket"  Information  Illus¬ 
trates  the  time  problem.  The  average  time 
exceeds  1  year,  and  even  the  median  figures, 
which  discount  extreme  values,  reflect  a 
10-12  month  timeframe  for  adjudication. 

Appeals  of  leas  than  $25,000  are  approxi¬ 
mately  50  percent  of  the  total  of  all  appeals 
filed  during  1973-77.  The  Commission  on 
Government  Procurement  found  that  61  percent 
of  the  ASBCA  appeals  In  1972  were  for  less 
than  $25,000.  (5:15)  In  either  case,  it  is 

significant  to  the  problem  of  responsive  pro¬ 
cedures. 

The  need  for  a  flexible  and  responsive 
appeals  system  was  alto  addressed  by  the 
Commission  on  Government  Procurement.  The 
Commission  reported  that  the  dictates  of 


Justice  have  emphasized  duo  piocc-s  .it  tilt- 
expense  of  both  speed  and  cnt,t,  and  that  the 
procedures  have  become  formalized  by  demands 
for  Judicial  type  safeguards.  Furthermore, 
the  Commission  found  that  the  ptosent  proce¬ 
dures  provide  neither  full  duo  process  for 
large,  complex  claims,  nor  a  fast  and  inexpen¬ 
sive  means  of  resolving  small  claims.  The 
overriding  problem  with  the  present  system,  as 
determined  by  the  Commission,  Is  the  attempt 
to  adjudicate  appeals  and  claims  across  the 
entire  spectrum  of  size  and  complexity. 
(5:19-22) 


POSSIBLE  SOLUTIONS 

Separation  of  Contracting  Officer  Roles 

The  contracting  officer's  dilemma  has 
several  possible  solutions.  Regardless  of 
the  ultimate  solution  to  the  dilemma,  the 
regulations,  particularly  the  ASPR,  should 
be  revised  to  better  describe  the  proper 
actions  and  roles  of  the  contracting  officer 
during  disputes  and  appeals.  Many  experts 
say  the  contracting  officer  is  supposed  to 
get  the  "best  deal"  possible  for  the  Govern¬ 
ment;  however,  procurement  regulations  do  not 
clearly  define  that  requirement .  There  Is 
almost  no  guidance  on  disputes.  The  roles 
should  be  analyzed  and  the  regulations 
revised  accordingly.  Hhen  the  negotiation  of 
a  claim  breaks  down,  and  the  contractor 
requests  a  final  decision,  the  ASPR  should  be 
core  explicit  in  defining  the  requirements 
and  content  of  a  fair  and  impartial  decision. 
Also,  additional  guidance  Is  needed  to  insure 
that  the  negotiations  are  conducted  with 
impartiality  and  a  cooperative  business-like 
approach.  (3:11) 

Perhaps  Che  dilemma  could  bo  resolved  by- 
providing  a  separate  contracting  officer 
position  at  a  higher  procurement  authority 
level  (such  as  major  command  and  "SAr  head¬ 
quarters).  The  position  should  also  be 
organizationally  separated  from  the  contract¬ 
ing  officer  Involved  in  the  dispute.  This 
contracting  officer,  who  could  be  called  a 
Disputes  Contracting  Officer  (DCO) ,  would 
take  jurisdiction  of  the  dispute  when  notified 
that  negotiations  had  failed.  The  DCO  would 
be  responsible  to  review  the  contract  and  all 
documents  Involved  In  the  dispute.  Informal 
arguments  could  be  heard  by  the  DCO  prior  to 
Issuance  of  his  flnsl  decision.  An  appeal 
to  the  Board  could  still  be  made  by  the  con¬ 
tractor.  Present  procedures  could  also  be 
revised  to  allow  claims  of  less  than  $25,000 
to  be  submitted  directly  to  a  small  claims 
forutg  or  to  the  proper  court  if  not  settled 
by  the  DCO.  The  ASBCA  process  could  he  an 
option  for  small  claims,  based  on  contractor 
desires.  Tie  advantage  to  this  procedure 
change  Is  that  a  more  Impartial  third  party 
would  make  the  final  decision  and  the  original 
contracting  officer  would  not  have  to  change 
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roles  from  negotiator  to  adjudicator.  No  new 
role  would  be  introduced,  but  the  Judicial 
role  would  be  filled  by  someone  in  a  better 
position  to  provide  impartial  and  tair  treat¬ 
ment  to  both  parties.  (3:10)  The  Impact  of 
this  suggested  procedure  appears  to  be  a  shift 
of  respor.sib  11  tty  and  authority.  In  some 
Instances,  contractors  and/or  the  contracting 
officer  might  Sail  to  negotiate  adequately, 
in  order  to  pass  the  problem  to  the  DCO  for 
resolution.  However,  the  basic  concept 
seems  to  be  a  means  of  resolving  the  contract¬ 
ing  officer  dilemma.  (1:81) 

Appeals  Under  $25,000 

\  review  of  the  dispersion  of  claim3  in 
Table  2  q-lc’-  discloses  that  approximately 
50-55  percent  <  f  the  monetary  claims  were  for 
amounts  of  less  than  $25,000.  Most  author¬ 
ities  agree  chat  claims  in  that  category  are 
considered  to  be  small  claims  and  should  be 
handled  in  a  reasonable  rapid  manner  without 
lengthy  Involved  procedures.  The  existing 
procedures  have  failed  to  provide  adequate 
flexibility  and  responsiveness.  (5:20) 

A  resolut:on  proposed  by  the  Commission 
on  Government  Procurement  offers  one  peispec- 
tlve  of  a  more  responsive  and  flexible  admin¬ 
istrative  system.  The  Commission  stated  that 
justice  and  efficient  operation  can  best  be 
obtained  by  a  system  which  provides  alterna¬ 
tive  forums  for  resolution  of  particular 
kinds  of  disputes.  The  contractor  should  be 
able  to  choose  a  forum  based  on  his  needs  In 
e3ch  particular  case;  forums  where  Che  degree 
of  due  process  can  be  Judged  against  the  time 
and  expense  involved.  The  Commission  recom¬ 
mended  establishment  of  a  series  of  small 
claims  hoards  as  one  means  of  providing  fast, 
relatively  informal  and  Inexpensive  adjudica¬ 
tion  of  appeals  claims  of  $25,000  or  less. 

The  small  claims  boards  would  be  geographic¬ 
ally  dispersed  and  would  operate  under 
informal,  accelerated  procedures,  with  the 
present  ASBCA  no  longer  utilizing  an 
accelerated  procedure.  (5:17-18)  Under  the 
solution  proposed  by  the  Corar.lsslon,  the 
contractor  would  have  the  option  of  filing 
an  appeal  Involving  $25,000  or  less  with 
either  a  small  claim*  ''oard,  or  the  ASBCA, 
depending  on  the  an  ,c  of  due  process,  time 
and  expense  deter  ir..  1  necessary  by  the  con¬ 
tractor.  Adverse  decisions  of  the  small 
claims  board  could  receive  a  new  trial  In 
court.  If  desired  by  the  contractor.  Tills 
provision  would  tend  to  allow  the  small 
claims  hoards  to  remain  Informal  and  reason¬ 
ably  Inexpensive.  (5:22) 

Another  posalble  solution  pertinent  to 
claims  under  $25,000  concerns  revision  of  the 
"Htnputes"  clause  to  provide  coverage  of  "all 
disputes  resulting  from  a  contract."  Specif¬ 
ically  Involved  under  rhtn  limited  chsr.ge  are 
all  appeals  under  $25,000.  Thin  solution 


provides  that  the  ASBCA,  or  other  boards 
formed  to  act  on  small  claims,  would  be 
allowed  to  dispose  of  all  appeals  under 
$25,000,  some  of  which  presently  must  be 
decided  by  the  court  system.  This  procedure 
would  provide  flexibility  and  also  reduce 
time  ar.d  expense  to  the  contractor.  The  new 
procedure  would  allow  the  contractor  the 
option  of  appealing  to  an  administrative 
forum,  or  appealing  directly  to  the  court 
system.  If  full  Judicial  consideration  was 
desired.  The  main  advantages  to  this  solution 
are  (1)  the  "all  disputes"  provision  which 
would  encompass  disputes  not  covered  by  con¬ 
tract  terms — presently  outside  the  jurlsdic- 
iwC  of  the  ASBCA  ar.d  (2)  the  contractor’s 
option  to  se-e-t  either  the  administrative 
process  or  the  judicial  process  when  filing 
an  appeal.  At  present,  the  administrative 
Board  process  must  be  completed  before  the 
contractor  can  file  an  appeal  In  the  ^ourt 
system.  (2:123-124) 

Conclusions 

The  solutions  presented  In  this  study 
discuss  methods  of  improving  the  existing  pro¬ 
cedures  and  thereby  restore  effective  resolu¬ 
tion  of  disputes  and  appeals  at  mlninua 
expense.  Flexibility  and  responsiveness  can 
be  restored  by: 

(1)  separating  the  roles  of  the  con¬ 
tracting  officer  and  providing  Disputes  Con¬ 
tracting  Officers  who  would  take  Jurist iction 
of  the  contract  when  settlement  negotiations 
breakdown,  thereby  eliminating  the  present 
dual  role  dilemma, 

(2)  establishing  a  scries  of  small 
claims  boards  for  claims  under  $25,000  as 
rcconreended  by  the  Commission, 

(3)  revising  the  presenc  Disputes 
clause  to  cover  all  disputes  resulting  "from 
the  contract"  for  claims  under  $25,000  to 
provide  options  for  the  contractors. 

Kecommendat Ions 

In  this  author's  opinion  the  following 
actions  are  recommended  as  a  means  of  resolv¬ 
ing  the  problems  reviewed  in  this  study. 

(1)  Revise  policies,  procedures  and 
procurement  regulations  to  provide  Improved 
guidance  for  contracting  officers:  establish 
a  combination  of  appeals  forums  to  provide 
tnc  contractor  with  forum  options  In  order 

to  Improve  the  responsiveness  and  flexibility 
of  Government  contract  appeal  procedures. 

(2)  Resolve  the  contracting  officer's 
dual  role  dilemma  by  separating  the  roles  and 
providing  a  separate  Disputes  '  .ratting 
Officer  (DCO)  for  disputes  and  appeals. 
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(4)  Provide  various  appeal  options 
based  on  levels  of  due  process,  time,  and 
expense.  The  contractor  should  be  provided 
the  flexibility  to  decide  which  appeals  forum 
Is  best  suited  to  his  needs.  The  options 
recommended  are  small  caltms  beards,  ASBCA, 
and  the  court  system. 

The  implementation  of  the  above  recommen¬ 
dations  should  fulfill  the  need  for  responsive 
administrative  procedures  for  contract  dis¬ 
putes  and  appeals. 
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ABSTRACT 


The  results  of  a  DoD  tri-service-sponsored  study 
to  investigate  contractor  risks  associated  with 
reliability  improvement  warranties  (RIW)  are 
summarized  in  this  paper.  To  provide  appropri¬ 
ate  background,  the  RIW  and  RIK/MTBF  guarantee 
concepts  are  first  reviewed.  Key  contractor- 
risk  assessment  models  are  developed  and  related 
to  the  issues  of  MTBF  predictability  and 
contractor  warranty  pricing . 1 


INTRODUCTION 


A  number  of  studies  have  indicated  that  military 
equipment  is  often  less  reliable  than  expected 
or  specified  and  in  some  cases  is  significantly 
less  reliable  than  comparable  commercial  equip¬ 
ment  (2)[8](9)  .  Poor  reliability,  of  course,  in¬ 
creases  maintenance  and  logistic  support  costs 
and  reduces  operational  readiness.  To  counter 
undesirable  trends  in  support  cost  and  readi¬ 
ness,  long-term,  comprehensive  warranties  are 
being  applied  in  a  number  of  military  equipment 
procurements.  The  approach  is  known  generall'' 
as  the  reliability  improvement  warranty  (RIW) . 

There  are  many  approaches  for  structuring  RIW 
terms  and  conditions  to  cover  various  contin¬ 
gencies.  Basically,  all  RIW  contracts  contain 
provisions  for  the  equipment  producer  to  assume 
responsibility  for  certain  types  of  repair  serv¬ 
ices  for  the  warranted  equipment  over  an  ex¬ 
tended  period  and  to  charge  a  fixed  price  for 
these  services.  One  of  the  most  frequently  used 
variations  is  to  include  a  provision  whereby  the 
contractor  guarantees  that  a  stated  mean  time 
between  failures  (MTBF)  will  be  experienced  by 
the  equipment  in  the  operating  environment.  If 
the  guaranteed  level  is  not  met,  the  contractor 
must  provide  relief,  such  as  instituting  correc¬ 
tive  action  and  supplying  consignment  spares 
until  the  MTBF  improves.  Inherent  in  all  RIW 
contracts  is  an  incentive  for  the  manufacturer 
to  design  and  produce  reliable  equipment.  Pro¬ 
fits  are  reduced  with  each  unit  returned  for 
warranty  service,  and  the  contractor  must  deter¬ 
mine  how  much  to  invest  in  design  and  production 
to  achieve  a  product  with  a  level  of  reliability 
that  will  maximize  profits.  Ir.  addition,  if  an 
unexpected  reliability  problem  arises  during  the 


‘opinions  expressed  in  this  paper  are  those  of 
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warranty  period,  the  contractor  must  decide  if 
he  should  make  further  investment  to  correct 
such  a  problem  and  thus  reduce  future  warranty 
repair  costs. 

Although  a  number  of  warranty  contracts  have 
been  negotiated  with  defense  industry  companies, 
considerable  concern  has  been  voiced  about  the 
risks  inherent  in  the  form  of  warranty  cur¬ 
rently  being  applied.  The  Council  of  Defense 
and  Space  Industries  Association  (CODSIA)  has 
been  the  focal  point  for  much  of  industry's 
concern  with  the  degree  of  risk.  In  response 
*■0  this  concern,  the  Department  of  Defense  has 
issued  guidelines  for  warranty  implementation 
that  place  particular  emphasis  on  tailormq 
the  terms  of  the  RIW  so  that  the  rewards  and 
risks  to  both  government  and  industry  are  ac¬ 
ceptable.  1  In  addition,  a  tn-servico  contract 
was  awarded  to  ARINC  Research  Corporation  to 
examine  risk  issues,  to  determine  their  scope, 
and  to  suggest  alternatives  or  modifications 
that  would  prevent  excessive  wananty  risk. 

This  paper  presents  the  major  results  of  the 
study  (4) .  The  primary  RIW  and  MTBF  guarantee 
risk  factors  that  were  identified,  together 
with  the  suggested  means  for  controlling  such 
risks,  are  reviewed.  Approaches  for  quantita¬ 
tive  assessment  of  contractor  risk  are  then 
described,  with  emphasis  on  reliability- 
prediction  uncertainty.  The  conclusions  and 
recommendations  developed  in  this  study  are 
then  summarized. 


CONTROLLING  RIW  RISKS 


The  risks  associated  with  RIW  contractual  com¬ 
mitments  can  be  examined  both  quantitatively 
and  qualitatively.  The  quantitative  approach 
permits  an  objective  assessment  of  the  risks 
involved.  The  qualitative  approach  supports 
such  assessment  by  addressing  areas  of  uncer¬ 
tainty  that  cannot  be  st'udied  quantitatively 
and  by  suggesting  approaches  to  reducing  the 
number  of  significant  risk  variables. 

Our  qualitative  examination  involved  de¬ 
tailed  discussions  with  experienced  RIW  con¬ 
tractors  to  gain  an  understanding  of  their 
misgivings,  a  review  of  industry's  position 
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as  represented  by  CODSIA, 3  and  a  study  of  past 
warranty  contracts.  We  found  that  contractors 
are  faced  with  both  explicit  and  implicit  risks. 
The  former  are  directly  associated  with  the 
contractor's  entering  into  the  warranty  agree¬ 
ment  and  may  include ’the  following: 

•  The  contractor  cannot  precisely  determine  the 
frequency  of  failure  of  the  cost  to  repair. 

•  Equipment  is  subjected  to  unforeseen  opera¬ 
tional  stresses,  causing  it  to  fail  more 
frequently. 

•  By  mishandling  or  tampering,  military  main¬ 
tenance  personnel  may  cause  failures  beyond 
contractor  control. 

•  Increased  equipment  usage  will  increase 
exposure  to  failure. 

•  Slow  government  processing  of  reliability  and 
maintainability  Engineering  Change  Proposals 
(ECPs)  will  hamper  the  improvement  process. 

•  The  contractor  may  bid  too  low  a  price  be¬ 
cause  of  competitive  pressures,  optimistic 
reliability  and  maintainability  estimates,  or 
misinterpretation  of  provisions. 

•  The  inflation  rate  may  exceed  planned  levels, 
affecting  labor,  material,  and  overhaul  costs. 

The  implied  risks  are  less  clearly  defined.  An 
RIW  can  affect  sales  and  profit  the  contractor 
might  realize  on  the  equipment  without  an  RIW. 
Additional  contractor  income  has  resulted  from 
ECPs,  spare  part  sales,  and  contract  maintenance 
(12) .  Although  the  RIW  in  itself  represents 
additional  sales,  it  may  adversely  affect  the 
sales  resulting  from  these  sources.  Conversely, 
it  can  be  argued  that  the  RIW  will  lead  to  a 
superior  product  that  could  ultimately  result  in 
more  end-item  sales.  Contractors  whe  desire  to 
increase  their  share  of  the  market,  enhance  the 
probability  of  follow-on  awards,  promote  product¬ 
line  growth,  or  foster  public  relations  may 
choose  to  enter  into  a  warranty  agreement.  In 
effect,  a  management  decision  is  made  to  forego 
short-term  profits  for  what  are  viewed  as  long¬ 
term  benefits. 


RIW  RISK  FACTORS 


Some  important  factors  ri-  ated  to  these  contrac¬ 
tor  risks  are  identified  in  Table  1,  which  also 
lists  proposed  risk-reduction  approaches.  Ac¬ 
tions  that  might  be  taken  to  limit  or  preclude 
the  risks  are  presented  in  the  column  headed 
"Risk-Reduction  Approach”.  The  factors  presented 
in  Table  1  constitute  many  of  the  risks  likely  to 
be  enountered  in  RIW  contracting:  they  represent 

’Letters  to  Director,  U.S.  Army  Procurement  Re¬ 
search  Office,  July  1975;  Chairman,  Tri-Service 
Reliability  and  Support  Incentives  Group, 
December  1975:  and  Director  of  Procurement 
Policy,  LGP,  USAF,  April  1976. 


current  RIW  knowledge.  It  is  acknowledged  that 
problems  may  arise  in  a  given  procurement  that 
may  be  unique  to  the  program  or  represent  a  set 
of  new  circumstances  requiring  the  addition  of 
new  provisions.  Finally,  even  with  protective 
provisions,  it  is  important  that  RIW  and  RIW/ 
MTBF-guarantee  Is  carefully  applied  only  to 
situations  in  which  there  is  reasonable  expec¬ 
tations  of  achieving  desired  field  performance. 


CONTROLLING  RISKS  OF  MTBF  GUARANTEE 


The  inclusion  of  an  MTBF  guarantee  in  the  RIW 
co-iira-t  merits  special  attention.  In  most 
cases,  the  gu-: anteed-MTBF  provision  requires 
the  contractor  to  provide  consignment  spares  in 
the  event  operational  MTBF  does  no'  meet  a 
specified  level.  The  contractor  is  also  obli¬ 
gated  to  improve  the  equipment  to  resolve  the 
reliability  deficiency,  and  the  government  re¬ 
tains  the  consignment  spares  until  such  im- 
piovenont  is  achieved.  Careful  consideration 
must  be  given  to  the  additional  risk  associated 
with  this  £>otentially  costly  obligation. 

The  MTBF-guarantee  provisions  should  not  be 
included  for  the  newer-technology  items  when 
there  is  great  uncertainty  about  reliability 
prediction  because  of  a  limited  data  base  on 
similar  equipment.  In  addition,  the  provision 
requiring  consignment  spares  may  not  be  appli¬ 
cable  if  the  production  run  does  not  coincide 
with  the  coverage  period. 

The  definition  and  measurement  of  MTBF  must  bo 
carefully  stipulated  and  completely  understood 
by  both  parties.  In  most  casus,  not  all  equip¬ 
ment  returns  are  included  in  the  calculation 
(o.g.,  excluded  failures  and  unverified  fail¬ 
ures)  .  Since  military  service  data  systems  do 
not  normally  provide  direct  reporting  of  total 
operating  time,  clearly  delineated  procedures  for 
for  obtaining  such  data  must  be  developed.  The 
liabilities  associated  with  the  MTBF  guarantee 
must  be  kept  within  reasonable  limits.  The 
following  are  suggested  approaches: 

*  Provide  a  grace  period  before  invoking  the 
MTBF  guarantee  so  that  initial  production  and 
installation  problems  can  bo  resolved. 

*  State  a  maximum  number  of  consignment  spares 
the  contractor  may  h*’’e  to  provide  and  in¬ 
clude  a  provision  requiring  timely  government 
return  of  consignment  spares  as  stipulated  in 
the  contract. 

*  Permit  the  contractor  to  offer,  as  now  equip¬ 
ment,  consignment  spares  that  have  been  re¬ 
turned  and  refurbished 

*  If  the  equipment  Kl’BF  achieves  the  highest 
required  level  prior  to  t.  "ract  termination, 
relieve  the  contractor  of  the  nee  o  demon¬ 
strate  further  compliance. 
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Table  1.  Contractor  RIW  Risk  Factors  and  Risk  Redaction  Approaches 

Risk  Factor 

Risk  Reduction  Approach 

I .ate  notification  of  intention  to 
use  warranty 

The  intention  to  use  warranty  should  be  made  known  to  the  contractor  as  early  as 
possible  during  engineering  development  so  that  he  will  have  maximum  opportunity  to 
optimize  his  design. 

Detailed  government  specification 
of  item  design 

Functional  specifications  should  bo  used  to  the  maximum  extent  to  ucmit  design 
flexibility. 

Application  of  RIW  to  advanced 
technology 

Warranty  may  not  be  appropriate  for  completely  revolutionary  design.  When  applied 
to  new  technology,  the  program  funding  and  schedule  should  allow  for  adequate 
reliability  testing.  A  cost-sharing  RIW  agreement  could  be  considered. 

Reliability-prediction  uncertainty 

The  government  should  specify  only  a  minimum  acceptable  level  of  reliability. 
Operational  and  environmental  data  should  be  provided  to  the  contractor.  Adequate 
time  and  funding  for  necessary  reliability  testing  should  be  included  in  the 
contract. 

Unpredictability  of  inflation  rates 
for  long-term  agreements 

The  warranty  price  should  be  tied  to  economic  adjustment  provisions  to  account  for 
inflation. 

Failures  outside  contractor  control 

Exclusions  should  be  provided  for  such  instances  as  acts  of  God,  fire,  explosion, 
submersion,  flood,  combat  damage,  aircraft  crash,  and  unauthorized  tampering  by 
government  personnel.  Exclusions  for  mishandling  should  be  carefully  worded. 

Large  number  of  unverified  failures 
("test  goods")  returned  to 
contractor 

Contractual  provisions  should  be  made  for  sharing  the  costs  of  processing  good 
returns. 

Item  usage  rate  not  precisely  known 

The  contract  should  provide  for  a  price  adjustment  for  significant  vaiijtions  in 
usage  rate,  or  seek  a  cut-off  on  total  operation  time. 

Data  not  supplied  to  contractor  as 
required 

Contract  provisions  should  include  oovernment  responsibilities  for  meeting  data 
obligations  in  a  timely  manner.  Contractor  obligations  for  warranty  performance 
may  be  related  to  receipt  of  applicable  data. 

Shipping  destinations  of  warranted 
items  may  not  be  known  at  time  of 
bidding 

If  there  is  significant  uncertainty  about  shipping  costs,  the  government  should 
assume  these  costs. 

Effect  on  turnaround  time  of  events 
outside  contractor  control  (e.g., 
strike,  uneven  flow  of  failed 
units) 

Relief  from  turnaround- time  obligation  should  be  included  as  part  of  the*  contract. 

Time-consuming  procedures  for  ECP 
approve  1 

Warranty  provisions  should  provide  for  expeditious  approval  of  ECPs,  perhaps  by 
automatic  approval  unless  notification  is  given  within  a  certain  time  limit. 

•  Do  not  invoKa  a  guarantee  on  mean  tine  be¬ 
tween  removals  unless  the  product  is  very 
mature.  Limits  might  be  established  on  the 
"no  trouble  found"  returns  to  provide  for 
equitable  risk  sharing. 

Common  to  all  the  factors  discussed  is  that 
mechanisms  to  reduce  risk  can  be  evolved  and 
included  in  the  equipment  specification  or  KlU 
contract.  Review  of  existing  RIW  contracts 
also  Indicates  that  once  risk-reduction  ap¬ 
proaches  are  established,  they  are  applicable 
from  contract  to  contract.  This  suggests  that 
as  experience  is  gained  in  RI»r  contracting, 
problems  associated  with  many  of  the  risk  fac¬ 
tors  can  be  routinely  resolved  and  eventually 
will  not  be  considered  major  risk  areas.  The 
Department  of  Defense  and  the  military  services 
have  established  focal  points  for  monitoring 
warranty  contracting  and  implementation,  which 
should  provide  the  management  continuity  and 
-•ontrol  necessary  to  achieve  this  desired 
result. 


QUANTITATIVE  ANALYSIS  OP  RIW  RISK 


During  the  study,  a  number  of  approaches  to 
quantifying  warranty  risk  were  developed;  Risk 


quantification  must  consider  the  reasons  why 
a  contractor  may.  propose  or  contract  for  on 
RIW: 

•  It  is  part  of  the  RFP  and  the  contractor  has 
no  choice  if  he  is  to  be  responsive. 

•  He  believes  that  the  RIW  can  provide  addi¬ 
tional  profit  on  the  contract. 

'  He  believes  that  RIW  is  the  "coming  thing" 
and  that  the  particular  contract  will  serve 
as  a  good  learning  vehicle. 

•  He  believes  that  the  RIW  will  give  him  a 
competitive  edge  for  future  awards. 

The  first  two  reasons  listed  are  related  pri¬ 
marily  to  the  contract  under  consideration,  i.e., 
a  short-term  view,  while  the  second  two  arc 
related  primarily  to  long-term  considerations. 
This  distinction  is  important  because  the  risk 
and  uncertainty  aspects  are  viewed  differently 
for  the  two  cases.  In  the  long-term  case,  the 
contractor  may  consider  the  RIW  portion  of  the 
contract  as  an  investment  in  that  the  knowledge, 
experience,  and  reputation  gained  will  provide 
future  returns  that  are  not  otherwise  obtainable. 
In  this  long-term  view,  the  potential  outcomes 
and  prior  probabilities  are  not  as  likely  to  bo 
developed;  we  therefore  limit  our  initial 


WARRANTY  PROFIT  VARIANCE  AND  DISTRIBUTION 


quantitative  investigation  of  RIW  risks  to  a 
particular  contract.  However,  the  conclusions 
drawn  will  incorporate  longer-term  aspects  as 
appropriate. 


WARRANTY  COST  AND  PRICE  MODELS 


Wo  will  quantify  risk  in  terms  of  profit  on  the 
RIW;  for  a  short-term  view,  this  is  a  natural 
risk  variable.  (The  investigation  of  risks  also 
addressed  R1W/MTBF  contract  profits  and  total 
contract  profits;  These  results  are  briefly 
summarized  in  a  subsequent  part  of  this  paper.) 
Several  monels  for  warranty  cost  and  price  have 
been  formulated  [3) (6),  but  for  our  analysis  a 
simplified  vei-io  will  be  used.  Such  a  model 
for  contractor  warranty  cost  has  the  following 
form: 

WC  --  FC  +  X  X  TOH  X  CR  (1) 

where 

KC  =  contractor  warranty  cost  over  the 
warranty  period 

?C  =  contractor  fixed  costs  associates  with 
the  warranty 

TON  =  total  operate  hours  of  all  warranted 
equipment  over  the  warranty  period 
X  =  average  hourly  failure  rate  of  all 
warranted  equipment  over  the  warranty 
per iod 

CR  =  average  contractor  cost  to  repair  a 
unit  returned  for  warranty  service 

The  simplifications  and  assumptions  inherent  in 
this  model  are  quite  extensive  and  should  be 
noted:  Costs  include  overhead  factors  but  not 
profit;  all  future  costs  have  been  discounted  as 
necessary.  The  failure  rate,  X,  is  an  average 
value  that  accounts  for  such  factors  as  relia¬ 
bility  growth,  varying  population  sizes  over  the 
warranty  period,  and  returns  of  good  items.  The 
repair  cost  includes  the  processing  of  both  good 
units  and  failed  units  plu3  any  anticipated 
mxlificatior.s  necessary  to  achieve  acceptable 
reliability. 

The  warranty  price  model  used  is  based  on  the, 
cost  model  and  has  the  fol  ving  form: 

WP  =  (FCb  +  X„  x  TOHQ  X  CRU)FW  (2) 

where  the  subscript  B  denotes  a  "bid"  value  for 
pricing.  The  factor  FW  is  the  loading  applied 
to  expected  costs  to  yield  the  fee  or  profit. 
Therefore,  FW  will  generally  be  greater  than  1.0, 
and  its  value, may  very  well  be  influenced  by  the 
contractor's  view  of  his  risks  at  the  time  of 
pricing. 


For  further  simplification,  we  will  assume  that 
the  risks  and  uncertainties  associated  with  the 
fixed-cost  (FC)  and  total-operate-hou'f  (TOH) 
factors  are  at  a  relatively  minor  level.  The 
fixed  costs  are  usually  fairly  well  known  and 
are  usually  3mall  relative  to  the  total  cost. 
The  TOH  factor  is,  of  course,  important  and  is 
subject  to  wide  variations,  but  most  current 
RIW  terms  and  conditions  have  adjustments  or 
controls  for  undue  variability. 

It  ....  m-'ke  the  further  assumption  chat  failure 
rate  and  repair  cost  are  independently  distrib¬ 
uted,  we  can  show  that  profit  variance  is 
expressed  by  the  following  equatior- 

Cp=  (TOH)2  lp{  OcF+  <EX)2o£r+  IE(CR)  )2  (3) 

where 

E  =  expected-value  operator 
Op  =  RIW  profit  variance 
o£  ■=  variance  in  field  failure  rate 

°CR  “  variance  in  contractor  warranty  repair 
cost 

For  illustrative  purposes,  we  now  consider  a 
"typical"  warranty  procurement.  One  thousand 
units  with  four-year  warranty  coverage  are  to 
be  purchased.  Each  unit  operates  50  hours  per 
month  and  has  an  average  MTBF  over  the  warranty 
period  of  500  hours  £  100  hours  and  an  average 
repair  cost  of  $250  t  $35.  Assuming  that  the 
ranges  of  MTBF  and  repair  cost  represent  i3 
standard  deviations  of  a  normal  distribution, 
we  u3C  Equation  3  to  calculate  a  profit  vari¬ 
ance  of  $1.03  x  lo* or  a  standard  deviation 
of  $101,500.  A  profit/loss  probability  range 
is  estimated  by  the  equation4 

100p%  profit/loss  range  »  EP  t  knOp  (4) 

where 

EP  =  expected  profit 

kp  »  standardized  normal  deviate  associated 
with  probability  level  p 

If  the  contractor  bids  at  the  mean  values  of 
MTBF  and  repair  costs  and  it  fixed  costs  repre¬ 
sent  20  percent  of  total  repair  costs  (20  per¬ 
cent  of  $1,200,000  =  $240,(500) ,  the  total  bid 
cost  is  $1.44  million.  Assuming  a  fee  factor 

4If  X  and  CR  are  each  normally  distributed, 
the  product  cannot  be  exactly  normal.  How¬ 
ever,  from  a  variance  viewpo.  ,  the  term 
(TOH) 2  (ECR)  2oJ  will  generally  domis.~  ,  so 
that  CR  in  relatively  constant  compared  with 
variation  in  X.  If  X  is  normal)-/  distributed, 
the  normality  assumption  for  profit  will  be 
adequate. 


of  1.13  (i datively  high  to  coyer  R1W  risks), 
the  warranty  price  is  $1,627,000  —  a  targeted 
return  on  sales  of  11.5  percent. 

We  can  now  apply  Equation  4  to  evaluate  profit/ 
loss  ranges  from  a  probabilistic  viewpoint.  For 
example,  for  a  95-percent  probability  level,  the 
standardized  normal  deviate  is  about  2,  so  that 
the  95-perccnt  profit  range  is  $187,200  i  2 
($101,500)  =  -$15;800  to  $390,200.  In  terms  of 
return  on  sales,  this  range  converts  to  -1  per¬ 
cent  to  24  percent.  If  we  extend  the  analysis 
as  shown  (4),  we  can  state  that  if  the  contrac¬ 
tor  bases  his  warranty  price  on  a  500-hour  MTBF 
and  a  targeted  return  on  sales  of  12.5  percent, 
he  will  have  95  percent  assurance  of  earning  at 
least  a  5  percent  return  on  sales  if  the  ex¬ 
pected  MTBF  ranges  from  430  to  590  hours.  The 
equivalent  range  for  a  break-even  situation  is 
•about  395  hours  to  675  hours. 

In  many  respects,  the  example  used  is  represen¬ 
tative  of  a  number  of  military  warranty  procure¬ 
ments.  While  the  assumptions  made  or  individual 
numbers  chosen  might  be  questioned,  we  do  not 
believe  that  it  can  be  argued  strongly  that 
order-of-magnitude  errors  arc  involved.  The 
example  shows  that  RIW  risk  is  not  likely  to  be 
a  "bet  your  company"  proposition,  as  some  have 
claimed:  however,  it  entails  distinct  risks  not 
encountered  in  non-RIW  procurements. 


RETURN  ON  SALES  AND  MTBF  VARIATION 


We  now  consider  risks  associated  with  warranty 
pricing  on  the  basis  of  return  on  sales  (ROS) 
versus  MTBF  variation,  where 


RIW  Price 

We  let  pB  represent  the  average  MTBF  at  which 
the  warranty  was  bid  and  0ft  represent  the  actual 
MTBF.  It  can  be  shown  that  the  ratio  of  these 
MTBFs  is  related  to  the  warranty  pricing 
variables  by  the  formula 

Ojv,,  _  (TOH)CR  _ _  , 

0B  FW  (1  -  ROS)  l(TOH)  (CR)*+ 0gFC)  -  8BFC  l  ' 

From  the  contractor’s  point  of  view,  the  lower 
the  ratio  of  6ft  .to  0B  for  fixed  :RDS,  the  better. 
Equation  5  shows  that -the  MTBF  ratio  0ft  to  0B 
increases  as  FW  decreasea.  or  ROS  increases, 
which  is  equivalent  to- stating  that  the  warranty 
risk  is  proportional  to  target  ROS  and  inversely 
proportional  to  FW.  For  the-other  terms,  the 
picture  is  not  as  clear.  For  FW  (1-R0S)  greater 
than  1.0,  the  MTBF  ratio  (and  therefore  the  risk) 
increases  with  ROH  and  CR  and  it  decreaaes  with 
0B  and  FC.  The  relationships  are  reversed  when 
FW  (1  -  ROS)  is  leas  than  1.0. 

If  we  ascribe  greater  utility  to  not  losing  a 
large  amount  of  noney  than  to  earning  a  larger 
than  normal  profit  (a  usual  position  for  today's 


risk-averse  corporate  society),  wo  are  more 
interested  in  the  case  in  which  FW  (1-ROS)  is 
greater  than  1.0.  For  this  case,  a  low-risk 
RIW  would  be  a  contract  for  equipment  with  low 
utilization  (i.e.,  TOM),  low  Lepair  cost,  lugh 
MTBF  level,  and  high  relative  fixed  costs,  imd 
bid. with  a  high  fee  factor.  Similarly,  a  high- 
risk  procurement  is  one  for  which  the  utiliza¬ 
tion  and  repair  costs  are  high  and  Uie  relative 
fixed  costs,  MTBF  level,  and  fee  factor  are  low 


ROS/MTBF  RISK  RELATIONSHIPS 


We  have  developed  three  "generic"  risk  cases 
based  on  the  foregoing  relationships;  they  are 
described  in  Tabic  2.  These  cases  help  in 
developing  the  risk  relationship  between  the 
MTBF  ratio  and  return  on  sales. 


Table  2.  Case-StoJ/  V*lu<’*  j 

Risk 

Quantity 

Procured 

» tours 
per 
Month 

years  of 
warranty 

Fixrrt 

Cost  • 

fee 

ractwr* 

fo-t 

of 

Repair 

hid 

MTfiF 

LOW 

SOO 

50 

4  __ 

*100.000 

1.20 

100 

1000 

Mediua 

1000 

50 

4 

200.000 

1-15 

.*00 

W< 

High 

WOO 

50 

4 

J00.0O0 

1.1*’ 

400 

IOC* 

•Xt  eight  be  arg«e<J  that  the  ordering  of  the  fee  fattors  should  U 

I  ever  aed  1  e.«j*«  a  high-risk  procurement  should  hast  *  high  fee 
factor.  This  la  certainly  true,  but  we  are  wergl  dev-loptnj 
generic  cases.  Perhaps  competitive  factors  "fore*"  the  contrac¬ 
tor  for  the  high-risk  case  to  use  a  1.16  factor,  ore  of  the 
reasons  it  becomes  a  high-risk  case. 

However,  we  are  concerned  only  with  a  segment 
of  the  total  risk  picture;  thus  these  generic 
references  do  not  necessarily  apply  universally. 
As  a  simple  example,  low  utilization  is  gener¬ 
ally  accompanied  by  low  rick.  However,  if  the 
utilization  is  low  and  the  procurement  is  small, 
perhaps  not  enough  items  will  be  returned  early 
enough  in  the  program  to  detect  correctable 
failure  patterns.  Therefore,  the  contractor 
may  be  forced  to  "live  with"  the  low  OTBF  he 
initially  provides,  for  it  might  not  be  cost- 
effective  to  imnlement  an  ECP  after  the  warranty 
has  been  in  force  for  some  time.  This  situation 
was  actually  encountered  during  an  Air  Force 
gyro  warranty  program. 

To  show  the  relationships  quantitatively,  Figure 
1  plots  the  ratio  of  actual  OTBF  to  bid  MTBF  for 
three  types  of  procurement  tabulated  in  Table  2. 
Of  course,  for  any  ROS  in  the  figure,  the  Higher 
the  risk,  the  closer  the  actual  MTBF  must  be  to 
the  bid  value.  For  example,  to  break  oven  or, 
the  warranty  (ROS  =  0»),  the  ratios  of  actual 
OTBF  to  bid  MTBF  are  .91,  .85,  and  .73  for  the 
high-,  medium-,  and  low-risk  cases,  respectively. 

If  the  three  illustrative  cases  can  be  used  as 
generic  models  for  most  RIW  procurements,  we  can 
conclude  that  for  a  profit  to  be  realized  on 
RIW,  the  average  OTBF  over  chc  warranty  period 
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should  be  at  least  73  percent  of  the  bid  value 
for  a  Jow-rj.sk  procurement  and  at  least  91  per¬ 
cent  of  the  bid  value  for  a  high-risk  procure¬ 
ment.  For  a  10  percent  return  on  sales,  the 
percentages  for  the  low-risk  and  high-risk  cases 
become  87  percent  and  101  percent,  respectively. 
It  is  shown  in  Reference  4  how  the  contractor 
may  relate  the  fee  factor  (FW)  to  the  MTBF  ratio 
to  provide  further  insight  into  warranty  bidding 
risks.  Figure  2  shows  the  relationship  of  FK  to 
0^/00  for  ROS  levels  of  -10  pp-  jnt,  0  percent, 
and  10  percent  for  the  medium-  isk  procurement. 
It  is  noted  that  FW  decreases  at  a  decreasing 
rate  as  the  MTBF  ratio  increases,  a  charac¬ 
teristic  of  the  reciprocal  relationship  between 
RIW  profit  and  MTBF. 


MTBF  GUARANTEE  AND  TOTAL  CONTRACT  RISKS 


A  number  of  other  quantitative  analyses  were  per¬ 
formed  to  include  additional  factors.  When  an 
MTBF  guarantee  is  included  in  the  RIW  contract, 
the  contractor  risks  incrcitoe  with  respect  to 
MTBF  variation.  As  an  example,  for  one  typical 
case  examined,  for  a  break-even  result  (warranty 


ROS  o  0) ,  actual  WTHF  must  be  about  85  percent 
of  the  bid  value  for  an  RIW  alone,  but  it  must 
bo  about  92  percent  for  the  RIW/MTBF. 

We  also  examined  risks  from  a  total  contract 
viewpoint,  where  return  on  sales  also  includes 
hardware  profit,  which  is  assumed  to  be  fixed. 
As  expected,  the  field  MTBF  requirements  appear 
must  loss  severe  from  this  viewpoint  than  they 
do  when  only  RIW  return- on  sales  is  considered. 
For  example,  for  the  medium-risk  procurenent, 
with  a  10  percent  hardware  profit,  achievement 
of  a  7.5  percent  total  return  on  sales  requires 
a  ratio  of  actual  MTBF  to  bid  MTBF  of  about 
0.73,  as  compared  with  a  required  ratio  of  0.92 
for  only  the  RIW  return  on  sales.- 


MTBF  PREDICTABILITY 


The  ability  to  predict  MTBF  accurately  lias  been 
the  key  issue  in  alW  risk.  C0DSIA,  in  a  .:ter 
to  the  Air  Force  in  1976,  stated: 

"Until  the  hardware  is  tested  in  an  opera¬ 
tional  environment,  with  typical  operational 
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Figure  2.  Warranty  Fee  Factors  Versus  MTBF  Factors  —  Medium-Risk  Procurement 


users,  and  in  all  planned  vehicle3/platforms, 
etc.,  reliability  (the  basis  for  a  good  RIW 
quote)  is  not  'reasonably  predictably'" - 

Wo  have  shown  in  Figure  1  that  for  a  medium-risk 
procurement,  the  actual  MTBF  must  be  at  least  85 
of  the  bid  MTBF  for  the  contractor  to  realize  a 
positive  return  on  sales  from  the  RXW  portion  on 
the  contract  —  an  accuracy  requirement  that 
appears  on  the  surface  to  be  well  outside  cur¬ 
rent  prediction  capabilities  for  a  typical  equip¬ 
ment  program.  However,  for  warranted  equipment, 
we  do  not  subscribe  to  this  conclusion  but  be¬ 
lieve  that  bid  MTBF  values  and  demonstrated 
MTBFs  will  be  much  closer  to  the  field  results 
than  has  been  possible  in  the  past. 

The  underlying  reason  for  this  belief  is  that 
under  a  warranty  a  contractor  must  place  great 
emphasis  on  the  operational  reliability  of  his 
deliverwi  equipment.  Reliability  prediction, 
test,  analysis,  and  demonstration  activities  will 
no  longer  be  performed  simply  because  the  govern¬ 
ment  dictates  them  for  government  purposes.  The 
manufacturing  process  will  be  more  closely  con¬ 
trolled  to  provide  the  maximum  reliability  in¬ 
herent  in  the  equipment.  For  example,  there  is 
evidence  that  because  of  a  warranty  coassitment, 
contractors  are  increasing  the  number  of  inspec¬ 
tion  stations,  establishing  higher  part-screening 
levels,  and  using  longer  burn-ins. 

Reference  5  provides  theoretical  support  that 
contractors  have  opportunity  and  strong  incen¬ 
tive  to  correct  reliability  problems  identified 


during  the  warranty  period,  and  experience  on  a 
number  of  programs  shows  that  the  incentive  is 
real  (10). 

Three  additional  factors  are  worth  noting: 

•  As  pointed  out  in  Reference  11,  the  govern¬ 
ment's  response  to  low  field  reliability  has 
historically  been  to  overspecify  in  hopes  of 
achieving  an  improvement,  which  usually 
causes  a  gap  between  predicted  or  demon¬ 
strated  MTBF  and  actual  field  MTBF .  If  cur¬ 
rent  warranties  arc  successful,  this  practice 
should  diminish  because  contractors  facing 

a  long-term  warranty  will  no  longer  auto¬ 
matically  respond  to  unrealistic  reliability 
requirements  and  the  government  will  no 
longer  have  to  resort  to  artificial  devices 
in  an  attempt  to  meet  minimum  goals. 

•  It  has  been  shown  in  a  number  of  studies  that 
a  significant  percentage  of  military  equip¬ 
ment  failures  are  maintenance-induced  or 
maintenance-related  (91.  Under  warranty, 
units  arc  usually  sealed  and  the  ar.iount  of 
military  maintenance  is  limited.  The  result 
is  a  much  lower  factor  for  military  mainte¬ 
nance  handling,  which  should  provide  better 
correlation  between  predictions  and  field 
performance. 

•  While  damage  due  to  mishandling  and  abuse  of 
warranted  equipment  may  not  differ  from  that 
for  nonwarranted  equipment,  the  failures  that 
result  from  such  causes  are  generally  ex¬ 
cluded  from  warranty  coverage.  Most 


predictions  and  demonstrations  do  not  account 
for  such  failures.  From  the  contractor's 
risK  viewpoint,  however,  the  predictions  will 
more  close! y  reflect  the  field  MTBF  asso¬ 
ciated  with  his  no-charge  repair  commitment 
than  earlier  predictions. 

To  support  these  conclusions,  it  is  noted  that 
for  four  equipments  under  warranty  for  which 
bid/and  field  MTBFs  are  available,  three  had 
field  MTBFs  higher  than  the  bid  values.  These 
four  programs  are  summarized  in  Table  3.  Data 
from  References  (0)  (9)  show  that  in  the  past 
only  20  of  111  equipments,  or  18  percent,  had 
MTBF  ratios  greater  than  1.0.  If  18  percent  is 
taken  as  a  population  value  for  previously  de¬ 
ployed  j itmenb,  theie  is  less  than  2  percent 
chance  thdt  the  four  warranted  equipments  have 
the  same  filin'  CO..;, liability  as  the  | opulation 
that  has  shown  unfavorable  MTBF  ratio-,  in  the 
past. 
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Of  course,  this  small  sample  car.not  be  taken  as 
final  evidence  that  contractors  under  warranty 
can  accurately  estimate  field  MTBF,  but  the  re¬ 
sults  are  encouraging.  One  fnrthe.  point  must 
be  made.  In  all  four  cases  the  contractor  has 
initiated  no-cost  iiCPo  to  overcome  some  unexpect¬ 
ed  field  reliability  problem.  Obviously,  if 
there  chang.  >  were  oxper.itivo  and  »f  the  toa’m  t 
prlcu  did- not  include  a  contingency  for  si.  h 
aiti-ai.  A-'-li : .  — y-T.— ii '  of  a  staled  MT11F  goal  * 
not  )).i*  uwni,  T..Jadit.  1  hat  i «•  1  pro!  it 

was  oars  ...  even  if  all  other  fnctoru  nuch  as 


repair  costs  and  fixed  costs  met  pricing  levels. 
There  are  no  data  on  profit  earned;  however, 
except  for  the  one  case  in  which  field  MTBF  was 
lower  than  expected,  there  is  no  evidence  that' 
contractor  profit  margins  on  the  warranty  were 
unacceptable.  However,  two  of  the  remaining 
three  programs  are  still  in  force;  therefore, 
na  firm  conclusions  are  possible  at  this  time. 


CONCLUSIONS  AND  RECOMMENDATIONS 


The  basic  conclusion  drawn  from  the  study  is 
that  a  military  warranty  can  be  structured  to 
share  r xsl -  e-eitably.  Further,  warranties 
provide  propel  .ucentives  to  reasonably  assure 
that  equipment  reliability  obiectives  will  bo 
met.  Achieved  I'.TBr  is  the  key  va  table  in 
detetmining  contractor  risk  under  wari-.nty. 
Quantitative  risk  models  and  early  experience 
indicate  that  equipment  MTBF  under  warranty 
can  be  controlled  to  provide  contractors  a 
reasonable  profit  expectation  and  that  in¬ 
creased  ri..k  of  Joss  is  balanced  to  some  extent 
by  the  greater  op£ortumty  for  profit  and  (per¬ 
haps  more  important)  by  long-term  benefits. 

These  benefits  include  product-line  growth, 
commercial  spin-offs,  and  follow-on  award 
opportunities.  However,  there  is  no  doubt 
time  if  a  contractor  falls  substantially  short 
of  the  desired  MTBF,  considerable  losses  might 
be  sustained,  especially  with  an  MTBF  guarantee. 

The  risk  analysis  approaches  developed  in  this  ' 
study  provide  a  simplified  method  for  assessing  \ 
contractor  risk.  Interviews  with  a  number  of 
RIV!  contractors  indicate  that  assessment  meth¬ 
ods  used  to  date  have  been  mostly  subjective, 
and  this  nay  have  increased  apprehensions  about 
risk. 

The  recommendations  encompass  three  areas:  DoD 
lolicy,  high-risk  areas,  and  further  research. 
Future  fob  guidelines  or  directives  should 
stress  (1)  that  all  warranties  must  be  individ¬ 
ually  tailored  to  mitigate  risks  to  both  par¬ 
ties,  (2)  that.  M.BF  requirements  must  be  real¬ 
istic  in  terms  of  what  is  actually  needed  and 
achievable,  (3)  that  equipment  development  pro¬ 
grams  mould  provide  adequate  time  and  money 
tor  reliability  testing  and  analyses,  and  (4) 
that  an  MTBF  guarantee  should  not  be  used  where 
considerable  new  or  improved  technology  is  to 
be  procured . 

With  regard  to  high-risk  cases,  two  courses  of 
action  are  suggested: 

•  Investigate  warranty  plans  with  some  form  of 
cost  sharing,  possibly  coupling  this  type  of 
plan  with  a  commitment  that  recognizes  relia¬ 
bility  Y«ow»ii  from  a  rls,.  (eduction  viewpoint 
f  4). 

•  :.i udy  in  g-catcr  detail  the  relationships 
b<:— .>n  r"l iabj  1  ity  predictions,  reliability 
dels-..  -< -li  - .  u  tus-i.  and  field  results. 


especially  for  warranty  programs.  Attempt  to 
develop  improved  assessment  methods  that  can 
be  used  to. estimate  expected  reliability 
under  warranty. 

Additional  research  recommendations  involve  con¬ 
tinued  monitoring  of  current  warranties  regard¬ 
ing  risk,  study  of  government  risk  aspects,  and 
development  of  an  approach  for  providing  posi¬ 
tive  incentives  that  balance  the  additional  risk 
of  an  MTBF  guarantee  provision. 

These  recommended  actions,  individually  or 
jointly,  should  assist  in  structuring  warranty 
programs  that  equitably  distribute  attendant 
risks. 
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A  NEW  LOOK  AT  WARRANTIES  IN  DEFENSE  CONTRACTS 

Arturo  Gandara  and  Micliael  D.  Rich 
The  Rand  Corporation  Santa  Monica,  California 


INTRODUCTION 


In  August  1974,  various  parts  of  the  Office  of 
the  Secretary  of  Defense  (OSD)  asked  the  three 
Military  services  to  begin  trial  uses  of  the 
Reliability  Improvement  Warranty  (RIW),  a  con¬ 
tractual  technique  aimed  at  improving  relia¬ 
bility  of  weapons  systems  and  reducing  their 
life-cycle  costs  |4).  Under  an  RIW,  a  contrac¬ 
tor  assumes  responsibility  on  a  fixed-price 
basis  for  repairing  or  replacing  (as  he  sees 
fit)  warranted  units  chat  fail  during  the  war¬ 
ranted  period.  (A  variation  combines  the  war¬ 
ranty  wltii  a  guarantee  that  obligates  the  con¬ 
tractor  to  take  whatever  steps  are  necessary 
to  meet  specific  reliability  levels.) 

Although  commercial  firms  have  abundant  exper¬ 
ience  with  product  warranties,  the  Department 
of  Defense  (DoD)  has  had  only  three  completed 
warranty  programs.  Its  current  warranty  activ¬ 
ities  are  substantial,  however.  The  Air  Force, 
which  is  the  lending  servlce~in  this  regard, 
has  17  items,  including  nine  F-16  components, 
under  a  form  of  RIW.  Depending  on  the  number 
of  options  exercised,  its  expenditure  for  war¬ 
ranty  coverage  could  reach  $65  million  (and 
the  value  of  the  items  purchased  under  warranty 
could  reach  $500  million).  Unfortunately,  data 
oh  the  outcomes  of  these  programs  will  not.be 
complete  until  the  early  1980s.  While  awaiting 
thc-.results,  we  have  explored  the  KXW  concept 
by  evaluating  commercial  analogs,  past  DoD 
warranty  experience,  and  the  current  trl- 
sorvlce  RIW  trial.* 


COMMERCIAL  WARRANTY  EXPERIENCE 


OSD's  decision  to  promote  RIWs  was  based  in 
part  on  a  hlgti  regard  for  commercial  warranty 
experience.  This  study  examined  warranties  in 
two  commercial  settings:  consumer  products 
and  airline  avionics. 

Consumer  product  warranties  have  usually  been 
either  promotional  or  protective — i.e.,  they 
have  cither  been  marketing  tools  or  devices  to 
limit  liability  (2|f5).  They  have  rarely  im¬ 
proved  product  quality.  Consumer  product  war¬ 
ranties  have  worked  so  poorly  that  the  Congress 
recently  empowered  the  Federal  Trade  Commission 
to  monitor  most  aspects  of  warranty  practices. 

T - 

Thin  paper  Is  based  on  the  authors'  report. 
Reliability  Irzimo-awnt  Warranties  for  Military 
Procurecant,  The  R.I.I.I  Corporation,  R-2264-A1, 
December  1977.  Views  expressed  In  this  paper 
are  nut  necessarily  shared  by  Rand  or  Us 
research  sponsor ,. 


Consumer  goods  warranty  experience  does  not 
justify  optimistic  expectations  for  RIWs,  at 
least  from  the  perspective  of  the  military 
services. 

Commercial  airline  avionics,  which  usually 
carry  warranties,  appear  at  first  sight  to  be 
generally  more  reliable  than  similar  equipment 
oseu  by  the  military.  However,  there  are  too 
many  differences  in  the  commercial  and  mili¬ 
tary  environments  to  credit  the  warranties 
with  being  the  major  cause  of  cocaercial 
products'  better  reliability.  These  differ¬ 
ences  extend  to  definitions,  operating  and 
support  environments,  missions  requirements, 
and  procedures  for  data  collection  and  reten¬ 
tion.  In  fa.:t,  the  effect  of  the  warranties 
is  not  well-understood  by  even  the  airlines; 
they  have  developed  no  standard  by  which. to 
measure  the  cost-benefit  derived  from  the  war- 
warranties  (l:B-4). 


PAST  DOD  WARRANTY  EXPERIENCE 


There  have  been  three  items  purchased-by  the 
military  services  under  RlW-like  warranties 
for  which  the  period  of  coverage  has  ended. 
This  section  discusses  those  procurements. 


The  Navy's  APN-154  Radar  Transponder 


The  APN-154  is  an  airborne  X-band  radar  trans¬ 
ponder— a  "beacon"--that  extends  the  range  of 
surface  radar,  allowing  identification  of 
specially  equipped  airborne  targets.  First 
produced  in  1965  by  United  Telecontrol,  it  has 
been  used  on  a  variety  of  fixed-wing  and 
rotary-wing  aircraft.  In  1973,  a  warranty 
went  into  effect  on  218  units.  Data  collected 
under  test  conditions  at  the  close  of  the  war¬ 
ranty  period  Indicated  that  the  mean  time 
between  failures  (MTEF)  had  increased  almost 
four-fold  from  the  pre-warranty  level  to  2025 
hours,  a  seemingly  striking  success  for  the 
warranty  application. 

There  is  no  evidence,  however,  to  link  the 
warranty  and  the  reliability  improvement.  In 
fact,  other  factors  more  readily  explain  the 
Improvement.  For  example,  before  the  war¬ 
ranty,  and  independent  of  it.  United  Tele¬ 
control  undertook  at  Its  own  Initiative  a 
corpnny-ful.ded  study  to  develop  longer-lived 
replacements  for  the  local  oscillator  >nd 
magnetron  assemblies.  These  two  thermionic 
assemblies,  produced  before  solid-state  de¬ 
vices  of  sufficient  reliability  were  afford¬ 
able,  were  the  major  causes  of  earlier  fail¬ 
ure.  The  study  produced  a  suitable  solid- 
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state  replacement  for  the  local  oscillator 
design,  requiring  only  minor  power  supply  mod¬ 
ification.  Although  the  search  for  c  solid 
state  magnetron  assembly  was  not  successful, 
the  contractor  discovered  that  the  magnetron's 
life  could  be  extended  by  redesigning  the 
existing  cathode  structure.  United  Telecontrol 
submitted  an  unsolicited  proposal  to  the  Navy 
to  substitute  the  solid-state  oscillator  and 
modify  the  magnetron.  When  the  changes  were 
negotiated  as  an  engineering  change  proposal 
to  the  existing  production  contract,  provisions 
for  warranty  coverage  were  added. 

In  addition,  several  other  changes  were  identi¬ 
fied  before  the  warranty  entered  the  picture. 
Many  of  the  earlier  equipment  failures  were 
environmentally  related.  For  example,  in  one 
case,  the  transponder  was  mounted  adjacent  to 
the  jet  exhaust  tail  cone.  During  normal 
flight  and  ground  operation,  the  equipment  tem¬ 
perature  was  maintained  well  within  its  limit, 
but  in  extended  jet  engine  ground  operation,  as 
might  occur  during  engine  test  or  a  prolonged 
taxi  situation,  the  equfpaent  temperature  would 
rise  more  than  30*C  above  the  mnxlnum  limit, 
causing  equipment  failure.  Design  changes  in 
the  heat  sink  and  new  component  part  selections 
provided  satisfactory  operation  at  the  higher 
temperature  and  contributed  to  an  unspecified 
increase  in  MTBF. 

To  the  extent  that  the  reliability  improvement 
is  traceable  to  such  piv-varranty  redesign  and 
externally  generated  component  technology  ad¬ 
vances,  the  warranty  appears  simply  to  have 
tome  along  in  time  to  receive  the  credit. 


The  Navy's  2171  Gyroscope 

The  2171  gyroscope  (the  contractor's  nomencla¬ 
ture)  was  initially. designed  and  produced  by 
Lear  Siegler' in  the  1950s  and  was  Introduced 
Into  service  with  A -4  Skyhawks  and  F-4  Phantoms 
In  the  early  1960s.  By  1967,  there  were  about 
3200  units,  of  various  configurations,  in  the 
inventory.  Using  the  data  and  experience 
gained  during  its  maintenance  of  the  gyro,  hear 
Siegler  proposed  a  warranty  for  800  of  the  3200 
fielded  gyros.  MTBF  was  expected  to  improve  30 
percent,  but  a  third  of  the  increase  was  expec¬ 
ted  to  result  merely  from  updating  the  800 
units  to  the  most  reliable  configuration  then 
in  the  field.  The  results  were  favorable:  The 
MTBF  of  the  warranted  gyros  Improved  frem  400 
to  520  operating  hours  in  three  years  (the  MTBF 
of  the  non-varranted  gyros  improved  to  442 
ho^irs  during  the  same  period). 

Although  some  of  the  difference  between  the 
MTBFs  of  the  warranted  and  ron-warranted  sub- 
populatlons  cannot  be  attributed  to  the  warranty 
(that  part  due  to  updating  to  the  most  reliable 
configuration),  it  would  be  unfair  not  to  regard 
the  warranty  as  a  contributing  factor.  Two 
things  must  be  considered,  however,  before 


generalizing  from  these  results.  First,  the 
activities  the:,  probably  led  directly  to  the 
reliability  improvement  could  have  been  promot¬ 
ed  without  the  warranty.  In  this  instance, 

Lear  Siegler  conducted  a  continuous  test  pro¬ 
gram,  using  laboratory  units,  which  accounted 
for  50,000  hours  of  testing  and  provided  data 
for  corrective  design  change  decisions. 

Second,  whether  the  warranty  approach  saved  Che 
Navy  money  is  also  uncertain.  A  study  prepared 
for  the  Naval  Air  Systems  Command  found  that 
after  a  two-month  contract  extension  designed 
to  compensate  for  underutilization  during  the 
basic  warranty  period,  the  warianty  costs  were 
less  than  the  probable  costs  of  support  without 
a  warranty  [1:31-32,  App.  A).  Independent  re¬ 
calculations  by  Rar.d  revealed  the  differential 
to  be  much  less  than  the  Navy's  calculation:  In 
fact,  after  the  period  extension  the  warranty 
costs  very  slightly  exceeded  Lhc  predicted 
costs  of  the  non-warranty  nltumncive  (3:48). 
This  difference  is  probably  offset  by  the  sav¬ 
ings  from  reduced  spares  requirements  made 
possible  by  the  higher  MTBF  levels  of  the  war¬ 
ranted  units  (about  23  percent  fewer  spares  in 
the  case  of  the  2171  gyro  warranty  population), 
whatever  the  cause,  and  by  the  greater 
operational  readiness  rates  themselves. 


The  Air  Force's  F-lll  Cyroscope 

The  F-lll  gyroscope  was  originally  designed  in 
the  early  1960s  by  General  Electric  specifical¬ 
ly  for  uae  In  the  F-lll.  The  first  534  units 
produced  by  General  Electric  experienced  disap¬ 
pointingly  low  reliability,  which  prompted  the 
Air  Force  to  call  for  a  new  procurement  In  a 
competitive  environment.  The  new  contract,  wen 
by  Lear  Siegler  in  January  1969,  contained  a 
warranty  provision.  The  MTBF  of  the  warranted 
gyros  peaked  at  1214  operating  hours,  but  later 
fell  to  995  hours.  The  non-warranled  gyros, 
which  hsd  sn  MTBF  of  681  hours  in  1968, 
achieved  an  MTBF  of  749  hours. 

The  differences  In  reliability  levels  c„nnot  be 
traced  to  the  warranty.  Lear  Siegler  incorpo¬ 
rated  no  najor  design  changes  during  the  war¬ 
ranty  period.*  Several  factors,  ocher  titan 
measurement  Imprecision,  may  have  accounted  for 
the  difference.  The  warranted  units  were  pro¬ 
duced  by  a  new  manufacturer  at  n  later  date  and 
as  a  result  of  a  competitive  source  selection: 
these  changes  may  themselves  have  improved 
reliability.  In  addition,  there  was  extensive 
additional  failure  m'de  testing  conducted  be¬ 
fore  the  warranty  period.  As  in  the  2171  g)ro 
program,  this  augmented  test  regimen  could  be 
duplicated  even  without  a  warranty. 


2 Lear  Siegler  did  make  one  minor  change: 
incorporation  of  a  new  bearing  actuation  to 
correct  a  directional  gyro  drift  problem. 
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When  the  cosl  implications  of  the  F-lll  gyro 
warranty  program  are  considered,  two  circum¬ 
stances  must  be  kept  in  mind: 

o  The  initial  plans  called  for  the  pur- 
*cli3se  of  601  warranted  units.  The 
initial  contract  was  influenced  by  cut¬ 
backs  in  the  F-lll  program  and  called 
for  only  332  units.  Additional  revi¬ 
sions  reduced  the  number  to  128. 

o  When  the  warranty  period  ended,  the 
operating  hours  of  the  warranted  units 
were  about  half  the  expected  amount. 

The  underutilization  was  due  to  recur¬ 
rent  groundings  of  the  F-lll  fleet  and 
frequent  delays  in  Installations  of  the 
gyros.  The  warranty  period  began  when 
tlie  gyros  .‘ere  d&livcred  to  the  Air 
Force;  the  F-lll  prime  contractor, 
General  Dynamics,  often  Installed  them 
six  months  later. 

The  combination  of  these  events  had  two  impor¬ 
tant  results.  First,  ultimate  cost  per  opera¬ 
ting  hour  of  the  warranty  coverage  was  very 
high.  Later  contracts  have  used  special  price 
adjustment  provisions  to  address  this  problem. 
A  rare  troublesome  result,  one  not  addressed 
by  new  contractual  clauses,  is  the  deleterious 
effect  on  the  contractor's  motivation  tc  make 
changes.  The  few  units  in  the  field  and  the 
low  rate  at  which  they  wore  used  meant  that  a 
representative  failure  distribution  was  not 
achieved  until  the  warranty  period  was  80  per¬ 
cent  complete.  Lear  Slegler  justifiably  chose 
not  to  make  any  investments  in  engineering  im¬ 
provement:  Its  remaining  period  of  responsi¬ 
bility  for  the  reliability  of  its  gyros  was 
not  very  long,  and  the  prospect  for  recoupment 
of  its  inver'.cent  wns  reduced  by  the  small 
number  of  units  In  Che  field. 


Lessons  from  the  Programs 

Although  examination  of  completed  DoD  warranty 
programs  does  not  reveal  conclusive  evidence 
that  the  warranty  was  a  major  factor  in  the 
observed  improvement,  it  does  permit  the 
following  observations: 

o  Modification  aft  *  some  operational  use 
or  appropriate  operational  testing  is 
almost  always  desirable  to  take  advan¬ 
tage  of  field  experience  and  advances  in 
component  state  of  the  art  and  can  be 
promoted  without  a  warranty. 

o  Implied  In  the  above  statement  Is  the 
worth  of  schedule  flexibility  to  allow 
incorporation  of  test  data  In  the  subse¬ 
quent  development  and  production  pro- 
ceso. 

o  To  the  «xient  that  modification  Is  envi¬ 
sioned  «ir  desired,  the  contractor  should 
be  Involved  Jn  the  initial  overhaul  and 


repair  activities  to  improve  his  ability 
to  formulate  product  improvements. 

o  Because  the  prospect  for  reliability 
growth  is  dimmed  by  program  quantity 
reduction  and  underutilizations,  RIKs 
should  not  be  applied  to  programs  sub¬ 
ject  to  extreme  quantity  or  utilization 
uncertainty. 


FINAL  OBSERVATIONS: 

THE  CURRENT  TRIAL  APPLICATIONS 


Several  osptvs  of  current  trial  applications 
diminish  the  likelihood  that  they  will  yield 
conclusive  evidence  on  the  value  of  RIWs.  Be¬ 
cause  an  RIW  is  a  collection  of  c.  iplex  con¬ 
tractual  terms,  such  an  experiment  can  Identify 
preferred  contractual  constructions.  This 
opportunity  may  be  lost  if,  as  in  the  case  of 
the  present  set  of  contracts.  Important  terms 
and  penalties  vary  widely  and  not  in  accordance 
with  a  conscious  plan  for  evaluation  (3:11-28). 
Two  other  facts  make  the  variation  of  terms 
disturbing:  the  absence  of  adequate  "control” 
groups  and  conditions  and  the  continued  consid¬ 
eration  of  new  applications.  The  design  of 
the  experiment  should  be  improved  by  at  least 
three  actions: 

o  Reduce  the  variation  in  contractual 
tains  and  penalties.  A  first  step  is 
the  careful  development  of  hypotheses 
about  desirable  constructions  so  that 
vat inti  ns  can  be  consciously  and  sys¬ 
tematically  devised  to  test  them. 

o  Develop  better  control  conditions.  The 
sane  difficulty  in  isolating  the  war¬ 
ranty  as  the  cause  of  the  reliability 
Improvement  in  the  completed  DoD  pro¬ 
grams  is  likely  to  plague  the  analysis 
of  current  programs. 

o  Sound  the  experiment.  Rather  than  be¬ 
ginning  new  trial  warranty  programs  for 
an  indefinite  period,  the  experiment, 
which  has  a  discernible  birthdattr, 
should  have  a  finite  number  of  trial 
programs.  This  would  permit  better 
assessment  of  Interim  data  and  prompt 
final  evaluation. 

The  experiment  is  also  hampered  by  deficiencies 
in  a  number  of  associated  methodologies.  For 
example,  both  che  contractor  and  the  services 
have  limited  ability  to  price  warranty  and 
non-warranty  alternatives  Jn  confidence. 

Methods  for  reliability  measurement  and  pre¬ 
diction  are  similarly  Imprecise.  Improvements 
in  these  areas  would  enhance  selection,  moni¬ 
toring,  and  evaluation  of  warranty  programs. 

Evaluation  of  the  warranty  concept  will  be 
further  complicated  by  the  multiple,  indepen¬ 
dent  objectives  that  an  RIW  can  serve  and  the 


failure  to  establish  priority  among  them. 

These  objectives  include: 

o  Ile.Habil.itij  improvement.  This  objective 
is  attained  if  the  contractor  is  motiva¬ 
ted  to  change  his  behavior  so  that  the 
item  he  produces  is  more  reliable. 

o  Life-cycle  cost  reduction  (cost  shift¬ 
ing).  This  objective  is  attained  if  the 
service  "makes  a  good  deal" — i.e.,  if 
the  price  of  the  warranty  coverage  is 
less  titan  the  price  of  alternative 
logistics  support  arrangements  and  if 
the  warranty  dees  not  cause  Increases  in 
acquisition  cost  or  support  cost  after 
the  warranty  period  (or  during  transi¬ 
tion  out  of  it). 

o  Insurance  (risk  shifting).  This  objec¬ 
tive  is  attained  if  the  service  and  the 
contractor  execute  a  binding  indemnifi¬ 
cation  contract,  enforceable  in  court. 

Any  one  of  these  objectives  can  be  attained 
without  either  of  the  others.  That  is  (assum¬ 
ing  the  ability  to  establish  cause  and  effect), 
a  warranty  might  induce  reliability  improvement 
but  increase  life-cycle  cost;  or  it  might  re¬ 
duce  life-cycle  cost  but  have  no  effect  on 
reliability;  or  it  might  fail  either  to  reduce 
life-cycle  cost  or  improve  reliability  but 
might  be  binding  on  the  contractor  to  provide 
interim  product  support.  The  Department  of 
Defense  must  agree  on  the  priority  of  these 
objectives  to  create  a  framework  for  evaluating 
RIW  data  and  formulating  RIW  policy. 


(5)  Udell,  J.  G.  and  E.  E.  Anderson,  "The 

Product  Warranty  as  an  Element  of  Compet¬ 
itive  Strategy,"  Jouimal  of  Marketing, 

Vol .  32,  October  1968,  pp.  1-8. 
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USAK  TEST  OF  RELIABILITY  IMPROVEMENT  WARRANTIES 


David  G.  Newman,  Directorate  of  Procurement  Policy 
Headquarters  USAF 


INTRODUCTION 

The  Air  Force  is  dedicated  to  improved  military 
readiness  and  reduced  Life  Cycle  Costs  for  its 
weapon  systems  and  equipment.  Reliability  Im¬ 
provement  Warranty  (RIW),  under  trial  use  in 
DOD,  promises  to  both  improve  equipment  readi¬ 
ness  and  drive  down  Life  Cycle  Costs.  RIW 
establishes  supplier  responsibility  for  opera¬ 
tional  or  "field"  reliability,  and  raaintaln- 
ablli.v  of  equipment.  Its  purpose  is  to  moti¬ 
vate  conir„  'to™  to  design  and  produce  equip¬ 
ment  with  1  a  .a.  ere  rates  and  low  repair 
costs  in  operational  use.  !*■  uses  the  Inherent 
incentives  of  a  fixed  price  eontract  to  harness 
the  profit  motive  to  bring  about  reliability 
growth  and  reduced  repair  costs  during  the  long 
term  warranty  period. 

The  Air  Force  has  made  a  major  financial  com¬ 
mitment  to  the  RIW  test.  This  paper  provides 
an  overview  >f  the  Air  Force  RIW  program  from 
a  policy  perspective,  it  includes  a  brie 
summary  of  each  major  application  of  RIW  within 
the  Air  Force.  The  paper  highlights  the  exper¬ 
ience  and  lessons  learned  about  RIW.  It  summa¬ 
rizes  the  results  achieved  with  RIW  and  where 
increased  emphasis  is  needed  to  bring  the  RIW 
trial  to  a  successful  conclusion. 

The.  views  expressed  herein  ate  strictly  those 
of  the  nuthoi  and  do  not  necessarily  represent 
the  views  of  the  U.S.  Air  Force. 

AIR  FORCE  POLICY 

One  of  the  acquisition  techniques  which  has 
been  developed  under  the  Life  Cycle  Cost  policy 
umbrella  is  Che  RIW.  The  need  to  buy 
"affordable"  -llltjry  systems  has  been  recog¬ 
nized  and  is  being  institutionalized  in  the 
Air  Force.  Tno  Air  Force  is  making  a  concerted 
effort  to  reduce  tosts,  both  acquisition  and 
Operation  and  Support  (O&S)  costs.  The  Air 
For.e  is  also  intent  on  improving  reliability 
to  enhance  military  read'  ess.  The  focus  of 
RIW  is  on  both  Improve  ^liability  and  reduced 
Life  Cycle  Coot  with  pa.  leular  emphasis  on 
downstream  OSS  Costs. 

The  Air  Force  defines  RIW  as  a  provision  in  a 
fixed-price  acquisition  contract  In  which  for 
a  ffxed  price,  (I)  the  contractor  is  provided 
with  the  monetary  incentive  to  loprovc  the  pro¬ 
duction  des ign  and  engineering  of  the  equipment 
throughout  tfie  period  of  the  warranty  to  en¬ 
hance  the  Cidd/operatlonal  reliability  and 
nuiintainabll ity  of  the  systcm/cquipment;  and 
(2)  the  contractor  agrees  to  repair  or  replace 
(within  a  specified  turnaround  time)  all  equip¬ 
ment  that  fall  (subject  to  specified 
exclusions  If  applicable)  during  the  period  of 
the  warranty. 


The  objective  of  an  RIW  is  to  motivate  and  pro¬ 
vide  an  incentive  to  contractors  to  design  and 
produce  equipment  which  will  have  a  low  fail¬ 
ure  race  as  well  as  low  repair  costs  after 
failure  due  to  field/operational  use. 

Wlille  there  Is  logistics  support  associated 
with  RIW,  it  is  not  u9ed  as  a  maintenance  con¬ 
tract.  Its  thrust  is  directed  toward  rcll- 
1  lev  improvement  in  the  form  of  increased 
inherent  r<_;  '-lllty  for  the  hardware  and  reli¬ 
ability  growth  alter  Che  equipment  is  placed 
Into  operation  in  the  field. 

Based  upon  field  experience  and  discussions 
with  contractor  peop)  .,  we  conclude  that 
supplier  concerns  about  field  reliability  have 
often  been  rhetorical.  The  traditional  goal 
under  Government'  contract  has  been  Government 
acceptanc  i.e.,  Government  assumption  of 
ownership  of  work  tendered  in  performance  of 
ae  contract.  The  act  of  acceptance  transfers 
che  risk  to  the  Government.  Unless  reserved 
by  a  warranty  or  a  certificate  of  conformance, 
the  Government's  right  to  reject  after  accep¬ 
tance  is  limited  exclusively  to  instances  of 
latent  defects,  fraud,  or  gross  mistakes 
amounting  to  fraud.  Contractors  have  focused 
on  passing  required  qualification  demonstra¬ 
tions  and  production  acceptance  tests  rather 
than  good  field  performance.  In  addition, 
follow-on  contracts  for  spares,  service  con¬ 
tracts  and  replacement  parts  to  provide 
necessary  operational  support  afford  an  oppor¬ 
tunity  through  reduced  reliability  to  increase 
sales  to  DOD. 

ECONOMIC  CONSIDERATIONS 

RIW  Is  intended  to  require  contractors  to 
share  some  degree  of  financial  responsiblity 
for  field  performance  of  their  equipment.  In 
this  regard,  Figure  1  depicts  the  inherent 
Incentives  of  a  fixed  price  contract  without 
RXW  while  Figure  2  shows  the  inherent  Incen¬ 
tives  of  the  same  contract  with  an  added  RIW 
provision.  Under  a  fixed  price  contract  with¬ 
out  RIW,  a  contractor,  in  theory,  will  maxi¬ 
mize  his  profits  'ellvering  equipment  with  the 
lowest  reliability  that  the  Government  ylll 
accept.  The  contractor  has  an  Inherent  incen¬ 
tive  to  take  actions  to  reduce  production 
costs.  Examples  of  cost  reduction  efforts  in¬ 
clude  the  elimination  of  certain  in-process 
testing,  speed  up,  of  the  assembly  process,  and 
elimination  of  high  reliability  piece  parts. 
Unfortunately,  these  actions  may  degrade  the 
reliability  of  che  product.  Different  Incen¬ 
tives  arc  at  work  under  RIW.  The  *  factor 
takes  on  the  obligation  to  repair  or  replace 
till  items  that  fall  during  the  extended  period 
of  the  warranty  at  a  fixed  price  established 


prior  to  commencement  of  th«  warranty  period. 
Since  the  contractor  hay  both  a  contractual  ob¬ 
ligation  to  produce  the  equipment  and  a  con¬ 
tractual  obligation  to  support,  the  equipment 
during  operation,  Ideally,  he  will  be  motivated 
to  increase  reliability  to  reduce  his  overall 
costs.  In  addition,  subjecting  an  emerging 
system  to  a  "tcst-analyze-and-f lx"  (TAF) 
process  has  proved  to  be  a, basic  mechanism  for 
achieving  reliability  growth.  The  RIW  concept 
embodies  this  TAF  concept. 

RIW  may  be  used  to  obtain  a  guaranteed  Mean- 
Time-Detween-Failure  (MTBF).  This  feature 
serves  as  both  an  additional  incentive  to 
assure  that  a  specified  operational  MTBF  is 
achieved  and  as  protection  or  "insurance" 
against  short  term  asset  shortages.  An  MTBF 
guarantee  puts  "teeth"  into  the  RIW  provision. 
Air  Force  applications  which  Include  the  MTBF 
guarantee(s)  require  the  contractor  to  provide 
consignment  spares  in  the  event  of  a  low  MTBF 
to  prevent  shortages  of  assets  in  the  Air  Force 
logistics  system  which  result  from  the  low 
MTBF.  The  MTBF  guarantee  feature  also  requires 
the  contractor  to  perform  engineering  analysis 
of  failed  items  and  to  make  design  changes 
required  to  achieve  stated  MTBF  values.  In 
the  event  that  the  low  MTBF  is  not  corrected  at 
the  end  of  the  warranty  period,  the  consignment 
spares  become  Government  property  at  no  addi¬ 
tional  cose  to  the  Government. 

An  RIW  may  also  Include  a  guaranteed  turnaround 
time  (TAT).  This  feature  provides  an  addition¬ 
al  incentive  to  ensure  prompt  processing  of 
failed  units. 

It  is  important  to  note  that  the  Air  Force 
approach  In  employing  RIW  and  the  MTBF  guaran¬ 
tee,  while  resulting  in  a  risk  transfer  from 
the  Air  Force  to  its  RIW  contractor,  is  intend¬ 
ed  to  motivate  contractors  to  deliver  equipment 
with  a  higher,  inherent  reliability  than  would 
otherwise  have  been  provided.  In  addition, 

RIW  provldea  a  mechanism  for  achieving  reli¬ 
ability  growth.  The  interim  results  of  apply¬ 
ing  RIW  include  both  a  contractor  behavorial 
incentive  and  a  *'isk  transfer.  The  end  results 
are  intended  to  be  both  enhanced  readiness  and 
reduced  Life  Cycle  Coats  through  improved  reli¬ 
ability. 


STATUS  OF  AIP.  FORCE  APPLICATION  OF  RIW 


The  Air  Force  has  made  a. major  commitment  to 
the  RIW  trial  by  applying  RIW  to  9  programs 
with  a  total  RIW  cost  of  about  $65  million.  It 
has  been  used  on  hardware  costing  about  $500 
million.  Those  equipments  covered  by  RIW  are 
installed  in  both  combat  and  support  aircraft 
deployed  worldwide. 

Figure  3  lists  both  the  "major"  and  "less  than 
major"  Air  Force  applications  of  RIW.  The 


largest  mul  most  complex  RIW  appl  li  oi  ion  Is 
for  equipment  on  the  F-lh  Lightweight  Fighter 
covered  by  RIW.  The  K  —  I (>  warrant  y  lommeneoti 
In  January  1979  and  will  cover  nine  equipments 
on  250  UKAF  fighters  and  I**.'  hmopean  fight  era 
for  a  period  of  4  years  oi  ,100, OUt)  flying 
hours. 

The  second  largest  Air  Force  application  of 
RIW  is  the  ARN-1 18  TACAN,  an  airborne  radio, 
used  in  navigation.  Tills  navigation  set 
will  ultimately  be  installed  in  about  85%  of 
the  Air  Force  fleet  of  combat  and  support  air¬ 
craft.  The  warranty  commenced  in  April  1976 
and  will  end  in  March  1982.  We  have  already 
seen  sizable  benefits  from  the  ARN-118  TACAN, 
l.c.,  drastically  reduced  support  costs  and 
outstanding  reliability  growth. 

The  initial  Operational  Test  and  Evaluation 
for  the  ARN-118  TACAN  was  completed  in  April 
1976.  The  test  program  included  more  than  50 
equipments  divided  among  three  bases  and  four 
aircraft,  namely,  the  T-38,  B-5Z,  KC'-llS,  and 
F—  1 11.  The  achieved  level  varied  fiom  2?,1 
hours  MTBF  on  the  T-38  to  £88  hours  MTBF  on 
the  B-52/KC-135  with  a  composite  reliability 
of  324  hours.  This  inherent  reliability  of 
the  hardware  is  attributed,  in  part,  to  the 
RIW/MTBF  guarantee.  However,  it  is  difficult 
to  isolate  and  quantify  that  inherent  reli¬ 
ability  associated  solely  with  the  RIW/MTBF 
arrangement.  It  is  likely  that  the  field 
reliability  of  the  TACAN  would  have  been  about 
325  hours  MTBF  undet  the  usual  DoD  practice 
of  assuming  all  financial  rosponsisi llty  for 
field  performance  after  acceptance  of  the 
hardware.  Some  twenty  months  after  completion 
of  I0T&E,  the  composite  reliability  has  ex¬ 
ceeded  1900  hours,  i.e.,  a  reliability  growth 
of  almost  1600  hours  of  field  reliability 
Improvement.  Based  upon  discussions  with 
people  actually  involved  in  the  management  of 
the  ARN-118  TACAN  program,  it  appears  that 
this  reliability  growth  is  directly  attributed 
to  the  RIW/MTBF  guarantee. 

Under  the  ARN-118  TACAN,  the  real  incentives 
and  workable  mechanisms  to  grow  real  (field) 
reliability  are  being  observed.  For  example, 
the  Contractor  has  established  a  failure  re¬ 
currence  control  program  for  the  TACAN  which 
Includes  the  following  elements: 

Extended  Burn-In  for  new  equipment. 

Burn-In  returned  equipment  subsequent 

to  repair. 

Special  Isolated  part  testing. 

Special  parts  screening,  i.e.,  visual, 

electrical  or  mechanical. 

Corrective  action  at  source  of  piece 

parts. 
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Selective  use  high  reliability  parts. 

Development  of  alternative  sources  of 
parts  where  expedient. 

Identification  of  end  equipment  shipped 
with  questionable  parts  and  replace 
questionable  parts  on  an  attrition 
basLs. 

Review  of  design  and  where  appropriate 
redesign  circuits  to  remove  critical 
characteristics. 

It-  has  been  reported  by  contractor  personnel 
that  RIW  has  given  them  their  first  real  op¬ 
portunity,  under  a  military  contract, to  deter¬ 
mine  for  then .  !v,  ■  the  effect  the  total  oper¬ 
ating  environment  has  on  their  product.  They 
ate  now  able  to  verify  chat  field  reliabi¬ 
lity  growth  can  be  made  to  occur. 

Under  the  TACAN  RIW  program,  the  contractor 
has  Identified  the  following  lessons  learned: 

Address  and  follow  through  on  Reliabi¬ 
lity  Critical  Items  will  result  in 
Improved  field  MTBFs . 

A  computerized  failure  data  system  is 
vital  to  timely  recognition  and  correc¬ 
tion  of  reliability  problems. 

A  high  degree  of  failure  analysis  cap¬ 
ability  at  the  contractor's  facilities 
is  essential  for  reliability  improve¬ 
ment  . 

Close  coordination  among  all  disci¬ 
plines  at  the  contractor's  facilities 
Is  required  to  resolve  reliability 
problems. 

Sell- Imposed  testing  such  as  Burn-In 
and  Evaluation  Sample  Testing  is  need¬ 
ed  to  promote  field  reliability  growth. 

Another  major  Air  Force  application  of  RIW  is 
the  CorouscllV  Iner.tial  Navigation  System 
(INS).  The  program  contemplates  installation 
of  a  dual  INS  set  on  the  C-141  fleet,  a  single 
set  on  the  XC-135  and  a  t'  >le  installation  on 
the  C-5  fleet.  The  need  or  a  new  INS  evolved 
from  an  International  Civil  Aviation  Organiza¬ 
tion  requirement  that  all  aircraft  flying  in 
the  North  Atlantic  corridor  be  equipped- with 
navigation  equipment  of  accepted  accuracy  to 
meet  reduced  air  lanes.  The  INS  being-pro¬ 
cured,  the  Carousel  IV,  ha3  been  widely  used 
in  the  commercial  747  aircraft  and  is  covered 
by  a  .-.ommerelnl  warranty  similar  to  RIW.  The 
contractor  guaranteed  an  excellent  reliability 
of  11  "8  hours,  Hu.in-Time-Bctwcen-Fanurc,  at  a 
warranty  com  which  equates  to  about  $1.41  per 
iiynl  cm  opera:  lug  bourn.  This  support  coat  com¬ 
pares  very  favorably  lo  approximately  $10  per 
flylug  hour  lor  oilier  Inertial  navigation 


systems  in  UBe  in  the  Air  Force. 

The  other  two  major  applications  of  RIW  in¬ 
clude  the  C-141  Altitude  and  Heading  Refer¬ 
ence  System,  (a  third  source  of  navigational 
Inputs  on  the  C-141)  and  a  C-130  OMECA  Naviga¬ 
tional  act  which  will  be  installed  on  the  en¬ 
tire  C-130  fleet.  The  other  4  program  using 
RIW  are  categorized  as  "less  than  major"  since 
the  RIW  price  is  less  than  $1M. 

A  considerable  amount  of  information  is  avail¬ 
able  for  one  of  the  "le88  than  major"  appli¬ 
cations,  namely,  the  F-lll  Displacement  Gyro. 
This  program  Involved  a  multi-year  buy  of  332 
gyros,  however ,  only  128  unita  were  actually 
procured .  The  contract  did  not  contain  MTBF 
or  TAT  guarantees.  Results  include: 

The  contractor  made  ten  reliability  and 
maintainability  (RilM)  design  changes  in  the 
Cyro  prior  to  and  during  production.  These 
changes  are  directly  attributable  to  the  RIW 
provision.  With  those  R&M  Improvements,  It  is 
believed  that  the  RIW  provided  greater  reli¬ 
ability  than  would  have  been  obtained  without 
the  RIW. 

The  reliability  decreased  from  approxi¬ 
mately  1200  hours  MTBF  to  approximately  1000 
hours  at  the  end  of  the  warranty.  No  Reli¬ 
ability  and  Maintainability  design  improve¬ 
ments  were  made  after  delivery  of  the  hardware. 
Reasons  for  the  reduced  reliability  are  unkno-.-n. 

Specified  Turnaround  Time  of  45  days 
was  not  met.  The  actual  TAT  for  the  warranty 
period  averaged  90  days. 


LESSONS  LEARNED 


A  considerable  amount  of  experience  and  lessons 
learned  have  been  gained  during  the  last 
three  years  about  RIW  Acquisition.  Additional 
experience  and  lessons  learned  are  now  being 
gained  on  RIW  Administration.  We  expect  to 
obtain  significant  teat  data  from  both  major 
and  "less  than  major"  applications  of  RIW.  It 
is  Important  to  note,  however,  that  our 
warranty  performance  experience  is  limited.  A 
great  deal  of  this  Information  will  become 
available  during  the  next  three-years.  How¬ 
ever,  we  have  gained  enough  experience  to  know 
that  RIW  and  its  application  impacts  far 
greater  than  originally  expected. 

Application  of  an  RIW  on  a  contract  inherently 
Implies  that  a  tremendous  amount  of  research, 
coordination,  and  soul  searching  has  been  done 
by  both  the  contractor  and  the  government.  The 
contractor  must  understand  what  the  government 
wants  and  be  able  to  confidfct..  ly  assess  the 
risks  Involved  to  respond  with  RIW  pr  -osals. 
The  government  must  first  define  what  it  wants 
the  RIW  lo  achieve,  l.c.,  higher  reliability 
.uni /or  Inner  life  cycle  cost.  Once  this  Is 
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done,  Impacts  on  the  overall  maintenance  con¬ 
cept,  manpower,  data  systems,  and  administra¬ 
tion  of  the  contract  must  be  determined.  Un¬ 
fortunately,  this  is  the  area  where  we  arc 
discovering  that  we  have  major  difficulties  in 
Implementation. 

Implementation  of  an  RIW  automatically  estab¬ 
lishes  the  logistic  concept  (le.vels  of  main¬ 
tenance,  spares  stockage,  etc.)at  least  during 
the  period  chat  the  RIW  is  in  effect,  i.e., 
organizational  (remove  and  replace)  and  depot 
(contractor).  Most  RIM  applications  today 
state  the  Air  Force  desire  to  switch  to  an  or¬ 
ganic  (In-house)  maintenance  capability  at  the 
termination  of  the  RIM  period.  This  concept 
requires  early  planning  and  coordination  to 
insure  that  the  manpower,  support  equipment, 
spare  parts,  training,  and  technical  data  is 
available  to  make  this  change.  As  we  bring  in 
the  function'll  staffs  that  manage  these  areas, 
more  and  more  questions  surface,  indicating 
that  RIU  is  not  as  easy  to  apply  and  admin¬ 
ister  as  originally  thought.  Presumably,  we 
have  always  done  all  the  necessary  advanced 
planning  and  coordination  required  in  all  our 
past  acquisition  programs.  Thu  RIM  has  just 
highlighted  the  fact  that  maybe  there  are  more 
interested  players  or  more  players  who  should 
be  interested  and  brought  in  early  in  the 
conceptual  3tage  of  the  acquisition  process  to 
assure  a  smooth,  cost  effective,  reliable  in¬ 
troduction  of  a  new- system  into  our  operation¬ 
al  inventory. 

The  most  challenging  phase  of  our  RIM  exper¬ 
ience  is  in  i he  administration.  The  magnitude 
of  this  task  was  underestimated  when  RIW  was 
being  develop* d  in  the  Air  Force  in  Che  1973- 
1975  period  or  time.  RIW  demands  a  management 
organization,  data,  and  an  educated  population 
of  Air  Force  personnel  who  arc  Involved  in  the 
dally  processing  of  warranted  components. 

We  have  lonined  of  the  importance  of  an 
effective  warranty  reporting  system.  RIW  re¬ 
quires  a  lot  of  data  on  the  part  of  both  the 
contractor  and  the  USAF  if  it  is  to  be  effec¬ 
tively  managed  and  evaluated.  The  data  re¬ 
quirement;,  become  even  more  complex  because 
each  RIW  program  Is  unique,  calling  for  slight¬ 
ly  different  approaches.  Component  serial 
numb"r  font  ml,  extensive  use  of  Elasped  Time 
Indicators  (Eli),  remove  and  Install  dates  and 
test  data  findings  seem  to  bo  the  basic  common 
denominator  to  measure  the  performance  and 
guarantee  commitments.  We  arc  conditioned  to 
the  fact  that  we  must  pay  the  contractor  for 
data.  However,  there  is  a  growing  cadre  of 
influential  people  within  the  Air  Force  who  are 
concerned  that,  we  have  already  overburdened  our 
technicians  with  data  collection  requirements, 
to  the  point  where  elimination  of  data  Is  now 
a  major  movement.  RIW*  and  Its  requirements, 

Is  running  head  on  into  tills  movement  with  the 
uitimnte  possibility  that  we  may  not  be  able  Co 
proporLy  support  or  evaluate  it.  Changes  to 
existing  data  systems  and  procedural  directives 


needed  to  Support  RIW  hnv  •  been  -.low  In  coming 
or,  In  some  cases,  t e layc.l .  This  Is  not  to 
say  that  some  progress  has  not  been  made. 

Field  failure  notificel ‘on  Co  the  contractor 
is  being  written  inti  our  RIW  programs  to  In¬ 
sure  prompt  release  of  a  servl,  cable  replace¬ 
ment  back  to  the  field.  Tills  *  ■.  done  Co  hold 
down  tlie  number  of  spares  in  tho  pipeline  and 
thus  reduce  costs.  Originally,  manual  prepar¬ 
ation  of  the  message  by  base  personnel  was 
the  method  employed  to  satisfy  the  rtqti  l  foment. 
However,  we  quickly  learned  that  normal  base 
level  communications  capabilities  were  not 
responsive  enough  (adminlstral Ive)  nor  com¬ 
pletely  reliable  (human)  to  meet  the  provisions 
of  the  contract.  Therefore,  modification  of 
the  Air  Force  Standard  Base  Supply  System  Is 
being  done  to  automatlcnl ly  notify  the  RIW 
contractor  when  a  failure  is  verified  by  the 
Air  Force  maintenance  shop.  Tills  notif  Scat  ion 
will  advise  the  contractor  which  I.RU  failed, 
its  serial  number,  the  Air  For.-e  base  which 
experienced  the  failure,  and  the  shipping  doc¬ 
ument  number  covering  the  reparable  iu>m  being 
returned.  In  addition,  the  USAF  Hcpurabl* 

Item  Movement  Control  System  direct Iv  routes 
the  item  to  the  contractor’s  designated  repair 
facility  with  the  appropriate  "mark  for"  infor¬ 
mation.  Applicable  technical  orders  have  been 
issued  specifically  outlining  the  level  of 
maintenance  authorized  and  the  steps  lo  be 
followed  in  verifying  the  equipment  failure. 

In  another  area,  we  are  attompMng  to  establish 
an  independent  data  baae,  using  existing  Air 
Force  data  systems,  in  order  Lo  pr* vide  a 
parallel  means  of  verify  lug  guar  mu  ••  pro¬ 
visions  and  evaluating  the  RIV  .  eiv't  \  I  itself. 
The  success  of  this  effort  will  dr.»iM  m  how 
well  we  cun  overcome  the  prevlorslt  lied 
difficulties  ns  well  as  the  quail  \  d  data  we 
receive.  In  all  probability,  we  will  be  able 
to  evaluate  the  concept  and  the  beiiv*  us 
gained  from  RIW.  Using  the  data  base  to  verify 
key  data  cited  in  the  contralto)  w.itj.iniy  re¬ 
ports  may  prove  to  be  more  elusi'-i  . 

Hie  moat  encompassing,  and  periia;**.  I  in  most 
frustrating  lesson  we  have  le.itr.i't’  about  RIW 
Is  that  in  order  to  make  it  wjrk,  Air  force 
personnel  involved  in  all  level.-*  of  its  manage¬ 
ment  must  be  made  aware  of  what  7i*  is,  what 
pari  they  play  in  it,  and  how  lh> it  actions  or 
decisions  impact  on  others  involved  >11  Uic 
program. 

A  generic  problem  is  delayed  installation 
of  warranted  units.  Those  delays  an*  of  gvq.at 
concern  to  the  Air  Force.  Although  there  is 
some  protection  to  the.  Government  undot  the 
Operating  Hours  Adjustment  provision,  the  in¬ 
herent  incentives  of  the  RIW  arc  eroded  by 
warranted  units  which  arc  idle,  rheie  may  be 
another  cost  impact:  when  old  Jen.,  > «■  1  i. able 
units  with  high  suy-ort  cost  air  being  operated 
and  maintained  whi ....  the  new  highly  reliable 
equipment  remain  not  installed. 
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FINAL  COMMENTS 


He  have  learned  chat  administration  of  a 
special  warranty  for  equipments  installed  on  a 
great  variety  of  aircraft  deployed  world-wide 
is  a  challenging  task..  There  is  a  need  for 
special  management  emphasis,  a  great  amount  of 
data,  and  education  of  all  levels  of  Air  Force 
people  who  arc  involved  in  processing  of 
warranted  equipment  and  data.  There  is  a  need 
for  special  techniques  to  detect  potential  RIW 
problems.  In  this  regard,  the  Air  Force  lias 
established  an  independent  automated  data  base, 
using  existing  Air  Force  Supply  and  Maintenance 
data  systems,  as  a  tool  to  use  in  administering 
the  wart  antics.  The  Air  Force  has  learned  the 
value  of  a  ur  go  'Justmenc  provision  in  the 
contract  for  Loch  l:  -i  contractor  and  the  Gov¬ 
ernment.  Without  such  a  provision,  n  contrac¬ 
tor  may  be  penalized  by  a  wartime  surge  or  reap 
an  unearned  windfall  from  reduced  flying  pro¬ 
grams.  The  WHIP  Guarantee  is  a  powerful  incen¬ 
tive  which  Imposes  additional  risk  on  the  con¬ 
tractor  and  complicates  both  the  structuring 
of  the  contract  and  administration  of  the 
warranty.  However,  significant  benefits  have 
resulted  from  its  use.  Proper  administration 
of  the  warranty  is  of  utmost  importance,  other- 
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wise,  the  promised  benefits  may  be  lost. 
Favorable-  results  from  RIW  are  being  observed. 
The  data; from  these  demonstrations  should  be 
cnrcfully  studied  before  RIW  Is  Incorporated 
as  a  "business'  as  usual"  acquisition  technique. 
During  CY  IGld,  the  Air  Force  will  focus  on 
the  long  term  range  planning  needed  to  bring 
the  trial  of  IUW  (o  a  successful  conclusion. 
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Purpose-Abstract 


This  paper  presents  a  relatively  complex 
legal-rellabillty-liability  case  history. 

Two  approximately  equal  parties  signed  a  con¬ 
tract  for  the  delivery  of  merchandise.  In¬ 
stead  of  continuing  the  relationship  of  a 
satisfied  customer  and  profitable  manufactur¬ 
er,  they  became  adversaries  in  a  protaeted 
legal  proceeding  which  culminated  in  an  out- 
cf-court  settlement  reached-  just  prior  to 
trial.  The  agreement  required  the  payment  of 
a  large  portion  of  the  total  remuneration 
anticipated  five  years  earlier  when  the  con¬ 
tract  was  signed. 

The  content  of  this  paper  Includes  the  con¬ 
tractual  language  used  by  the  parties  at  bar. 
It  also  shows  the  product  flow  and  relation¬ 
ship  between  supplier;  manufacturer,  customer, 
sales  distribution  organization,  ultimate  cus¬ 
tomer,  repair  and  maintenance  operations. 

The  sequence  of  document  exchange  containing 
relevant  Information  affecting  the  parties  is 
discussed  showing  how  it  also  contributed  to 
tho  difficulty.  The  misconceptions  and  mis¬ 
interpretations  made  by  both  parties  to  the 
litigation  are  explored.  Both  organizations 
involved  in  this  action  are  competently 
staffed  by  highly  qualified  reliability  and 
quality  assurance  engineers.  Numerous  in- 
house  counsel  and  engineering-legal  talent 
were  employed  in  both  organizations. 

Marketing  organizations  compounded  the  prob¬ 
lem  by  the  overzealous  puffing  of  product 
utility  to  contractual  parties  and  to  subse¬ 
quent  users.  Product  performance  was  over¬ 
sold,  but  thlp  had  relatively  little  bearing 
on  the  basic  outcome  of  the  litigation  be¬ 
tween  the  two  contractual  parties.  These  two 
organizations  were  approximately  of  equal 
stature,  both  being  well-known,  nationally 
recognized  manufacturer*  of  military  and  com¬ 
mercial  product. 

He  prepared  this  paper  to  establish  an  aware¬ 
ness  of  the  pitfalls  that  can  be  encountered 
during  all  phases  of  the  contraet/produot 
cvcle.  Some  errors  oceurred  in  each  of  the 
following: _ 

*  Reprinted  with  pexmlselon  of  the  Institute 
of  Electrical  and  Electronics  Engineers, Inc. 
c  1978.  Originally  published  in  the  Pro¬ 
ceedings  1978  Annual  Reliability  and  Main¬ 
tainability  Symposium. 


negotiation,  proposal,  preliminary  design, 
prototype  analysin  and  engineering  models. 
There  was  also  inadequate  preparation  of  fa¬ 
cilities  and  personnel  to  handle,  maintain  or 
service  the  production  quantities  Involved. 

Background 

The  relationship  between  these  organizations, 
divisions  of  much  larger  organizations,  was 
originally  one  of  partners!  Perhaps  this  re¬ 
lationship  was  one  of  the  underlying  diffi¬ 
culties  in  the  situation,  What  apparently 
occurred  was  that  following  what  had  been  a 
long  and  profitable  relationship  both  divi¬ 
sions  were  left  with  too  large  an  operation 
and  insufficient  business.  In  casting  about 
to  find  a  suitable  activity,  the  officers  of 
Division  A,  Company  A,  saw  a  device  in  the 
laboratory  of  Division  Z,  Company  Z.  This 
was  immediately  recognized  by  A 's  officers  as 
&  product  with  enormous  potential.  It  could 
be  sold  at  a  reasonable  price.  It  had  a  poten¬ 
tially  wide  market.  The  service  and  installa¬ 
tion  operations  would  fit  into  the  activities 
of  Division  B,  Company  A.  If  Company  Z  would 
make  it,  Company  A  would  sell  and  service  it. 
It  was  in  Company  A 's  collective  market-mind- 
edness  that  the  product  was  the  best  thing 
since  sliced  bread  was  developed.  It  wss,  of 
course,  necessary  to  enter  into  a  contractual 
agreement,  draw  up  specifications,  start  man¬ 
ufacture  and  delivery  to  the  ultimate  custom¬ 
er.  Any  device  as  big  a  drawing  card  as  this 
thousand-dollar  device  was  bound  to  draw  com¬ 
petition,  and  they  had  to  be  prepared. 

Difficulties  abounded.  No  one  at  either  Com¬ 
pany  A  or  Z  had  had  very  much  experience  with 
this  product  or  with  this  type  of  device.  Al¬ 
though  a  model  existed,  there  were  no  detailed 
specifications  or  drawings.  The  actual  reli¬ 
ability  of  the  product  wae  unknown.  The  mean- 
tlme-between-failure  (KTBF)  could  only  be  de¬ 
termined  when  soae  of  the  design  details  be¬ 
came  firm.  The  produce  performance  functions 
were  stabilized  after  a  few  hundred  units  were 
in  operation.  ' 

Company  A  originally  wanted  an  8000-hour  MTBF. 
This  requirement  was  based  om 

a.  Obtaining  a  reasonable  profit. 

b.  Approximately  Uo  hours  a  week  of  ua. 
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c.  Once  every  four  years  a  service  call  would 
be  required.  (The  less  service  required, 
the  happier  the  customer.) 

d.  Early  delivery  and  ease  of  Installation. 

Company  A  felt  it  was  In  excellent  position  to 
market  the  device  successfully  in  many  areas 
of  the  country.  The  volume  was  estimated  to 
approach  100,000  units. 

The  specifications  were  drawn,  and  there 
3eened  to  be  general  agreement  of  what  should 
be  accomplished.  Unfortunately  neither  divi¬ 
sion  w  sufficiently  familiar  with  the  prod¬ 
uct,  its  use,  and  the  demands  likely  to  be  en¬ 
countered.  It  was  a  "new"  field  to  both  ad¬ 
versaries,  and  as  usual  planning  for  the  un¬ 
known  proved  treacherous. 

The  mutually-established  specifications  in¬ 
cluded  i 

1.  Reliability  Requirements 

The  following  3hall  be  minimum  require¬ 
ments  for  the  reliability  of  the  devlcei 

Mean  Life  .  5  years 

KTBF* .  2,000  hours 

‘KTBF  shall  be  established  by  reliability 
analysis  made  by  contractor  and  submitted 
to  Company  A  for  approval. 

Company  A  shall  have  the  option  to  test 
these  units  for  conformance  to  these 
reliability  figures.  Lack  of  conformance 
constitutes  reason  for  rejection. 

2.  Quality  Objective 

All  components  chosen  shall  be  reviewed  for 
quality  and  reliability  by  contractor. 

All  proposed  suppliers  shall  be  investi¬ 
gated  by  contractor -to  establish  the 
quality  and  reliability  of  past  perform¬ 
ance. 

Contractor's  Quality  Assurance  Department 
shall  audit  manufacturing  and  machine 
assembly  operations  to  insure  workmanship 
meets  tho  standards  for  commercial  prod¬ 
ucts. 

Contractor's  Quali1  *  Assurance  Department 
shall  audit  all  inspection  and  testing 
procedures  to  insure  deliverable  equip¬ 
ment  meets  specifications  as  set  forth 
elsewhere  within  this  document. 

Contractor's  Quality  Assurance  Department 
shall  review  all  field-returned  devices 
prior  lo  release  for  analyeln  and  repair. 
All  failure  aualyule  and  repair  actions 
shall  be  monitored  for  failure  trends. 

Areas  which  are  repeated  offenders  shall 
receive  corrective  action. 

J,  Maintenance  Objective 


teat  equipment. 

Minimization  of  dust  problems. 

Built-in  endurance  features  to  withstand 
operator  abuse,  misuse  and  mishandling 
of  equipment. 

A  minimum  of  operator-accessible  controls 
and  adjustments. 

b.  Warranty  Agreement 

Thi6  agreement  called  for  repair  and/or 
replacement  of  all  devices  at  Company  Z 's 
option  upon  receipt  at  Company  Z.  Company 
Z  would,  pay  the  cost  of  snlpment  for  the 
devices  that  w.ere  found  to-  be  ''out-of- 
specification"  on  arrival  at  Company  Z. 

The  Reliability  requirements  had  been  the 
basis  of  considerable  discussion  before  the 
inclusion  of  the  quoted  2000-hour  KTBF  item  in 
the  contract.  The  original  desire  on  the  part 
of  Company  A 's  engineers  hail  been  8000  hours. 
The  manufacturing  company  had  consistently 
in  discussions  denied  the  ability  of  this  prod¬ 
uct  to  exhibit  an  8000-hour  KTBF.  The  final 
commitment  was  a  2000-hour  MTBF.  Company  Z 
grudgingly  gave  in  to  this  figure,  although 
feeling  it  was  still  too  high.  It  should 
have  been  reduced  further  while  the  product 
was  still  under  development.  Nonetheless, 
Company  A  felt  it  had  to  have  a  product  with  a 
longer  KTBF. 

After  the  contract  was  signed  and  manufacturing 
had  started,  the  reliability  analysis  was  sub¬ 
mitted  on  schedule.  There  was  still  no  agree¬ 
ment  between  A  and  Z  as  to  whether  the  relia¬ 
bility  was  adequate.  It  was  contractually 
agreed  that  Company  Z  would  establish  a  relia¬ 
bility  test  plan  to  be  approved  by  Company  A. 
Company  A  would  establish  the  measured  KTBF. 

If  the  units  passed  the  test,  Company  Z  would 
accept  the  test  results  as'p/roof  that  tho 
specified  KTBF  had  been  equalled  or  exceeded. 

However,  before  the  reliability  tests  were 
agreed  upon,  Company- A  began  pressuring  Z  to 
deliver  salable  product  built  up  to  the  initia¬ 
tion  point  of  manufacture  and  delivery. 

Whenever  production  precedes  the  testing  for 
conformance,  problems  arise  (as  Murphy's  Law 
infers).  There  were  a  considerable  number  of 
units  received  by  Company  A  that  were  immedi¬ 
ately  returned  to  7.  an  "not  working".  Addi¬ 
tional  units  were  returned  to  Z  which,  it  was 
alleged,  had  not  been  operable  or  satisfactory 
when  installation  was  attempted. 

Some  unite  were  removed  after  days  or  weeks  of 
operation  and  returned  to  Z.  In  each  case  de¬ 
fects  were  clalraed. 


Built-in  self-checking  features  to  minimize 
or  eliminate  the  need  for  special  field 
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This  traffic  in  units  made  A  even  more  anxious 
to  obtain  units.  They  insisted  that  major 


Table  I 


emphasis  be  on  increasing  the  delivery  rate 
rather  than  holding  all  shipments  until  cor¬ 
rections  were  made.  The  sales  pressures  kept 
building  up  for  approximately  nine  months. 

Visits  of  executives  and  engineers  to  expe¬ 
dite,  correct,  Improve  and  rectify  were  be¬ 
coming  routine.  The  concept  appears  to  have 
been  fostered  that  a  test  to  determine  the  re¬ 
liability  of  the  product  was  a  luxury  that 
neither  A  nor  Z  could  afford  at  the  moment. 
Thus  the  Reliability  Test  Plan  was  momentarily 
ignored . 

After  approximately  15C0  units  had  been  de¬ 
livered,  the  available  stock  at  Company  A  be¬ 
gan  to  grow.  Troubles  were  continuous  and 
believed  to  be  insurmountable.  At  this  junc¬ 
ture,  Company  A  Issued  a  Stop  Vork  Order 
while  continuing  to  request  that  2  rebuild  and 
repair  "nonconforming"  returned  product.  Six 
months  later  the  contract  was  cancelled  and 
Company  A  sued  Company  2  for  losses  and  prof¬ 
its  which  should  have  materialized  had  the 
product  been  more  suitable. 

The  primary  claim  in  this  suit  was  that  com¬ 
mercial  success  had  failed  to  materialize  be¬ 
cause  of  the  failure  of  Company  2  to  deliver 
a  product  with  adequate  reliability.  Th* 
allegations  Included  an  HTBF  of  less  than  WO 
hours. 

During  the  period  of  contractual  relationships 
a  reliability  test  plan  had  been  submitted  by 
Z  which  read  essentially  as  followst 

The  test  had  three  criteria  for  termination. 
They  are  listed  aa  Plans  A,  3,  C.  Sample- 
KT3F  refers  to  the  "Totai-Test-Time"  divided 
by  the  "number  of  failures  during  that  time". 

Plan  A*  There  are  five  decision  points  (at 
12,  16,  20,  24,  23  weeks).  At  each 
decision  point,  the  sample-HTBF  J.o 
compared  to  Table  I,  If  the  sample- 
KT9F  is  greater  than  the  tabulated 
value,  testing  terminates  and  the 
test  is  passed t  otherwise,  testing 
continues. 

Plan  3i  If  the  test  la  not  passed  In  Plan  A, 
discard  the  operating  time  and  fail¬ 
ures  accumulated  during  the  first  12 
weeks  (viz.,  before  the  first  deci¬ 
sion  point).  Calculate  a  new  sample- 
KTBF.  If  it  1*  greater  than  the  tab¬ 
ulated  value,  the  testing  terminates 
and  the  test  is'paseed ;  otherwise, 
the  test  data  are  re-evaluated. 

Plan  Ci  Dae  the  total  operating'  time  and 
'  failures  from  Plan  A?'  Subtract  the 
number  of  failures  in  Table  II  from 
the  actual  failures  and  calculate  a 
new  sample-XTBF.  If  It  la  greater 
than  2000  hours,  the  test  Is  passed; 
otherwise,  the  teat  Is  failed. 


Termination  Data  for  Plana  A  and  3 


(?) 

P  of  Failures 


Critical  \TB? 
(hours) 


Critical 
Total -Test-Time 
(hours) _ 


2  or  less  —  3,035 

3  2695  3,035 

4  2460  9,340 

5  2315  15 ,575 

6  2215  13,290 

7  2140  14,930 

3  2035  16,630 

9  2040  13,360 

10  or  more  2000  2,000  x  F 


Table  II 

Humber  of  Failures  to  be  subtracted  for  Plan  C 


Total-Test-Time 
_ (hours) 


Ho.  of  Failures 
to  ce  Subtracted 


Less  than  12,000  1 
12,000  to  26,000  inclusive  2 
More  than  26,000  3 


The  plan  was  unusual  and  was  rejected  by  Com¬ 
pany  A  on  the  basis  that  "the  test  plan  was 
so  devised  that  the  product  would  eventually 
pass." 

This  was  interpreted  by  many  that  regardless 
of  the  true  KT3F  of  the  product,  the  plan 
would  eventually  reach  an  Accept  decision. 
Although  discussions  between  Reliability  per¬ 
sonnel  had  taken  place  and  many  letters  had 
been  written  to  modify  the  plan.no  formal  con¬ 
tractual  modification  took  place.  This  may 
have  been  due  to  the  strained  relationships 
which  were  now  prevalent. 

There  were  many  Imponderables.  Correspondence 
from  those  associated  with  the  project  at 
both  corporations  Indicated  from  initial 
field  data  estimates  that  the  KT3F  was  5°0  to 
1500  hours.  Haturally  the  higher  figures 
came  from  Company  Z.  The  litigation  specifi¬ 
cally  raised  these  differences  and  were  the 
jsause  of  the  suit  according  to  Company  A. 
Company  Z  Initially  agreed  that  this  was  tho 
cause  of  the  dispute.  Later,  during  trial 
preparation,  Company  Z  decided  that  poor 
marketing  and  Intense  technical  competition 
were  the  ceueee  of  the  decline  in  orders. 


At  some  point  in  every  situation  in  which  it 
appears  that  court  action 'is  imminent,  both 
parties  usually  seek  assistance.  They  obtain 
needed  answers  to  questions  that  appear  aea- 


303 


der.ic,  but,  as  this  paper  will  demonstrate, 
are  not.  Among  the  questions  that  arose  in 
the  instant  litigation  were: 

1.  What  was  the  tine  field  experience  of  the 
product? 

2.  What  did  the  contract  and  specification 
really  say? 

2.  How  should  the  specification  be  inter¬ 
preted? 

4.  What  was  the  operating  characteristic  of 
the  proposed  and  rejected  reliability 
test  plan? 

If  an  agreement  is  nade  to  deliver  devices 
with  an  KT3F  of  2000  Hours  and  the  field 
experience  is  200  to  300  hours,  it  is  obvious 
that  the  product  is  grossly  inadequate.  If 
the  field  experience  is  1500  hours  to  1900 
hours  in  the  early  life  of  the  product,  then 
one  could  expect  the  reliability  growth  to 
provide  some  Improvement  which  co-jbined  with 
a  few  changes  would  provide  for  a  reliability 
in  later  life  of  well  in  excess  of  2000  hours. 

Neither  vendor  nor  venlee  (Company  Z  or  Com¬ 
pany  A  respectively)  had  made  an  objective 
analysis  of  the  actual  operating  data.  Since 
the  data  had  not  been  analyzed,  the  defendant 
was  uncertain  about  the  results  presumably 
because  the  analysis  might  just  prove  the 
plaintiff's  allegations.  The  defense  position 
would  then  be  untenable.  When  the  need  for 
such  an  analysis  was  presented,  the  defense 
was  justifiably  reluctant.  Trial  counsel 
finally  prevailed  upon  defendant  Company  Z  to 
allow  a  sample  of  the  data  to  be  taken  for 
analysis. 

H'TBF  Analysis 

The  data  was  obtained  from  two  sources.  One 
source  wae  Company  A 's  card  record  of  each 
unit,  A  card  existed  for  each  serial-numbered 
unit  delivered.  The  data  on  the  card  showed 
when  the  unit  was  received,  Its  condition,  its 
disposition  depending  on  arrival  condition, 
each  date  It  was  shipped  hether  to  a  site  or 
to  Company  Z,  each  date  .nd  location  of  in- 
sta.  atlon  and  all  movements  of  the  device. 
Some  devices  were  returned  to  Company  A  im¬ 
mediately.  Man/  stayed  in  service  for  various 
periods  of  time.  Some  were  romoved  and  re¬ 
placed,  others  removed,  shipped  and  installed 
at  other  sites  and  some  removed  and  returned 
to  Company  Z.  Still  others  had  been  removed 
from  service  and  returned  to  stock, of  Company 
A.  In  each  case  data  was  reasonably  complete, 
and  only  ono  to  two  percent  of  the  cards  had 
to  be  discarded  due  to  poor  records. 

The  data  of  the  vendor,  Compiwy  was  also 
quite  complete.  It  showed  when  eaoh  serial- 
numbered  unit  wan  first  shipped  and  when  it 


was  returned.  The  data  log  showed  whether 
or  not  the  unit  was  operating  within  specifi¬ 
cations  when  returned ,  and  if  repaired ,  wheth¬ 
er  it  was  repaired  to  update  the  unit  or  to 
correct  a  nonconformity. 

Criteria  Associated  with  i',T3F 

In  making  the -analysis  of  Mean-Tlme-Between- 
Failures,  a  number  of  criteria  were  adopted 
by  these  writers  during  trial  preparation. 

The  contract  and  specification  did  not  identi¬ 
fy  when  or  whether  or  not  the  device  was  to 
be  counted  as  a  failure.  "Failure"  was  not 
defined.  The  adopted  (for  analytical  pur¬ 
poses)  criteria  were: 

1.  A  device  received  at  Company  A  and  re¬ 
turned  to  Company  Z  (vendor)  without 
service  tine  of  one  day  or  more  was  not 
considered  to  be  a  failure.  It  did  not 
contribute  any  time  to  the  total  service 
time  as  it  was  not  installed. 

2.  A  device  with  service  time  at  one  site 
and  subsequently  removed  and  sent  to 
another  site  was  considered  to  have  con¬ 
tributed  to  the  total  service  hours  but 
not  to  the  number  of  failures  (no  evidence 
of  failure). 

3.  A  device  which  was  returned  from  service 
at  a  site  and  which  was  returned  to  Com¬ 
pany  Z  and  found  to  be  in  conformity  to, 
specifications  contributed  to  the  trial 
service  hours  but  not  to  the  number  of 
failures  as  it  was  still  operating  satis¬ 
factorily.  ,  . 

4.  Devices  which  were  in  service  and  subse¬ 
quently  returned  to  Company  Z  where  they 
were  found  to  require  repair  to  satisfy 
specifications  were  counted  as  field 
failures.  Their  time  in  service  was  added 
to  the  total  service  hours. 

These  criteria  are  in  conformity  with  the 
general  practice  of  computing  the  Kean-Tlmc- 
Between-Failures  as  the  quotient  of  the  tptal 
equipment  operating  hours  divided  by  the 
number  of  failures  occurring  during  the  period. 
Failures  before  operation  arc  not  counted. 

It  had  been  established  by  Company  A  that 
service  time  would  be  based  on  40  hours  per 
week  of  use.  There  were,  we  are  certain, 
Instances  where  the  device  was  powered  twenty- 
four  hours  a  day.  Data  supports  this  conten¬ 
tion.  Because  of  the  large  number  of  devices 
(1500)  involved,  Company  Z  reluctantly  agreed 
to  use  the  40-hour  week.  The  customer  (Com¬ 
pany  A,  Division  A)  maintained  that  the  de¬ 
vices  were  actually  exercised  and  but  a 
fsw  minutes  a  day- even  though  power  was  "OH" 
for  longer  periods.  No  meters  or  counter 
were  installed  on’ any  devices  in  actual  uso. 
Nonetheless,  the  final  agreement  wan  that  tho 
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service  life  calculations  would  he  based  on  a 
usage  rate  of  90  honrs/week. 

The  first  data  anal 77 ed  consir.ted  of  Company 
Z ‘s  history  of  29  devices.  The  KTBF  calcula¬ 
ted  from  the  staple  proved  to  be  approximately 
100  hours.  This  was  an  extremely  low  value. 
The  analysts  were  not  satisfied  that  the  data 
■■.ere  valid.  The  suspicion  proved  valuable  as 
it  was  ther  learned  that  the  selection  of  the 
devices  had  been  made  by  Company  Z  on  a  non- 
r.ftdoT  selection  of  the  worst  (most  frequently 
returned)  devices. 

'.sing  a  random  number  table,  twenty  addition¬ 
al  devices  were  selected  from  the  remaining 
1 b1Q  device  population. 

Adopting  thf  same  criteria,  this  group  of 
twenty  had  an  I'.TiiF  of  more  than  ”000  hours . 
This  hlgh'-y  significant  lack  of  agreement  be¬ 
tween  the  two  samples  was  found  to  have  been 
caused  by  the  nonrandom  process  used  for  the 
selection  of  the  first  group,  .'..unpany  2 
thought  that  the  analysts  would  find  the  most 
interesting  data  to  analyze  would  be  among 
the  history  records  of  the  devices  most  fre¬ 
quently  returned  to  the  factory.  The  fre¬ 
quency  of  return  of  this  first  group  of  twenty 
exceeded  the  average  by  more  than  three  times. 

The  data  from  Company  A  *s  card  record  which 
showed  late  of  installation  and  "removal'' 
showed  substantially  lower  "in-operation" 
periods.  The  analysts  combined  these  data 
(Company  a  and  2*s  records)  to  conduct  the 
balance  of  the  investigation. 

Base.!  on  these  data,  the  estimate  of  the  KTBF 
(based  on  the  forty-device  sample)  was  found 
to  exceed  2n09  hours.  This  result  so  encour¬ 
aged  Company  U  that  it  authorized  the  analysis 
of  a  totally  random,  unbiased  sample  of  40 
devices  from  the  total  popilatlon.  The  re¬ 
sults  exceeded  2000  hours  KTBF.  The  differ¬ 
ence  between  the  defense  and  plaintiff's  ap¬ 
proach  was  expected  to  be  submitted  to  a  jury 
for  resolution  of  future  problems. 

Reliability  Test  Plan 

Another  defense  investigation  was  simultane¬ 
ously  underway.  The  reliability  test  plan 
that  had  been  proposed  by  Company  7,  Indicated 
that  the  operating  characteristic  was  essen¬ 
tially  that  shown  in  Figure  1.  If  the  KTBF 
was  2000  hours,  the  probability  of  acceptance 
was  1Q£;  if  1000  hours,  %• 

The  operating  characteristics  changed  slightly 
if  the  rate  of  accumulating  operating  time 
changed.  It  was  not  grossly  different  over 
the  rates  of  f>00  to  1900  total  machine  operat¬ 
ing  hours  per  week.  The  greatest  changes 
seemed  to  occur  if  the  FT3F  was  well  below  the 
specified  value. 


During  the  litigation  there  was  much  discus¬ 
sion  concerning  the  merits  of  specifying  a 
VTBF  with  or  without  a  confidence  level.  If 
r.o  confidence  level  cr  test  procedure  with  an 
acceptance  criteria  is  given,  there  Is  a  seri¬ 
ous  question  as  to  whether  a  specification 
actually  exists.  As  in  this  case,  the  vendor 
may  wisn  to  provide  a  test  plan  that  behaves 
like  the  well-known  operation  characteristics 
of  K11-STD-105D.  If  the  true  KTBF  »  2000 
hours,  the  test  plan  should  accept  the  product 
with  a  probability  of  approximately  0.95* 

The  purchaser  may,  as  in  this  case,  hold  for 
the  concert  that  the  test  Dlan  shoild  accept 
the  protect  readily  If  the  true  KTBF  grossly 
exceeded  2000  hours,  under  these  conditions, 
the  probability  of  acceptance  would  equal  ".1 
if  the  true  KT3F  »  2000  hours.  If  the  true 
KTBF  »  1000  hours,  then  the  probability  of 
acceptance  nay  exceed  0.9. 

Based  cn  this  philosophy  Company  A  wa3  argu¬ 
ing  that  even  if  the  i-’TBr  of  a  sample  proved 
to  be  2000  hours,  this  was  unacceptable. 

Company  A's  Reliability  r'arual  included  defi- 
tions  which  were  in  essential  agreement  with 
the  philosophy  advanced  by  Company  Z;  yet  In 
spite  of  these  documents,  Conpany  A  was  will¬ 
ing  to  permit  a  court  to  decide  the  technical 
merits  of  the  question.  The  results  might 
have  been  interesting  to  the  technical  cotnu- 
nity. 

At  the  negotiating  state,  a  reliability  test 
plan  that  would  have  satisfied  both  parties 
could  have  been  devised.  However,  following 
this  stage,  cooperation  Is  not  anticipated. 
Each  party  then  Insists  on  tile  most  advantage¬ 
ous  interpretation  fc.  its  organization. 

Another  phase  of  the  contract  that  appeared  to 
have  been  neglected  was  the  definition  of  con¬ 
formance.  Vhat  could  readily  have  been  re¬ 
quired  is  that  on  ar.y  sequence  of  shipments  of 
!!-devicos,  not  more  than  ”n“  may  be  noncon¬ 
forming  to  the  extent  that  it  need  be  returned 
to  manufacturer  for  repair.  As  It  was,  both 
manufacturer  and  purchaser  rolled  on  a  100£ 
sorting  procedure  to  eliminate  nonconforming 
product.  This  practice  seldom  works.  It  did 
not  work  in  this  instance. 

It  Is  difficult  to  decide  exactly  why  the  com¬ 
panies  were  unable  to  agree  on  a  reliability 
test  plan.  Various  opinions  were  offered: 

a.  The  rejection  of  the  Conpany  Z  prepared 
test  plan  was  actually  the  result  of  try¬ 
ing  to  modify  an  earlier  agreement. 

b.  The  recipient  and/or  the  writers  of  the 
test  plan  did  not  really  have  a  true 
knowledge  of  the  operating  characteristics 
of  the  plan  nor  how  it  would  be  adminis¬ 
tered.  The  representative  of  the  pur- 


305 


306 


its  "'eld  office  from  which  It  was  transferred 
via  .ruck  or  car  to  user  facility,  or  (b)  di¬ 
rectly  to  user  facility,  When  a  unit  was 
tra...-,ferrod ,  it  was  handled  in  the  sane  man¬ 
ner.  ‘/hen  it  was  returned  to  Company  A,  it 
retraced  the  route. 

The  carton  was  designed  per  specification  for 
delivery  purposes,  the  shipment  •‘‘rora  Company 
/.  to  A.  A  large  number  of  devices  returned 
for  service  under  the  warranty  were  in  origi¬ 
nal  cartons.  The  carton  designed  for  one 
sequence  of  shipment  (truck,  plane,  truck) 
was  actually  being  used  for  at  least  four  se¬ 
quences.  There  are  no  data  and  no  ways  of 
determining  the  deterioration  rate  per  sub¬ 
sequent  shipment  in  used  cartons. 

It  would  have  been  more  appropriate  to  con¬ 
sider  the  entire  sequence  of  handling  from 
manufacturer  to  user  In  the  design  of  the 
package  rather  than  the  assumed  one-shipment 
philosophy  employed.  Where  a  package  is  ex¬ 
pected  to  be  used  for  multiple  shipments  and/ 
or  rotml  trips,  the  package  should  provide  ap¬ 
propriate  strength  and  Instructions  (if  any) 
that  are  to  be  obsorved  for  viable  repeated 
use. 

Purchaser  *s  »odnct  Assessment 

During  the  time  the  litigation  process  was 
progressing,  data  were  being  analyzed  and  the 
test  plan  evaluated.  Company  A  (the  purchaser) 
had  its  engineers  carefully  review  the  device. 
’,'e  were  advised  that,  after  making  minor  re¬ 
visions,  the  tested  devices  were  consistently 
exceeding  the  ?.000-hour  KTBF  requirement  a- 
dopted  by  the  analysts.  As  part  of  the  court- 
approved  settlement,  Company  A  obtained  the 
excess  inventory  left  in  Company  Z 's  posses¬ 
sion  when  the  stop  work  order  was  invoked. 
Therefore,  It  may  be  assumed  that  the  allega¬ 
tions  of  design  non-compliance  were  not  aa 
critical  as  originally  stipulated. 

Failures  -  What  are  They  and  Who  is 

_ Responsible _ 

The  question,  when  does  a  failure  occur,  was 
an  important  element  In  this  litigation.  The 
device  must  satisfy  specifications)  when  It 
doesn't,  it  is  a  failure.  However,  given  the 
routing  and  handling  sequence  of  this  device 
and  tho  established  contractual  language,  the 
defendant  (Company  Z)  believed  that  the  device 
had  io  arrive  at  its  customer's  facility  in  an 
operable  ("within  specification")  condition. 
They  had  control  over  that  phase  of  the  deliv¬ 
ery  sequence.  Company  Z  did  not  have  control 
over  unpacking,  testing,  opening  the  device, 
adjusting,  closing,  repacking,  shipping,  un¬ 
packing  or  installing  the  device  after  these 
many  "handlings". 


records  showed  internal  shipping  damage  had 
contributed  to  "out-of-spoclf icatlon"  arrivals. 
This  question  will  probably  never  be  answered 
since  the  litigation  has  been  terminated. 

To  further  compound  the  problem,  the  users 
were  nontechnical.  Every  time  an  unexpected 
deviation  appeared ,  the  service  department  was 
called.  Their  instructions  were  clear  and 
concise — remove  ani  replace — satisfy  the  cus¬ 
tomer,  when  the  device  was  under  warranty. 

Since  the  warranty  provisions  were  not  en¬ 
forced  by  Company  Z,  it  meant  that  each  device 
was  harried  as  if  it  had  still  been  under 
warranty. 

All  of  Company  A 's  field  service  offices  were 
not  equipped  with  test  facilities.  As  a  re¬ 
sult,  all  units  that  were  "suspected"  to  be 
out  of  specifications  were  sr-nt  to  Company  A 's 
headquarters.  Many  removals  were  due  to  ir¬ 
regularities  of  power  sources,  operator  errors 
and/or  interface  equipment.  These  devices 
were  subsequently  returned  to  Company  Z  for 
repair. 

As  noted  above,  some  shifting  between  renting 
users  was  done  to  satisfy  peak  demands  and 
other  contractual  problems  between  Company  A 
and  its  customers. 

In  assessing  tiTBF ,  Company  A  counted  ever,£  re¬ 
moval  of  a  device  for  whatever  cause  as  an 
"unscheduled"  removal.  This  was  interpreted 
as  a  "failure".  This  accounted  for  the  dis¬ 
parity  between  the  alleged  400  hours  tiTBF  and 
the  over  2000  hours  MTBF  calculated  from  the 
combined  data  sources  using  only  failures 
that  were  confirmed  when  the  device  was 
tested  by  the  manufacturer  (Company  Z). 

A  detailed  agreement  is  needed  before  the 
questions  arise.  The  agreement  should  con¬ 
tain  answers  to  the  following i 

1.  What  is  a  "failure"? 

2.  When  is  it  to  be  counted? 

3.  When  failure  occurs ,  are  secondary  fail¬ 
ures  the  responsibility  of  the  manufactur¬ 
er? 

4.  How  does  a  customer  complaint  become  a 
failure?  How  is  it  to  be  confirmed? 

5.  Are  all  removals  failures? 

6.  Should  service  personnel  confirm  device 
failures? 

7.  When  warranty  provisions  apply,  should 
purchaser  of  devise  be  allowed,  without 
penalty,  to  open  the  device)  or  does 
opening  void  his  warranty? 


A  real  question  arises  as  to  what  Company  Z's 
true  responsibility  was  when  Company  A  *s 


Had  most  or  all  of  these  questions  been  de- 


fined  in  the  contract  or  in  referenced  docu¬ 
ments,  this  litigation  would  probably  have 
been  avoided. 

Conclusions 

The  lessons  that  can  be  learned  from  this 
financial  debacle  have  undoubtedly  been  ex¬ 
pensively  learned  by  others  in  a  similar 
fashion.  Some  of  the  lessons  are: 

1 .  Corporate  procedures  are  designed  to  keep 
the  company,  its  divisions  and  its  per¬ 
sonnel  out  of  difficulty.  They  are  usual¬ 
ly  wise  rules,  developed  when  pressures 
are  ab-v  it  vd  with  a  view  toward  avoid¬ 
ing  and  repeating  past  errors.  Post  of 
these  corporate  practices,  devoted  to  the 
development  of  product  and  process,  de¬ 
scribe  in  minute  detail  what  steps  are  to 
be  taken  in  order  to  avoid  problems.  They 
are  neither  foolproof  nor  easy  to  follow. 
Nonetheless,  ignoring  these  rules  is  an 
invitation  to  serious  problems.  By-pass¬ 
ing  the  rules  Is  almost  certain  to  lead  to 
a  catastrophe. 

2.  All  contractual  agreements  must  be  worked 
out  before  entering  into  a  deal.  Avoid 
the  simplistic  trust  phrase:  "Company  1 
shall  submit  to  Company  2  to  provide  a 
satisfactory  plan  for  completion  of  a 
phase  with  "n"  days  after  signing  .  . 
unless  penalties,  stop  work  and  contract 
cancellation  can  be  invoked  by  either  buy¬ 
er  or  seller. 

3.  Satisfactory  Prototype(a)  capable  of  dem¬ 
onstrating  operational  characteristics  and 
reliability  should  be  available,  tested 
and  approved  prior  to  a  production  go- 
ahead  . 

A  retirement  for  conformance  to  a  speci¬ 
fication  is  incomplete  unless  accompanied 
by  a  mutually  agreeable  or  standard  method 
of  measuring  the  characteristic.  When  the 
product  has  satisfactorily  completed  the 
Standard  Method  of  Measuring  Performance, 
the  result  shall  be  ♦ coepted  as  proof  of 
conformity.  Tolere  .e  limits  are  the  rule 
for  physical  measurements,  while  confi¬ 
dence  limits  and  test  plans  are  needed  for 
measurements  involving  time  and  decisions. 

5.  Accelerating  production  or  delivery  sched¬ 
ules  are  incompatible  with  the  insistence 
on  an  Improvement  in  workmanship  and  of 
the  quality  and/or  reliability  of  the  de¬ 
vice. 

a,  'Hi*  upeutrlentlon  of  «  life  nhurmntertatle 
PTSF  neither  includes  nor  repleoeu  a  n)'eo- 
ificatlou  for  other  characteristics  of 
quality. 

7.  Define  the  crltorla  for  acceptance. 


0.  Define  what  a  failure  is,  when  and  where 
it  becomes  a  failure,  how  it  is  to  be 
counted  or  excluded  from  calculations  of 
either  criteria. 

9.  Define  or  describe  shipping  requirements 
for  the  device  and  the  shipping  container. 

10.  Peach  agreement  on  how  data  will  be  re¬ 
tained  and  its  availability  (exchange¬ 
ability)  for  analysis  purposes. 

Ignoring  all  or  most  of  these  warnings  may 
result  in  claims  against  the  manufacturer.  A 
>30,000,000  lawsuit  1b  an  expensive  way  to 
find  out  that  corporate  procedures  and  poli¬ 
cies  were  reasonably  good  afte:  ail. 

Although  there  has  been  no  total  accounting  of 
the  amount  spent  in  this  litigation,  the 
authors  estimate  that  each  spent  considerably 
more  than  $500,000  to  prepare  their  portion  of 
the  case.  The  detail  contained  herein  is 
taken  from  an  actual  case  history  which  ended 
in  an  out-of-court  settlement  where  the  de¬ 
fendant  (Company  Z)  paid  the  plaintiff  in 
cash  and  Inventory  a  figure  greater  than 
$1,250,000. 

For  obvious  reasons,  no  references  or  ack¬ 
nowledgements  are  shown  which  would  Identify 
the  parties  at  bar. 
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PROCEDURE  FOR  ASSESSMENT  OF  SCIENTIFIC  SOURCES  (PASS) 
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INTRODUCTION 


NAVAIR's  materials  research  and  exploratory 
development  program  consists  of  approximately 
$S  million  annual  expenditures.  This  program 
is  done  approximately  50%  in  Navy  labora¬ 
tories  and  S0%  with  universities,  industrial 
laboratories,  and  private  research  organiza¬ 
tions.  The  characteristic  size  of  each 
contract  with  industry  is  between  $50,000  and 
$100,000  and  is  normally  for  a  one  (1)  year 
period.  Thus  there  are  about  fifty  (SO) 
contracts  each  year,  approximately  1/4  of 
which  are  new  starts  and  the  remaining  3/4 
consisting  of  extensions  of  on-going  work. 


HISTORY 


In  the  early  1960's  a  review  of  the  Materials 
RID  Program  contracting  practice  was  mad.’  and 
the  following  facts  were  observed: 

a.  A  very  large  percentage  of  the  contracts 
were  based  upon  "unsolicited"  proposals  from 
a  limited  number  of  offerors. 

b.  Known  sources  were  quite  limited  in 
number,  i.e.,  only  those  with  which  contract 
monitors  were  familiar. 

c.  When  a  diligent  attempt  was  made  to 
include  all  of  the  identifiable  potential 
sources,  their  number  was  large,  i.e.,  over, 
20.  This  meant  that  when  over  twenty  (20) 
complete  proposals  (cost  and  technical)  were 
received  in  response  to  an  individual  solici¬ 
tation,  the  combined  cost  to  the  offerors  for 
preparation  of  responses  were  equal  to  or 
greater  than  the  value  of  the  one  resultant 
contract.  It  was  recognized  that  these  costs 
must,  in  some  manner,  be  passed  to  the  Govern¬ 
ment. 


STUDIES  AND  DISCUSSIONS 


Study  and  discussion  of  ways  to  improve  the 
contracting  practice  made  against  a  background 
of  DOD,  ASN(RID)  and  ASFR  policies,  guidance, 
and  instructions  led  to  the  following  con¬ 
clusions: 

a.  In  general,  the  NAVAIR  engineers  were 
unable,  without  consultation  with  outside 
scientific  experts,  to  write  a  set  of  optimum 
requirements  for  specific  material  RID 
contracts  in  detail  adequate  to  permit  com¬ 


petitive  procurement  on  a  fully  defined  pro¬ 
gram. 

h.  Consultation  with  outside  experts  could 
not  be  extended  to  all  sources  due  to  time  and 
manpower  constraint  and  such  consultation  was 
a  signal  to  those  consulted  that  an  "unsolic¬ 
ited"  proposal  might  be  well  received. 

c.  There  was  no  assurance  that  the  ultimate 
source  was  the  highest  technically  competent 
source. 

d.  NAVAIR  needed  a  procedure  where,  (1)  all 
interested  sources  could  be  informed  regarding 
planned  "Material  RID  Programs",  (2)  interest¬ 
ed  sources  could  respond  with  technical  detail 
thereby  assisting  NAVAIR  engineers  in  fully 
defining  the  technical  program,  and  (3) 
assurance  could  be  gained  that  the  uost 
technically  competent  source  was  identified. 


PASS  SYSTEM 


The  PASS  system  was  developed  to  meet  the 
needs  set  forth  above  and  is  set  forth  as 
follows: 

a.  Cognizant  technical  personnel  will  prepare 
a  memorandum  for  AIR-02E1.  This  memorandum 
will  set  forth  (1)  the  objective  of  the 
material  RID  program  to  be  accomplished, 

(2)  the  estimated  level  of  effort  required, 

(3)  a  list  of  the  information  required  to  be 
included  in  the  response,  (4)  how  the 
response  will  be  used  by  NAVAIR,  and  (5)  the 
time  when  response  is  due  in  NAVAIR. 

b.  AIR-02E1  will  prepare,  using  the  afore¬ 
mentioned  memorandum,  a  synopsis  for  publica¬ 
tion  in  the  Souices  Sought  section  of  the 
Department  of  Commerce  "Commerce  Business 
Daily"  (CBD) . 

c.  Cognizant  technical  personnel,  upon 
receipt  of  the  responses  to  the  CBD,  will  per¬ 
form  an  analysis  to  determine  which  response 
to  send  with  a  Procurement  Request  (PR)  to 
the  contract  group.  The  analysis  will 
address  (1)  the  techncial  merit  of  the  select¬ 
ed  approach,  (2)  the  experience  of  the  select¬ 
ed  source,  (3)  the  qualifications  of  the 
personnel  who  would  perform  the  work,  and  (4) 
the  areas  of  original  thinking  and  unique 
ideas  presented  by  the  selected  source  which 
cannot  be  divulged  to  other  sources.  If  the 
selected  source  is  not  the  only  source  found 
to  be  fully  qualified  thechnically  or  presents 
no  unique  ideas  that  are  the  product  of 
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original  thinking  then  this  system  shall  not 
be  pursued. 


DIRECTIONALLY  SOLIDIFIED  SHPERALLOYS  (NON 

eutectic) 


d.  Contract  Specialist  upon  receipt  of  a  PR 
with  a  selected  CBD  response  will  (1)  use  the 
CBD  response  as  a  base  for  negotiation  and 
request,  as  required,  any  additional  informa¬ 
tion  required  for  contracting  with  that 
source,  (2)  prepare  Request  for  Synopsis 
Memorandum  to  AIR-02F.1  setting  forth  under 
additional  information,  the  following  state¬ 
ment:  "The  Naval  Air  Systems  Command  intends 
to  negotiate  a  contract  with  the  above  firm. 
This  firm  submitted,  in  response  to  an  Advance 
Sources  Sought  Synopsis  in  the  Commerce 
Business  Daily  a  technical  response  containing 
unique  ideas  welch  were  the  product  of  orig¬ 
inal  thinking  and  which  cannot  be  divulged  to 
other  sources  or  was  the  only  response  found 
to  be  fully  qualified  technically,"  and  (3) 
negotiate  and  finalize  a  contract  with  the 
selected  source. 

e.  AIR-02E1  will  prepare,  using  the  Request 
for  Synopsis  Memorandum,  a  synopsis  for 
publication  in  CBD. 


LIMITATIONS  VO  PASS  SYSTEM 


The  PASS  System  shall  not  be  used  if: 

a.  the  "Material  R6D  Program"  can  be 
specified,  by  NAVAIR  without  outside  input,  in 
detail  sufficient  for  establishing  a  com¬ 
petitive  solicitation  with  optimum  established 
requirements  and  criteria  for  source  selection 
can  be  established; 

b.  other  than  scientific  manpower  directed 
toward  a  material  RED  objective  is  to  be  pro¬ 
cured; 

c.  the  resultant  contract  exceeds  $100K. 


The  Naval  Air  Systems  Command  is  planning  the 
procurement  of  one  and  a  quarter  nan-years 
of  effort  in  a  scientific  study  of  non¬ 
eutectic  superalloys  suitable  for  directional 
solidification  processing  into  high  tempera¬ 
ture  aircraft  gas  turbine  blading,  lnteres* 
is  in  investigating  compositions  which  have 
the  potential  for  highest  possible  material 
temperatures  consistent  with  acceptable 
balance  of  characteristics  desirable  in 
turhlno  blading,  such  as  oxidation- 
sulfidation  resistance,  ductility,  interme¬ 
diate  temperature  properties,  and  fabric- 
ability.  Interested  sources  are  invited  to 
submit  the  following  information  m  concise 
form:  (1)  The  proposed  approach  to  accom¬ 
plish  the  task  and  the  scientific  rationale 
on  which  the  approach  is  based  in  detail ; 

(2)  The  identity  of  the  scientific  personnel 
who  would  conduct  the  investigations  and  the 
qualifications  they  and  their  organization 
have  for  undertaking  this  work;  and  (3)  An 
estimate  of  the  cost  of  a  one  and  a  quarter 
man-year  effort.  Responses  will  be  evaluated 
to  determine  which  response  (1)  contains  the 
highest  technical  merit,  (2)  evaluates  to  be 
the  highest  technically  competent  source,  and 

(3)  evaluates  to  be  the  most  desirable 

response  to  pursue,  technical,  cost  and  other 
factors  considered.  The  Naval  Air  Systems 
Command  will  not  divulge  your  response  with 
anyone  outside  of  the  Government.  Since 
responses  will  contain  unique  ideas  and  will 
he  the  product  of  original  thinking,  only  the 
source  selected  for  contracting  with  will  be 
contacted  as  a  result  of  this  request.  The 
information  shall  he  furnished  to  the 
Commander,  Naval  Air  Systems  Command,  Depart¬ 
ment  of  the  Navy,  Washington,  B.  C.  20361, 
Attn:  AIR--  ,  within  four  weeks  of  the 
publication  of  this  notice.  Naval  Air 
Systems  Commend  Synopsis  No. _ . 


RESULTS 


a.  Interested  source  are  informed. 

b.  Expensive  technical  and  cost  proposals 
from  all  interested  sources  not  required. 

c.  Highest  technical  competent  source 
selected. 


d.  Negotiations  and  contracting  limited  to 
one  source. 
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CONTRACTING  UNDER  GRANTS:  THE  NEED  TO  DEFINE  THE  FEDERAL  ROLE 
Robert  D.  Newton 


THE  ISSUE 


The  issue  of  contracting  under  federal  grants 
needs  attention.  Policy  decisions  affecting 
this  issue  are  made  without  adequate  public 
discussion  of  their  implications.  The  issue 
involves  operational  and  legal  questions.  It 
also  involves  political  and  theoretical  ques¬ 
tions  of  the  proper  federal  and  non-federal 
roles  and  responsibilities  in  our  federal  sys¬ 
tem.  The  basic  questions  which  need  exploring 
are  those  of  accountability  and  responsibility. 
This  paper  will  explore  some  aspects  of  the 
basic  questions  in  the  hope  of  clarifying  the 
federal  role  in  contracting  under  grants. 


FEDERAL  PROCUREMENT-RELATED  INVOLVEMENT 


Procurement-related  involvement  by  federal 
agencies  is  occurring  in  grant  programs.  The 
Department  of  Transportation  and  the  Environ¬ 
mental  Protection  Agency  are  substantially 
involved  in  grant  transactions,  having  signifi¬ 
cant  contracting  under  them.  A  good  case  can 
be  made  that  large  dollar-amount ,  one-time 
procurements  for  complex  items  or  systems  un¬ 
der  grants  require  federal  lnvolvemei.  -.  or  fed¬ 
eral  control.  This  Involvement  or  control  la 
justified  in  the  name  of  accountability  for 
the  expenditure  of  federal  funds. 


FEDERAL  SYSTEMS  INVOLVEMENT 


The  promulgation  of  procurement  standards  in 
Attachment  "0"  to  OMB  Circulars  A-102  and 
A-110,  and  the  development  by  an  interagency 
task  group,  under  the  auspices  of  the  Office 
of  Federal  Procurement  Policy  in  OMB,  of  a 
detailed  procurement  standard  relying  on  con¬ 
cepts  and  distinctions  drawn  from  the  federal 
procurement  system  are  outcomes  of  federal  con¬ 
cern  for  adequate  procurement  end  project 
management  under  grants.  Such  standards,  by 
virtue  uf  establishing  a  procurement  system's 
requirement  in  the  grants  areas,  will  encour¬ 
age,  if  no’,  require,  all  federal  agenclss  to  be 
more  Involved  In  grantees'  projects  and 
activities.  Moreover,  because  tu.-  proposed 
procurement  standard  is  for  a  system  basin 
explicitly  on  concepts  from  the  federal  .; 
it  will  encourage  further  federal  involvement 
in  the  establishment  and  use  if  recipient 
procurement  systems. 


GAO  INVOLVEMENT 


Along  with  the  development  of  procurement 
standards  and  increased  federal  agency  involve¬ 
ment  procurements  under  grants,  Che  General 
Accounting  Otflce  has  established  s  protest  or 


complaint  procedure  under  which  it  will  advice 
on  protests  on  contracting  under  federal 
grants  This  hae  happened  because  of  the 
lack  of  procurement  experience  and  case  law  in 
the  states.  In  providing  advice,  GAO  draws  on 
federal  experience  in  procurement.  With  th..t 
comes  the  application  of  the  principles  of  fed¬ 
eral  procurement  law.  To  that  extent,  the  GAO 
protest  procadure,  like  federal  executive  agen¬ 
cy  involvement,  predispones  us  in  the  direction 
of  making  the  federal  procurement  system  a 
national  system. 


Wl’AT  SHOULD  THE  FEDERAL  ROLE  BE? 


There  is  more  at  Issue  here  than  procurement 
activities  under  grants.  Federal  involvement 
in  grantee  third  party  relationships  will  ef¬ 
fect  the  prime  relationships  between  the  fed¬ 
eral  agencies  and  grantees.  The  type  of  fed¬ 
eral  involvement  that  is  occurring  should  im¬ 
prove  the  management  of  some  activities  and 
projects.  But  unless  the  federal  role  is 
clearly  understood,  defined,  and  circumscribed, 
the  result  ia  likely  to  be  more  federal  in¬ 
volvement,  not  only  In  the  types  of  projects 
and  activities  in  which  it  is  desirable,  but 
also  in  other  types  of  assistance  projects  and 
activities,  the  conduct  or  management  of  which 
have  traditionally  been  the  responsibility  of 
recipients.  The  latter  can  happen  because  the 
complex  and  novel  projects  or  activities  in 
which  federal  intervention  may  be  desirable 
will  not  be  systematically  distinguished  from 
other  types  of  assistance  projects  or  activi¬ 
ties  in  which  it  may  not  be  desirable.  By 
affecting  all  grantee  procurement,  federal 
procurement-related  involvement  has  implica¬ 
tions  for  all  grant-type  assistance  relation¬ 
ships. 

The  issue  involves  the  need  to  define  the  fed¬ 
eral  role  with  respect  to  federal  procurement- 
related  involvement  and  the  use  of  federal  pro¬ 
curement  standards.  We  have  described  the  cur¬ 
rent  situation.  The  question  that  needs  an¬ 
swer  is  what  should  the  f-H&ral  role  be  with 
respect  to  contracting  ui.der  grants?  To  an¬ 
swer  this  question  it  is  necessary  to  consider 
the  broader  question  of  the  federal  role  in 
grant  programs.  Unless  the  latter  question  is 
dealt  with,  no  rtallatlc  answer  to  the  former 
is  rofslble. 


THE  PROLIFERATION  OF 
FEDERAL  GRANT'  REQUIREMENTS 


The  proliferation  of  federal  grant  programs  has 
been  accompanied  by  a  proliferation  of  federal 
grant  requirements.  It  is  these  requiremir.ee 
or  "strings''  which  most  exasperate  grantees. 
There  are  several  reasons  for  the  proliferation 
of  grsit  requirements.  The  proliferation  of 


♦National  Science  Foundation.  The  views  expressed  herein  ere  thote  of  the  author  and  not 
neeesearily  those  of  the  National  Science  Foundation. 
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novel  or  complex  federal,  programs  has  of  It¬ 
self  required  the  development  of  new  standards 
which  tend  to  draw  the  federal  agencies  Into 
new  Interactions  with  grantee*.  The  complexity 
ol  projects  haa  required  fed.vral  participation. 
Conniruet ton ,  damonstratlon,  applied  research, 
and  development  often  call  for  federal  oper¬ 
ational  Involvement  during  performance.  In 
add  It  Ion,  congressional  generation  of  new  pub¬ 
lic  policy  provisions,  which  are  now  generally 
applied  to  grants  as  well  as  contracts,  require 
fed  a  ml  Involvement  to  implement  them.  Final¬ 
ly.  there  la  another  rssson  more  difficult  to 
handle,  for  the  proliferation  of  requirement*: 
the  miphaiiis  on  accountability  fer  the  expen¬ 
diture  ,jf  federal  funds. 


FROM  A  FEDERAL  PERSPECTIVE: 
ACCOUNTABILITY 


Fro-  the  perspective  of  the  federal  bureaucrat, 
the  proliferation  of  requirements  is  plausible. 
Congresn  creates  a  program.  Rulea  are  eetab- 
liahe&.to  Implement  it.  A  problem  occur*  in 
Its  Implementation.  Something  must  be  done 
about  It,  A  clause  1*  prepared  elaborating  re¬ 
quirements  and  providing  for  federal  review  or 
approval.  Federal  involvement  is  thereby  in¬ 
creased.  It  la  Increased  to  Insure  that  the 
bureaucrats,  of  which  the  author  is  one  have 
met  their  rcaponalbilltlea  for  the  expenditure 
of  federal  fundn.  Inasmuch  as  the  personnel 
In  the  federal  agencies  are  crltlcired  by  Con¬ 
gress  or  CAO  when  something  goes  awry,  do  bu¬ 
reaucrats  have  any  choice  but  to  attach  the 
strings  necessary  to  Insure  accountability? 


FROM  A  RECIPIENT  PERSPECTIVE: 
INTERVENTION 


The  roverse  aide  of  the  coin  of  accountability, 
from  a  recipient  perspective,  Is  "Interven¬ 
tion.”  State  and  local  recipient*  of  federal 
grants  have  for  some  while  deplored  federal 
"Intervention."  But  It  Is  not  they  alone.  In 
s  recant  report  to  the  members  of  ths  Board  of 
Overseers,  the  President  f  Harvard  University 
repeatedly  uaed  the  tew  'intervention"  to  de¬ 
scribe  his  perception  of  the  federal  role  in 
the  relationships  of  the  university  with  fed¬ 
eral  agencies.  He  note*  that: 

the  rising  tide  of  government  Intervention 
hss  begun  to  provoke  serious  concern  from 
meny  college*  end  universities  .  .  .  In  e  few 
short  years,  universities  have  baan  incum¬ 
bered  with  a  formidablt  body  of  regula- 
tlons,  some -of  which  aaem  unnecaseary  and 
most  of  which  cause  confusion,  sdmlnistrt- 
tlve  expanse,  and  red  tape.  If  this  process 
continues,  hlR'nor  education  will  almost 
certainly  lose  some  of  the  Independence, 
the  flexibility,  and  the  diversity  that  have 


helped  It  to  flourish  in  the  past. 12) 

Recipients  of  federal  grant  awarde  tend  to  feel 
halploss,  victims  of  an  avalanche  or  require¬ 
ments  they  can  do  little  to  hold  back. 


INVOLVEMENT  OR  INTERVENTION? 


'■  ignlf  Leant  reeaon  why  involvement  is  In* 
r  .  a  singly  psrcelvtd  as  intervention  la  that 
i.u  newer  rsqulrsmente  Involve  the  establish¬ 
ment  of  various  kinds  of  systems  or  programs 
tn  Implement  them.  Establishing  an  ufflrmntlv. 
..'■.ion  program  Is  more  complicated  than  follow 
me,  wage  rates  established  by  Davlu -Ihicon  Act. 
Btcaus*  systems  requirements  ere  federal  re¬ 
quirements,  federal  officials  ars  the  experts 
on  the  hows  and  whys  of  compile 'ice.  Recipient 
bursaucraclss  are  built  to  match  federal  bu¬ 
reaucracies.  The  supposed  simple  procurement 
standard  In  Attachment  ”0"  of  OMB  Circulars 
A  102  end  A-110  and  the  proposed  detailed 
. .ubo ration  of  It  are  good  examples  of  lnclp- 
cr.t  "sysf.wns  Intervention."  To  take  a  simple 
Illustration,  the  basic  standard  requlras  com¬ 
petition.  But  the  concept  of  competition  in 
the  federal  procurement  experience  Is  complex. 

It  requires  the  elaboration  of  detailed  excop- 
cion*  for  permitting  "competitive  negotiation." 
It  aleo  Involve*  the  notion  of  the  "competitive 
range,”  which  hae  required  a  aerlcn  of  CAO  de¬ 
cisions  to  interpret  end  define.  If  a  federal 
ly  Imposed  standard  is  mandatory,  and  If  CAO 
holds  that  requirement*  once  impooed  must  be 
an  forced  grant  recipients  will  procure  In  n 
fashion  different  from  that  Implied  by  the  fed 
oral  system  only  *t  their  peril)"! 

Twenty-five  year*  ago  eosia  Institutions  of 
hightr  #<’  , cation  wars  concerned  that  accepting 
federal  grents  for  research  would  eventually 
lead  to  faderal  control  of  higher  education. 
Thle  argument  was  used  in  opposing ,1b*  creation 
of  the  National  Science  Foundation^5*  Since 
that  time  It  hae  generally  been  felt  that  the 
original  concerns  were  unwarranted.  Federal 
support  and  grantee  control  ere  compatible. 

If,  *o,  why  are  the  same  types  of  concerns  being 
expressed  with  Increasing  frequency  now?  Is 
whet  vee  feared  beginning  to  happen?  And  hap¬ 
pening  with  the  best  of  Intentions  as  a  result 
of  pressures  on  the  federal  agencies  for  ac¬ 
countability  for  the  expenditure  of  "faderal 
funds."  Federal  "Involvement"  In  grantee  sys¬ 
tems  mey  bs  becoming  federal  "Intervention." 


THE  CHANT  HAS  BECOME  A 

LEST  MEANINGFUL  ALTERNATIVE 


Our  federal  eystMi  1*  a  division  of  responsi¬ 
bilities  among  federal  snd  non-federsl  enti¬ 
tles.  In  establishing  snd  implementing  pro- 
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curomcnt  <i:td  assistance  relatlonslilps  we  make 
rcle  and  responsibility  decisions.  When  we 
elect  to  use  grants  '.ether  than  contracts,  we 
are  in  theory  making  choices  which  have  feder¬ 
alism  implications  and  whi«‘h  in  the  aggregate 
should  be  very  significant.  In  practice  they 
tend  not  to  be  very  significant  because  in 
federal/non-federal  relationships  the  term 
"grant"  has  lost  much  of  its  original  meaning. 
Grants  are  now  used  for  purposes  different 
from  those  for  which  they  were  originally 
used.  Instead  cf  clarifyl.g  respective  feder¬ 
al/non-federal  roles,  the  use  of  grants  often 
confuses  them.  A  giant  has  become  a  less 
meaningful  alte-nitive.  It  has,  thus,  become 
easier  to  proliferate  federal  requirements  and 
encourage  federal  intervention  in  the  name  of 
accountability.  Role  decisions  are  made  ad 
hoc  and  unsystematically. 

To  be  true  to  our  federal  system  we  should  be 
asking:  "How  do  we  decide  who  should  be 
doing  what  and  why?"  The  individual  federal 
bureaucrat  is  in  no  position  to  ask  that  ques¬ 
tion  systematically.  The  ornbler;  needs  in¬ 
stitutional  attention.  Uniesa  we  can  find 
ways  to  maintain  the  integrity  of  the  federal 
grant,  it  will,  like  the  DOD  airplane  which 
wes  continually  modified  to  accommodate  new 
technical  needs  to  the  point  it  was  too  heavy 
to  fly,  become  a  cumbersome  anachronism.  That 
could  have  unfortunate  effects  on  non-federal 
responsibilities  in  our  federal  system. 


THE  ARGUE  FOR  "ACTIVE"  OR 
"TOTAL"  FEDERAL  ACCOUNTABILITY 


The  use  of  grants  to  serve  substantially  dif¬ 
ferent  purposes  is  responsible  for  most  of  the 
present  confusion.  Precisely  because  of  this 
confusion,  the  use  of  grants  for  inappropriate 
purposes  has  been  accompanied  by  new  asser¬ 
tions  of  the  need  for  federal  accountability^ 
The  argument  for  active  federal  accountability 
is,  83  I  read  it,  first,  that  because  funds 
pass  through  the  federal  exchequer,  the  feder¬ 
al  agencies  are  responsible  for  their  expendi¬ 
ture;  and,  second,  the  agencies  must  Impose 
requirements  on  grantees  to  assure  accoun¬ 
tability.  Once  that  i e  done,  CAO  holds  that 
the  agencies  m^st  acti'-'uly  enforce  the  re¬ 
quirements. 

The  first  part  of  the  argument,  that  because 
funds  pass  through  the  federal  exchequer,  the 
federal  agencies  are  responsible  for  their  ex¬ 
penditure,  doss  not  wash.  It  is  a  principle 
that  need  not  be  applied  to  all  transactions 
or  relationships.  It  1s  not  applied  to  direct 
payments  to  individuals  or  to  general  revenue 
sharing.  Overeating  the  disbursement  of  fed¬ 
eral  funds  in  one  type  of  federal/non-federal 
relationship  is  one  thing.  It  does  not  follow 
thst  the  same  principle  needs  to  be  applied  to 
all  federal/non-federal  relationships  or  to  all 


recipient  disbursements. 

The  se> ond  part  of  the  argument,  that  because 
the  federal  agencies  are  accountable  for  the 
expend!  ure  of  puhlic  funds  in  assistance  pro¬ 
grams,  they  vuit  actively  assure  that  thoae 
funds  are  spent  effectively,  begs  the  question 
of  what  federal  responsibility  should  be. 

That  argument  is  made  without  effective  rebut¬ 
tal  because  no  :lear,  viable  operational  al¬ 
ternative  to  fi.-daral  involvement  is  being 
articulated. 


FEDERAL  ROLES  MUST  BF. 
ALTERNATIVELY  DEFINED 


The  -hiloaop'iy  of  federal  procurement  is 
clear.  It  rests  on  ultimate  federal  control 
of  the  acceptability  of  a  product  or  result. 
The  philosophy  of  federal  grants  is  less 
clear.  It  rests  on  recipient  responsibility 
in  keeping  with  federal  standards.  But  it  has 
been  confused  during  the  past  two  decades.  In 
many  grant  programs  enacted  in  the  1960s  Con¬ 
gress  asserted  a  direct  national  Interest  in  a 
large  range  of  functions  and  activities.  The 
Congress  Intended  that  the  federal  agencies 
Intervene  in  projects  end  activities  to  assist 
in  achieving  specified  national  objectives. 

The  Congress  realized  that  this  intervention 
would.entall  some  federal  supervision  and  con¬ 
trol;  ’  However,  neither  the  Congress  nor  the 
Executive  has  given  systematic  attention  to 
whit  federa'l/non-federal  roles  and  responsi¬ 
bilities  should  be,  namely,  who  should  be 
doing  what  spd  why.  There  is  no  federal  as¬ 
sistance  syutem  In  terms  of  which  systematic 
decisions  can  vadc  on  federal  .intervention 
or  involvement  or  ihs  lack  of  it:  '  If  we  are 
to  do  an  adequate  Job  of  managing  the  projects 
which  require  federal  Involvement,  while  re¬ 
ducing  red  tape  and  unnecessary  strtc^s  on 
those  that  do  not,  we  must  system* '. tally  al¬ 
low  for  a  passive  or  reduced  f ede; ,  .■  'c  in 

some  cases  and  an  active  or  increased  fed;,.  al 
role  In  ethers.  This  is  necesasry  to  reduce 
the  confusion  and  waste  that  exist. 


TYPES  OF  ACCOUNTABILITY 


Until  we  are  able  to  specify  when  federal  in¬ 
volvement  or  federal  control  should  occur  and 
clearly  distinguish  assistance  projects  in 
which  either  of  these  relationships  is  desired 
traditional  grant  projects  and  activities,  and 
procurement  relationships,  the  danger  that 
federal  involvement  or  csntrol  will  prolifer¬ 
ate  to  satisfy  the  pressures  which  incline  the 
federal  agencies  in  that  direction  will  remain. 
Most  assistance  relationships  do  not  require 
substantial  federal  involvement.  Few  require 
federel  control.  Whan  involvement  or  control 
is  required,  specific  agency  decisions  should 
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be  required.  We  need  a  practical  way  of  dif¬ 
ferentiating  between  the  federal  control  and 
federal  Involvement  required  In  some  projects 
and  programs  and  the  absence  of  federal  In¬ 
volvement  or  control  characteristic  of  the 
traditional  grant  relationship  If  we  ate  to 
systematically  manage  federal  in  -olveoent  and 
control,  we  need  to  define  them. 

We  need  a  range  of  types  of  accountability. 

We  have  full  federal  accountability  In  federal 
procurement  in  which  the  federal  agency  as¬ 
sumes  responsibility  for  specifying  a  product 
or  service  and  assuring  that  it  Is  produced 
and  delivered  or  provided  satisfactorily.  A 
similar  type  of  federal  accountability  or  con¬ 
trol  can  or  should  be  arranged  to  serve  some 
federal  assistance  purposes  or  objectives.  In 
some  assistance  projects  and  activities  we 
should  have  shared  ac^o;  ntabil *  y  in  which 
federal  officials  and  recipient  officials  par¬ 
ticipate  in  assuring  th-t  projects  or  activi¬ 
ties  are  .successful.  And  in  most  assistance 
projects  and  activities  we  should  have  grantee 
accountability  in  which  the  grantee  is  given 
clear  responsibility  for  performance  in  keep¬ 
ing  with  minimum  federal  standard)!. 

Alternative  types  of  accountability,  expressed 
in  termB  of  procurement  relationships  and 
three  types  of  assistance  relationships,  can 
be  defined  as  shown  on  page  6.'9' 

Theae  same  alternatives  can  be  expressed  dia- 
grammatically  and  related  to  agency  purposes 
and  methods  of  obtaining  proposals  as  shown  on 
page  >. 


IMPLICATIONS 


The  management  alternative#  or  types  of  ac¬ 
countability  we  have  outlined  are  workable 
and  provide  an  answer  to  the  question  of  what 
the  federal  role  should  be  with  respect  to 
contracting  under  federal  grants  .^'Federal 
involvement  and  control  should  occur  in  some 
cases  but  not  in  others.  Procurement-related 
Involvement  should  occur  only  in  assistance 
contract  or  cooperative  agreement  relation¬ 
ships  aad  in  a  way  consistent  with  the  rela¬ 
tionships  established.  t  should  not  occur 
under  grants,  which  she  .Id  entail  federal 
delegation  or  devolvement  of  decision-mal.i.,  , 
authority  to  2rantecs. 

Recognition  of  alternative  federal  and  non- 
federal  roles  also  suggests  a  way  to  handle 
procurement  systems  involvement.  Systems  in¬ 
volvement  is  not  transection-  or  project-ori¬ 
ented  and  cannot  be  introduced  selectively. 

■It  la  tctal  or  indiscriminate.  It  is  involve¬ 
ment  at  an  inatlcutlonal  level”2' It  is  incon- 
siatexr  with  the  little  or  no  involvement  ap¬ 
propriate  for  greet  projects  end  programs.  To 
Introduce  procurement  standards  for  all  giants 


or  other  assistance  agreements,  as  is  done  in 
A-102  and  A-110,  is  improper  because  it  is  not 
selective,  but  indiscriminate.  Federal/nun- 
federal  relationships  on  systems  questions  re¬ 
lating  to  the  management  of  assistance  pro¬ 
jects  and  activities  should  be  established  only 
at  an  institutional  level,  not  at  the  project 
or  activity  level.  There  should,  for  example, 
be  federal  executive  branch  negotiations  on 
systems  questions  with  representatives  of  In-  • 
stitutions  or  aggregates  of  institutions. 

That  would  tend  to  insure  parity  of  negotiating 
strength  so  that  federal  systems  involvement 
would  occur  as  technical  assistance  to  improve 
non-federal  systems  that  are  used  in  achieving 
national  obiectivea. 

We  have  concluded  that  to  rationalize  pro¬ 
curement-related  federal  involvement  there 
is  a  need  to  institute  a  system  of  alterna¬ 
tive  federal  and  non-federal  roles  reflecting 
alternative  federal  procurement  and  assis¬ 
tance  relationships.  Such  a  system  will  per¬ 
mit  and  require  controlling  involvement.  Fed¬ 
eral  Involvement  does  not  need  to  become  in¬ 
tervention,  the  unnecessary  proliferation  of 
federal  requirements.  Accountability  can  be 
defined  differentially,  reducing  pressure 
for  federal  officials  to  Intervene.  Pressure 
to  Intervene  has  Increased  because  the  grant 
alternative  is  not  well  defined.  The  grant 
has  become  operationally  meaningless  in  many 
federal  agencies.  That  in  turn  increases 
pressures  for  accountability.  This  vicious 
circle  can  be  broken.  It  can  be  broken  by 
defining  the  grant  in  a  way  that  requires 
separating  projects  and  programs  requiring 
significant  federal  Involvement  from  those 
which  do  not.  This  requires  institutional 
change,  not  just  tinkering  or  ad  hoc  adjust¬ 
ments  by  some  federal  agencies.  The  Congress 
and  the  Executive  must  take  the  initiative. 
Until  they  do,  confusion  such  as  that  over 
procurement-related  involvement  will  remain. 


(1)  Notice  given  in  Federal  Register  Septem¬ 
ber  12,  1975. 

(2)  Derek  Bok,  "Harvard  University:  The  Pre¬ 
sident's  Report,  1974-1975,"  delivered 
January  10,  1976,  pp.  4  and  22-23. 

(3)  Sec,  for  example,  GAC  Decision  B-185790, 
July  9,  1976,  Griffin  Construction  Company 
which  states  ”...  unless  a  grantor  takes 
such  actions  as  clrcumscanccs  Indicate 
are  necessary  to  assure  compliance  with 
conditions  it  imposes  upon  grantees,  there 
will  be  no  guarantee  that  what  the  agency 
requires  to  carry  out  congrv."  •  al  pur¬ 
poses  will  be  met." 
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(4)  The  practical  problem  here  may  be  one  of 
hou  to  transmit  the  essence  of  the  federal 
system  to  recipients  of  federal  awards 
without  the  paperwork  and  bureaucracy  that 
accompany  the  federal  system. 

(5)  See  Milton  Lomask,  A  Minor  Miracle,  An 
Informal  History  of  the  National  Science 
foundation,  Ch.  3,  "Old  Fears  and  New 
Ideas,"  Washington,  D.  C.,  GPO,  1976. 

(6)  See  Thomas  J.  Madden,  Providing  an  Ade¬ 
quate  Remedy  for  Disappointed  Contractors 
Under  Federal  Grants-in-Aid  to  Stites  and 
Units  of  Local  Government,  Federal  Bar 
Journal,  Vol.  34  (1975),  pp.  201-228. 

(7)  See  James  L.  Sundquist  and  David  W.  Davis, 
Making  Federalism  Work,  Washington,  D.C., 

The  Brookings  Institution,  1969. 

(8)  A  framework  for  a  federal  "grants"  system 
was  proposed  by  the  U.3.  Commission  on 
Government  Procurement  in  its  Report  of  the 
Commission  on  Government  Procurement,  Vol. 

3,  Tart  F,  "Federal  Grant-Type  Assistance 
Programs"  (Washington,  D.C. ,  GPO,  December 
1972).  The  basic  Procurement  Commission 
grant  concepts  are  discussed  in  Robert 

D.  Newton,  "Towards  an  Understanding  of 
Federal  Assistance,"  Public  Administration 
Review,  Vol.  35,  No.  4  (July/August  1975), 
pp.  372-377,  and  elaborated  in  Administra¬ 
tive  Federalism,  to  be  published  in  Public 
Administration  Review. 

(9)  Legislation  embodying  these  concepts  was 
introduced  by  Congressman  Frank  Horton, 
Chairman  of  the  U.S.  Commission  on  Federal 
Paperwork,  on  January  6,  1977.  See  Cong. 
Chiles,  Glenn,  Hathaway,  McIntyre,  Muskie, 
Nunn,  Percy,  Roth  and  Weicker  on  January 
25,  1977.  See  Cong.  Rec.  for  January  25, 
1977,  p.  E-S3.  Identical  legislation  was 
passed  by  the  94th  Congress  in  October, 
1976,  but  was  vetoed  by  President  Ford  on 
the  premise  that  the  concepts  or  some 
variation  of  them  could  be  implemented 
administratively. 

(10)  The  Energy  Research  and  Development 
Administration  and  the  National  Science 
Foundation  have  proposed  to  implement  these 
concepts. 

(11)  The  approach  suggested  also  has  implica¬ 
tions  for  grantee  financial  systems  end 
the  federal  audit  role.  Should  grantees 
be  required  to  have  the  sane  types  of  cost 
accounting  systems  as  industrial  contrac¬ 
tors?  Should  the  federal  audit  role  be  the 
same  for  procurement  contracts,  assistance 
contracts,  cooperative  agreements  and 
grants?  Should  there  be  during  performance 
evaluative  and  financial  audit  of  contract, 
cooperative  agreement  and  assistance 
contract  projects  and  activities  and  after- 
the-fact  or  delegation  of  audit  on  grants 


with  negotiations  on  needed  systems  con¬ 
ducted  at  an  institutional  level? 

(12)  Of  course  a  contractor  with  many  federal 
contracts  muy  prefer  (systems  approval  in 
lieu  of  the  review  and  approval  of  indi¬ 
vidual  transactions.  The  important  point 
with  respect  to  federal  assistance  is  that 
that  choice  should  be  a  recipient  choice 
and  not  federally  imposed  as  is  now  the 
case. 
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Program  Management  Alternatives 


PROCUREMENT 

CONTRACT 


ASSISTANCE 

CONTRACT 


COOPERATIVE 

AGREEMENT 


CRANT 


FEDERAL 

ROt.E 


"Purt’nscr" 


PRIMARY 

RESPONSIBILITY 


Foltfr.il 


2.  "Manager"  of  some 
assistance  tclationslups 

Federal 


3.  "Partner"  or  "Active 
Supporter" 

Shared 


4.  "Patron"  or  "Passive 
Supporter" 


Recipient 


I YPE OF  FEDERAL 
INVOLVEMENT 


Wholes  er  insolvement 
is  necessary  consistent 
itiili  Federal  Procure' 
ment  Regulations 


Whatever  involvement 
is  netessarv 


Substantial  manage¬ 
ment  or  technical 
involvement  during 
peiloimanre  on  specific 
decisions,  snbawards, 
provision  of  guidance 
or  technical  assistance, 
or  collaboration 


Federal  delegation  or 
devolvemcnt  of 
dec's'  as  and  approvals 


RIGHT  1  0 
REDIRECT  OR 
Cfl  \NGE  WITHIN 
SCOPE 


Unilateral  Federal  right 
to  change  or  redirect 


Unilateral  Federal  right 
to  change  or  redirect 


Recipient  right  to 
change  or  redirect, 
subject  to  Federal 
ads  ice.  assistance, 
pci  suasion,  or 
concurrence 


Recipient  right  to 
change  or  redirect 


Methods  of  Obtaining  Proposals  and  Program IManagement  Alternatives 
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THE  RELATIONSHIP  BETWEEN  THE  FEDERAL  GRANT  AND  COOPERATIVE  AGREEMENT  ACT 
AND  THE  FEDERAL  ACQUISITION  ACT 

Paul  Barron 

Sterling  Institute  (DAC) 


INTRODUCTION 

Tills  article  addresses  the  relationship  be¬ 
tween  the  Federal  Grant  and  Cooperative  Agree¬ 
ment  Act  and  the  Federal  Acquisition  Act  of 
1977  (S.1264)  and  implications  of  the  Federal 
Grant  and  Cooperative  Agreement  Act  of  1977 
for  the  promotion  of  technological  innovation. 


THE  FEDERAL  GRANT  AND  COOPERATIVE 
AGREEMENT  ACT  (P.L.  95-224) 

The  "Federal  Grant  and  Cooperative  Agreement 
Act  of  1977"  has  now  become  law.  It  provides 
disciplined  criteria  for  uae  of  contracts, 
grants,  and  cooperative  agreements  and  pro¬ 
vides  for  an  OMB  Study  to  determine  the  fea¬ 
sibility  of  providing  guidance  in  the  field  of 
Federal  assistance.  It  also  provides  OMB 
authority  to  establish  additional  criteria  for 
the  use  and  application  of  administrative  in¬ 
struments  in  different  situations. 


THE  FEDERAL  ACQUISITION  ACT  OF  1977  (S. 12691 

The  "Federal  Acquisition  Act  of  1977,"  S.1264, 
if  enacted,  will  provide  a  totally  new,  single 
statutory  basis  for  the  total  acquisition  pro¬ 
cess.  If  it  did  this  alone,  it  would  be  a 
major  achievement.  However,  it  does  much  more 
than  this.  Since  it  emphasizes  policy  rather 
than  procedural  detail,  it  provides  broad  lat¬ 
itude  to  the  Office  of  Federal  Procurement 
Policy  in  OMB  to  Improvise,  to  test  new  proce¬ 
dures  and  techniques  in  the  acquisition  pro¬ 
cess.  Thus,  it  provides  a  new  range  of  op¬ 
tions  or  opportunities  for  program  implementa¬ 
tion  within  the  acquisition  process. 

As  a  result,  the  Federal  Acquisition  Act 
broadens  the  utility  of  the  contract  as  an 
administrative  instrument  to  reflect  desired 
roles  and  relationships  of  parties.  Under  the 
Federal  Acquisition  Act  of  1977,  if  enacted, 
one  could  use  a  wide  variety  of  contracting 
devices  under  that  Act  or  if  the  element  of 
assistance  is  involved,  can  go  to  the  use  of 
a  cooperative  agreement,  with  a  wholly  differ¬ 
ent  set  of  accountability  features  and  con¬ 
trols,  or  can  go  the  grant  rout:  where  the 
flavor  of  the  assistance  transaction  contem¬ 
plates  little  Federal  involvement. 


Agencies  which  now  use  contracts  to  achieve 
some  of  the  purposes  that  are  better  suited  for 
cooperative  agreements  now  have  a  broader 
choice  of  program  implementing  options  as  a 
result  of  the  enactment  of  the  Federal  Grant 
and  Cooperative  Agreement  Act. 

John  H.  Young  of  the  Office  of  Technology  As¬ 
sessment,  in  his  article  entitled  "Inpl ications 
of  the  Federal  Grant  and  Cooperative  Agreement 
Act  of  1977  for  the  Applications  of  RAD  in  the 
Civil  Sector,"  beautifully  articulates  the 
range  of  new  options  under  that  statute,  namely 
P.L.  95-224  (S.431). 

He  points  out  that  the  major  advances  in  re¬ 
search  and  development  occurred  through  the 
acquisition  process  in  fields  such  as  the  Atom¬ 
ic  Energy,  and  the  Space  Program,  and  that  a 
number  of  projects  were  developed  to  promote 
the  transfer  of  the  new  technology  from  those 
programs  to  the  civil  sector.  However,  the 
success  of  these  technology  transfer  programs 
has  been  limited  insofar  as  utilization  of  such 
technology  in  meeting  research  and  development 
needs  of  the  civil  sector. 

His  article  addresses  the  subject  of  research 
and  development  to  promote  technological  in¬ 
novation  in  the  civil  sector,  that  is,  bring 
to  practical  application  and  commercial  util¬ 
ization,  new  technology  needed  to  meet  civil 
sector  needs. 


OBTAINING  THE  COMMITMENT  OF  PRIVATE  RESOURCES 

Young  points  out  that  one  of  the  primary  dis¬ 
tinguishing  features  of  trying  to  Introduce 
technological  innovation  into  practical  civil 
sector  applications,  is  the  requirement  that 
organizations  In  the  private  sector  commit 
skills,  management,  resources  and  funds  to  ac¬ 
complishment  of  the  objective.  Their  willing¬ 
ness  to  do  that  depends  upon  motivations  in¬ 
herent  in  our  competitive  system,  and  there¬ 
fore,  the  techniques  used  by  the  Federal  Gov¬ 
ernment  for  research  and  development  in  the 
acquisition  process  to  meet  "Government"  needs 
is  not  suitable  for  and  cannot  be  applied  to 
bringing  technological  Innovation  into  actual 
commercial  application  in  the  civil  sector. 
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Young  points  out  that  the  Federal  Government 's 
role  In  promoting  to  actual  fruition  techno¬ 
logical  innovation  in  the  civil  sector,  is  more 
nearly  that  of  ''partner"  and  the  arrangement 
between  the  Federal  Government  and  non-Federal 
parties  is  more  in  the  nature  of  a  Joint  ven¬ 
ture.  Consequently,  many  of  the  elements  of 
accountability  and  controls  in  contracting 
under  chc  acquisition  process  would  have  no 
realistic  application  or  appeal  under  a  joint 
venture  arrangement.  This  is  because  the  pri¬ 
vate  sector  member  must  utilize  fie  mechanisms 
that  he  employs  on  a  day-to-day  basis  in  making 
decisions  and  in  managing  projects  within  the 
entrepreneurial  framework. 

He  illustrates  this  point  by  reference  to  the 
possible  different  treatment  that  patent  rights 
may  require  ,n  connection  with  a  cooperative 
agreement  to  promote  civil  sector  objectives 
such  as  the  development  of  commercially  feasi¬ 
ble  energy  process.  The  unilateral  right  to 
change  direction  or  to  terminate  would  take  on 
a  less  acceptable  flavor,  he  points  out.  In  the 
environment  of  a  joint  enterprise.  This  was 
also  pointed  out  in  an  article  by  the  EF.DA 
Deputy  General  Counsel,  Leonard  Rawlcz,  de¬ 
scrib'd  In  the  concept  paper  on  cooperative 
agreements,  elsewhere  In  this  Symposium. 

John  Young  also  points  out  one  distinguishing 
feature  of  Innovation  goals  for  the  private 
sector.  The  fact  that  the  nor.-Federal  parties 
who  have  the  capacity  and  Incentive  to  deliver 
the  goods  and  services  fiv,a  which  the  public 
will  benefit,  will  be  involved  in  the  delivery 
of  such  goods  and  services  long  after  Federal 
support  and  involvement  comes  to  an  end.  And, 
of  course  that  Is  the  very  purpose  of  the  Fed¬ 
eral  involvement,  to  promote  the  commercial 
utilization  and  the  ultimate  disengagement  of 
the  Federal  Government  from  participation  in 
the  project. 

The  Young  article  further  points  out  that  the 
Federal  Grant  and  Cooperative  Agreement  Act 
expresses  no  policy  preference  ns  to  whether 
there  should  be  more  or  less  Federnl  Involve¬ 
ment  or  control  In  assistance  relationships. 
RuEher,  it  establishes  a  framework  of  relation¬ 
ships  Chat  requires  explicit  delineation  of 
Federal  and  non-Federal  roles  and  responsibili¬ 
ties. 


GUIDELINES  FOR  CONGRESS  IN  REVIEWING 
PROGRAM  IMPLEMENTATION 

Young's  discussion  is  particularly  useful  in 
that  It  provides  guidelines  for  the  Congress 
to  consider  in  reviewing  activities  of  execu¬ 
tive  agencies  for  the  purpose  of  determining 
whether  the  provisions  of  the  Federal  Crant  ar.d 
Cooperative  Agreement  Act  arc  being  effectively 
implemented. 


For  example,  he  poses  several  questions  for 
the  purpose  of  such  guidelines:  Is  the  dis¬ 
tinction  clearly  drawn  between  (1)  generating 
new  knowledge  to  expand  the  range  of  techno¬ 
logical  options,  and  (2)  fostering  specific 
technological  innovations?  This  question 
would,  of  course,  disclose  whether  an  agency 
has  given  full  thought  to  the  roles  and  rela¬ 
tionships  and  '.he  type  of  administrative  in¬ 
strument,  and  the  accountability  and  controls 
necessary  to  bring  about  technological  innova¬ 
tion  and  its  commercial  utilization  in  the 
private  sector  (as  distinguished  from  simply 
developing  new  technology  and  leaving  it 
banging) . 

Another  guideline  question  ha  poses  for  Con¬ 
gressional  utilization  Is:  Are  the.Fedcra’ 
and  non-Federal  roles  and  responsibilities 
appropriate  to  assistance  relationships  re¬ 
flected  in  the  use  of  alternative  legal  in¬ 
struments?  Here  he  points  out  thnt  assistance 
•■ela'tionships ,  such  as  under  a  cooperative 
agreement,  imply  a  cooperative  effort  in 
achieving  a  common  goal;  that  such  goals  lie 
be. olid  the  limited  period  of  Federal  involve¬ 
ment  and  support.  The  introduction  of  the 
cooperative  agreement,  now  available  on  a 
Government-wide  basis,  provides  a  means  for 
sharing  responsibility  with  non-Federal  par¬ 
ties  while  retaining  the  degree  of  Federal 
Involvement  necessary  to  achieve  public  policy 
objectives. 

Another  question  posed  by  Young  for  utiliza¬ 
tion  by  Congress  in  the  review  of  implementa¬ 
tion  of  the  Federal  Grant  and  Cooperative 
Agreement  Act:  Is  the  potential  of  a  uniform 
Government-wide  framework  for  systematically 
learning  which  program  Inputs  achieve  the 
desired  program  outputs,  being  fully  exploited 
by  executive  agencies? 

This  question,  for  example,  would  also  be  uti¬ 
lized  by  0MB  in  learning  on  a  Government-wide 
institutional  basis,  which  arrangements  work 
and  which  do  not,  and  therefore  offers  the 
opportunity  for  providing  guidance  In  delinea¬ 
ting  role3  and  responsibilities  and  the  proper 
administrative  Inscrutents  to  reflect  those 
roles  and  responsibilities. 


CONCEPTS  IN  THE  APPl  '.CATION  OF  ASSISTANCE 
DOLLARS  TO  PROFIT-  .AXING  ORGANIZATIONS 

Another  aree  of  discussion  in  the  Young  paper 
is  the  fact  that  under  the  Federal  Grant  and 
Cooperative  Agreement  Act,  Federal  assistance 
oav  be  provided  to  privace  sector  profit- 
caking  organization :.  A  good  illustracicn  of 
this  would  be  the  use  of  cooperative  agree¬ 
ments  on  demonstration  pti facts  where  the  or¬ 
ganizations  able  to  bring  such  presets  to 
commercial  utilization  would  normally  be 
proflc-nsklng  organizations. 
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He  points  out  the  need  to  assure  that  the  dis¬ 
tribution  of  such  assistance  Is  on  an  equitable 
and  competitive  basis;  that  such  assistance 
must  be  provided  In  such  manner  as  to  equitably 
and  competitively  achieve  the  public  goals  at 
the  same  time  that  the  private  profit-making 
organization  Is  in  pursuit  of  its  normal  profit 
objective. 

Young  uses  an  intriguing  scenario  in  which  the 
Treasury  Department  entered  into  various  kinds 
of  transactions  including  both  procurements  and 
cooperative  agreements  to  achieve  a  civil  sec¬ 
tor  objective,  in  this  case,  the  development  of 
computer-aided  coding  programs  to  handle  bearer 
bond  indebtedness  by  cities.  This  was  done  es¬ 
sentially  through  analysis  of  why  the  ordinary 
market  forces  in  the  entrepreneurial  system  it¬ 
self  were  not  producing  the  needed  technology 
and  then  constructing  the  environment  in  which 
the  entrepreneurial  sector  was  motivated  to 
achieve  this  objective  through  catalytic  use  of 
some  R&D  funds  of  the  Treasury  Department. 

Young  points  out  that  one  of  the  key  problems 
here  is  to  take  a  civil  sector  R&D  problem, 
such  as  a  State  or  city  problem,  and  get  It 
placed  on  the  R&D  agenda  of  a  Federal  agency. 
These  civil  sector  problems  tend  to  fall  be¬ 
tween  the  crevices  of  the  mission  mandates  of 
agencies.  He  points  out  that  this  situation 
may  turn  out  to  be  a  fundamental  limitation  on 
the  effectiveness  of  the  Federal  R&D  policy 
tool. 


CATALYTIC  ROLE  OF  THE  FEDERAL  ACQUISITION  ACT 
IN  PROMOTING  TECHNOLOGICAL  INNOVATION 

At  this  point,  it  is  interesting  to  observe, 
under  the  proposed  "Federal  Acquisition  Act," 
that  there  would  now  be  introduced  a  basic  pol¬ 
icy  and  objective  of  the  acquisition  process 
itself  to  promote  technological  Innovation  and 
to  encourage  the  admission  into  the  field  of 
new  businesses  and  small  businesses  and  the  pro¬ 
motion  of  the  interests  of  minority  business 
enterprises,  as  well.  The  point  is  that  S.1264 
puts  the  entire  multibillion  dollar  acquisition 
process  squarely  behind  technology  innovation, 
with  all  the  implications  for  collateral  assis¬ 
tance  to  civil  sector  needs. 

It  is  not  too  great  a  stretch  to  perceive  the 
possibility  of  employing  the  new  technology  and 
Innovation  objectives  of  the  Federal  Acquisition 
Act,  as  a  means  of  promoting  research  and  t 
velopment  in  the  civil  sector,  as  an  adjunct  to 
P.L.  95-224,  broadening  program  implementation 
alternatives  still  further. 

This  objective  of  the  Federal  Acquisition  Act 
also  directly  carries  out  recommendations  of  the 
Commission  on  Government  Procurement,  that  ail 
executive  agencies  promote  research  and  develop¬ 
ment  in  areas  related  to  their  basic  mission. 


It  would  appear  possible  that  agencies,  in 
looking  at  their  own  direct  missions  can  iden¬ 
tify  problem  areas  in  the  civil  sector  requir¬ 
ing  technological  innovation  that  tie  in  clos- 
ly  with  their  own  missions.  Conversely,  the 
civil  sector  could  identify  R&D  needs  as  can¬ 
didates  for  matching  with  related  Federal  mis¬ 
sion  R&D  needs.  The  type  of  R&D  inventory 
work  done  by  NSF  might  be  helpful  here. 

Such  collateral  research  and  development  ob¬ 
jectives  so  identified  could  then  be  factored 
into  each  executive  agency  overall  program. 

While  this  might  result  in  some  modest  broad¬ 
ening  of  executive  agency  missions,  and  with 
some  cost  implication,  it  would  appear,  In 
view  of  the  stated  policy  objectives  of  the 
Federal  Acquisition  Act  of  1977  that  such 
agency  matching  of  missions  with  civil  sector 
innovation  needs  would  be  consistent  with  the 
objectives  of  that  Act,  and  would  promote  the 
recommendation  of  the  Commission  on  Government 
Procurement  m  regard  to  research  and  develop¬ 
ment  in  support  of  agency  missions. 


THE  TWO  STATUTES  PROVIDE  COMPLEMENTARY  AND 
UNIFYING  PROGRAM  IMPLEMENTATION  POTENTIAL 

The  point  here  is  that  the  Federal  Acquisition 
Act,  together  with  the  Federal  Grant  and  Co¬ 
operative  Agreement  Act  provide  a  broad  basis 
for  program  implementation  under  the  control 
of  the  Office  of  Management  and  Budget. 

This  means  that  the  total  range  of  authorities 
for  effective  program  implementation  are  now 
brought  together  at  a  single  point  in  the  Gov¬ 
ernment  with  control  over  policy  and  the  abil¬ 
ity  effectively  to  promote  improvement  in  both 
the  acquisition  and  assistance  processes. 

The  opportunity  to  broaden  the  mode  of  program 
implementation  within  the  acquisition  process 
by  the  use  of  contracts  under  S.126&  is  pro¬ 
vided  by  some  of  the  provisions  of  the  Federal 
Acquisition  Act  which  permit  waiver  of  certain 
controls,  subject,  to  the  criteria  set  out. 

This  provision  for  waiver  of  certain  require¬ 
ments  in  effect  provides  options  within  the 
acquisition  process  to  reflect  different  roles 
and  responsibilities  appropriate  to  the  par¬ 
ticular  undertaking. 

Thus,  the  two  statutes  S.1264  and  Public  Law 
95-224,  taken  together,  provide  a  broad  range 
of  administrative  instruments  and  provide  for 
different  levels  of  accountability  and  control 
to  reflect  the  roles  and  relationships  between 
the  Federal  Government  and  non-Federal  parties 
that  are  needed  for  the  prrticular  objectives 
and  strategies  involved. 


THE  SINGLE  FOCAL  POINT 

Another  very  important  factor  in  the  relation¬ 
ship  of  S.1264  and  P.L.  95-224  is  the  fact  that 
both  laws  would  be  under  the  control  and  imple- 
mentational  jurisdiction  of  the  Office  of  Man¬ 
agement  and  Budget.  Thus,  for  the  first  time 
che  entire  process  of  examining  and  dealing 
with  effective  program  implementation  alterna¬ 
tives  would  be  brought  into  focus  at  a  single 
point  within  the  Government  hierarchy,  the 
point  at  which  budgeting  control  may  also  be 
applied. 

This  new  linkage  of  program  implementation  con¬ 
trols  and  budget  controls  in  the  Executive 
Branch  has  potential  of  historic  proportions. 


PROCUREMENT  EXPERIMENTATION  IN  THE  FOREST  SERVICE 


Norman  Anderson,  Boise  Interagency  Fire  Center 
John  E.  S.  Lawrence,  Research  Triangle  Institute 


ABSTRACT 


Cooperative  efforts  by  the  U.S.  Forest  Service 
and  the  Experimental  Technology  Incentives  Pro¬ 
gram  of  the  U.S.  Department  of  Commerce,  National 
Bureau  of  Standards,  have  resulted  in  procurement 
experiments  usinq  incentives  to  private  industry 
for  the  manufacture  of  Innovative  products.  The 
advantages  of  such  procurements  to  the  USFS  are 
in  obtaining  specialized  equipment  not  readily 
available  in  the  commercial  market,  and  particu¬ 
larly  in  passing  on  some  of  the  costs  of  related 
RSD  to  the  private  sector.  The  knowledge  gain 
to  the  National  Bureau  of  Standards  lies  in  the 
comparison  of  effects  of  various  incentives  across 
different  product  types  and  procurement  environ¬ 
ments.  Using  a  case  study  approach,  within  a 
conceptual  framework  facilitating  subsequent 
generalization  of  results  across  aqencles,  a 
single  experiment  is  described,  from  identifica¬ 
tion  of  agency  need,  through  commitment  of 
resources,  development  of  prototype  specifica¬ 
tions,  choice  of  manufacturer,  delivery  of  the 
prototype,  and  field  test  and  evaluation,  to 
the  attainment  of  a  satisfactory  product. 
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PROCUREMENT  POLICY  IMPLEMENTATION  -  CASE  STUDY  OF  THE  LEAD  AGENCY  APPROACH 


Floyd  Lewis,  Stanford  Research  Institute 
Allen  Beres,  General  Services  Administration 


ABSTRACT 

A  life  cycle  costing  (LCC)  can  result  in  dollar 
and  energy  savings  for  the  Government  when  used 
as  a  method  for  the  procurement  of  equipment. 

The  Federal  Supply  Service  (FSS)  has  been  named 
as  the  lead  agency  in  sponsoring  the  use  of 
LCC  for  this  purpose  throughout  the  Government. 
The  current  phase  of  the  FSS  approach  involves 
the  design  of  an  appropriate  mechanism  for  the 
sponsoring  of  Government-wide  use  of  LCC.  To 
tins  end.  parties  of  interest  will  soon  be 
contracted  to  ootain  their  input  into  the  design 
process. 
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PROCURING  SYSTEMS:  EXPERIENCES  PROM  CIVILIAN  AND  DEFENSE  AGENCIES 


Charles  W.  N.  Thompson,  Northwestern  Universit' 


INTRODUCTION 


The  purpose  ot'  this  paper  Is  to  describe  some 
of  the  lessons  learned  (and  being  learned)  In 
the  process  of  procuring  a  special  kind  of  sys¬ 
tem  called  an  "evaluation  system."  This  des¬ 
cription  draws  not  only  upon  the  experience 
with  the  specific  system  but  also  prior  experi¬ 
ence  with  the  procurement  of  several  military 
subsystems  which,  although  hardware  systems, 
presented  comparable  problems.  The  experience 
with  military  systems,  and  reference  to  the 
literature,  is  used  to  provide  a  context  within 
which  the  special  problems  of  procuring  evalua¬ 
tion  systems  can  be  observed.  This  context  is 
presented  in  the  form  of  a  set  of  dimensional 
characteristics  of  systems  and  a  set  of  strate¬ 
gies  particularly  appropriate  to  evaluation 
systems. 

The  evaluation  system  which  is  the  focus  of 
this  paper  is  being  procured  by  the  Experimen¬ 
tal  Technology  Incentives  Program  (ET1P)  , 
National  Bureau  of  Standards,  to  provide  a  con¬ 
tinuing  capability  to  evaluate  the  results  of 
procurement  experiments  designed  to  meet  the 
objectives  of  both  ET1P  and  the  several  federal 
procurement  agencies  with  which  ET1P  is  coop¬ 
erating.  Discussion  of  these  procurement  ex¬ 
periments  is  being  presented  by  other  speakers 
at  this  session.  At  the  present  time,  the 
evaluation  system  is  in  the  process  of  devel¬ 
opment  end  test  of  the  prototype,  the  second  of 
three  phases. 

Although  Intended  primarily  to  meet  the  need  to 
procure  an  evaluation  system,  the  process  used 
to  procure  the  system  was,  in  itself,  an  "ex¬ 
periment,"  and  is  reported  more  fully  elsewhere 
[14]  [15].  This  experimental  nature  of  systems 
procurement  is,  perhaps  not  unexpected,  and  it 
has  been  observed  that  procurement  of  systems 
is  still  undergoing  experimentation,  at  least 
in  a  trial  and  error  sense  [1:577,  585].  As  an 
experiment  itseli,  the  process  by  which  the 
evaluation  system  is  being  acquired  and  re¬ 
lated  processes  are  being  more  formally  exam¬ 
ined.  It  is  hoped  that  these  more  formal  ex¬ 
aminations  will  describe  the  process  and  the 
results  obtained,  and,  more  generally,  related 
processes  for  the  design  of  systems. 

The  primary  focus  of  the  remainder  of  this 
paper  will  be  to  describe  the  problems  present¬ 
ed  in  acquiring  an  evaluation  system  which  is 
"administratively  implementable"  [6],  In  order 
to  relate  the  problems  (and  solutions)  here  to 
those  more  generally  presented  in  the  procure¬ 
ment  of  other  systems,  a  set  of  dimensions 
which  characterize  differences  among  systems 
will  be  presented,  following  which  specific 
strategies  used  or  proposed  In  the  acquisition 


of  the  evaluation  system  will  be  described. 


CHARACTERISTIC  DIMENSIONS  OF  SYSTEMS 

At  least  since  the  1950' s  the  procurement  of 
systems  has  been  recognized  as  introducing 
problems  in  addition  to  those  presented  by  the 
procurement  of  other  products  and  services. 
These  problems  occur  throughout  the  procure¬ 
ment  process — in  defining  the  system,  choosing 
the  contractor,  developing  (and  producing)  the 
system,  and  putting  it  into  une  (implementa¬ 
tion)  .  One  way  to  examine  these  problems  is 
to  look  at  the  underlying  structure  of  systems 
[5:4]  [18:239]  to  identify  ways  in  which  they 
differ.  In  this  section,  systems  will  be  des¬ 
cribed  in  terms  of  some  selected  characteris¬ 
tic  dimensions. 

Systems  tend  to  have  in  common  three  charac¬ 
teristics  which  set  them  apart  from  other  pro¬ 
cured  products  and  services.  They  are  large, 
they  are  complex,  and  they  take  a  long  time  to 
acquire.  These  characteristics  require  a 
large  number  of  people  with  diverse  skills  and 
interests  to  work  together  over  a  long  period 
of  time.  While  this  introduces  a  variety  of 
problems,  two  will  be  mentioned  here.  First, 
the  diversity  of  skills  and  Interests  presents 
problems  of  cooperation  (or  interface)  and  of 
communication  [10:60]  [17]  [19],  Technical 
specialists  tend  to  be  concerned  with  the 
technical  performance  of  the  part  they  arc 
responsible  for  and  to  ignore  or  give  a  low 
priority  to  other  parameters  (such  as  cost, 
schedule,  and  interfacing  technical  parts) 
[22:41],  and  they  may  be  insensitive  in  the 
demands  they  make  on  others  [10:60).  Procure¬ 
ment  and  management  people  may  neither  under¬ 
stand  nor  be  "comfortable"  with  the  technical 
problems  [3:62]  and  may  be  more  concerned  with 
current  budgets  and  schedules,  and  near-term 
problems,  than  with  the  overall  parameters  of 
the  system  [20:86].  Second,  the  long  time  to 
acquire  presents  problems  with  the  increased 
turnover  cr  change  in  persons  who  support  or 
oppose  the  system.  Clients,  sponsors,  and 
users  change  Jobs,  retire,  or  die;  opponents 
have  the  time  to  become  informed  and  organize 
themselves  [16];  requirements  may  change  or 
competing  systems  may  become  available. 

While  the  above  comments  were  directed  to 
characteristics  which  systems  share,  there  are 
a  number  of  characteristics  or  dimensions 
which  may  be  used  to  distinguish  among  sys¬ 
tems,  particularly  with  respect  to  the  prob¬ 
lems  faced  in  procurement.  The  discussion 
which  follows  will  describe  a  scries  of  sel¬ 
ected  dimensions;  it  should  be  clear,  however, 
that  there  may  be  other  dimensions  of  inter¬ 
est.  Each  dimension  will  be  described,  fol- 
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lowed  by  a  brief  discussion  of  its  relation  to 
problems  of  procurement,  particularly  noting 
those  relevant  to  the  specific  systems  which 
provide  the  oase  for  this  paper. 


Hardware  -*-*  Software 

This  dimension  if  the  degree  to  which  the  sys¬ 
tem  can  be  described  or  visualized  in  terms  of 
specific  physical  Items  (Figure  1).  Systems 
which  are  substantially  described  is  "hard¬ 
ware1'  tend  to  be  easy  to  visualize;  what  is 
included  "within"  the  system  is  easy  to  de¬ 
fine;  its  characteristics  (performance,  cost, 
existence)  can  be  identified;  and  different 
people  can  share  a  common  understanding.  As 
the  non-hardware  component  becomes  a  more  sig¬ 
nificant  par*  ■  f  ‘ne  "system,"  the  system 
loses  Its  visibility,  and  it  may  become  more 
difficult  to  treat  It  as  a  system  (1:576]  (5:4] 
(7:1],  Organization  charts  and  process  flow 
diagrams  which  largely  characterize  evaluation 
systems  ure  often  difficult  to  accept  as  a 
description  of  "the  system." 


This  dimension  Is  the  degree  to  which  the  sys¬ 
tem  will  be  produced  In  quantity  (Figure  1) . 
Systems  which  are  produced  in  large  quantities 
differ  from  small  quantity  systems  (7:23-28] 
in  at  least  two  respects.  First,  development 
costs  tend  to  be  a  significantly  smaller  pro¬ 
portion  of  total  costs.  This  may  facilitate 
tradeoffs  between  development  costs  and  Ini¬ 
tial  and/or  operating  costs,  and  the  benefits 
of  a  large  number  of  systems  in  operation  may 
make  it  easier  to  "justify"  the  absolute  a- 
mount  of  the  cost  of  development.  Second,  for 
most,  if  not  all,  defense  contractors  the  pros¬ 
pect  of  production  in  quantity  (and  follow-on 
procurement)  is  the  major  incentive.  Because 
che  development  pnase  may  provide  only  a  break¬ 
even  on  costs,  or  even  a  loos,  the  contractor 
will  be  highly  motivated  to  assure  chat  the 
system  is  designed  in  such  a  way  that  it  will 
jo  into  the  inventory. 

An  evaluation  system  may  be  procured  as  a  sin¬ 
gle  system,  or,  at  moot,  tt  will  be  limited, 
initially,  to  a  very  fci  yntems.  This  has 
the  obvious  eCfect  of  we  'ng  the  development 
co3ts  a  very  large  proportion  of  the  total 
cost,  and  providing  for  an  offset  limited  to 
the  benefits  of  only  one  (or  a  few)  systems  in 
operation.  A  more  serious  problem  arises,  how¬ 
ever,  in  the  incentive  to  the  contractor  during 
development;  his  prospects  for  recovery,  at 
least  dlractly ,  aro  limited  largely  to  I1I3 
profit  on  the  development .  Only  If  ho  antici¬ 
pates  the  development  of  additional  markets  (or 
la  concerned  with  his  icputotlon  os  a  systems 
contractor)  will  he  have  a  strong  Incentive  to 
designing  the  system  no  that  It  is  nusuied  of 
going  Into  operation. 


This  dimension  is  the  degree  to  which  the  sys¬ 
tem  represents  a  change  from  the  "system”  it 
replaces  (Figure  1) .  Incremental  improvements 
In  present  systems  tend  to  be  easy  to  procure 
(and  to  put  Into  the  inventory) ;  they  repre¬ 
sent  snail  changes  which  are  easy  to  under¬ 
stand  and  to  adapt.  HosL  systems  procured  as 
systems  probably  fall  into  the  category  of 
significant  improvements  on  tin  "present"  sys¬ 
tem,  and  they  present  most  of  che  conventional 
problems  of  systems  procurement  (11],  Evalu¬ 
ation  systems  would  usually  fall  into  the  next 
category — systems  which  nominally  replace  sim¬ 
ilar  existing  "systems."  Because  the  existing 
"system"  may  not  he  recognized  as  such,  or,  in 
many  cases,  may  not  "exist,"  cost/benefit  com¬ 
parisons  may  be  difficult  or  impossible  to 
make.  The  final  category  on  this  dimension 
covers  novel  systems,  systems  for  which  ,s  no 
comparable  existing  system  to  replace;  these 
tend  to  present  very  specialized  problems  in 
procurement,  e.g.,  the  system  for  landing  a 
man  on  the  moon. 

This  dimension  includes  a  number  of  roughly 
paralleling  sub-dimensions,  a  brief  discussion 
of  which  might  serve  to  distinguish  related 
system  characteristics.  The  degree  of  change 
(or  novelty)  may  be  with  respect  to  function. 
In  the  extreme,  the  function  of  the  system  may 
be  one  which  no  one  (seriously)  considered 
possible,  or  one  which  hadn't  even  been 
thought  of;  os  a  consequence,  there  has  been 
no  preexisting  need.  A  closely  sainted  change 
would  be  where  there  was  a  need,  but  it  was 
assumed  that  the  system  couldn't  provided; 
the  change  here  would  be  In  novelty  of  payoff 
or  benefit.  More  commonly,  the  change  (or 
novelty)  may  be  described  in  terms  of  how  the 
system  performs  its  function,  or  how  fast  or 
how  well,  and  changes  in  how  people  u3e  it  or 
operate  it.  Another  common  type  of  change  (or 
novelty)  Is  in  how  the  system  changes  the  re¬ 
lationships  of  people  to  other  systems;  for 
example,  :he  new  systems  may  make  obsolete 
certain  citegorl.es  of  personal  skills  or 
change  an  individual's  ability  to  control 
events.  More  generally,  the  change  (or  novel¬ 
ty)  may  be  ui  related  systems — budgets,  poli¬ 
cies  and  procedures,  logistics,  appropriate 
technology,  etc.  Finally,  the  change  (or  nov¬ 
elty)  may  be  with  respect  ro  non-cooperating 
individuals  or  systems — the  enemy,  competi¬ 
tion,  or  environmental  protection  groups  [16]. 


Inhouse  Isolated 

This  dimension  Is  the  degree  to  which  the  de¬ 
veloper  of  the  system  Is  responsive  to  the  di¬ 
rection  and  control  of  tin  user  f Figure  1). 

The  highest  degree  ol  rcsponeivcnest  ,nr,  al¬ 
ternatively.  the  closest  relations'  ip>  .any  be 
expected  where  th'  developer  Is  employed  di¬ 
rectly  and  specifically  by  the  user;  this  is  a 
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common  form  in  many  industrial  organizations 
and  has  a  long  history  in  the  military  as  the 
"arsenal  concept."  Except  where  the  large 
size  of  the  user  organization  results  in  long 
communication  links,  and  a  diffuse  control 
system  (i.e.,  both  communication  and  the  re- 
waid  and  punishment  structure),  the  developer 
who  is  directed  to  produce  a  desired  system, 
and  who  receives  constant  review,  is  likely  to 
be  successful  in  producing  a  system  which  will 
be  used.  Contracting  out  introduces  all  of 
the  problems  of  procurement,  and,  most  partic¬ 
ularly,  the  problems  of  choice  of  contractor, 
of  assigning  risk,  and  of  providing  review  and 
direction.  The  problems  of  assuring  that  the 
system  that  is  designed  will  be  used  tend  to 
be  increased  where  a  third  party  is  the  spon¬ 
sor.  Where  the  developer  is  the  "sponsor," 
two  different  situations  may  appear,  if  he 
takes  a  "marketing  approach,"  i.e.,  he  is  de¬ 
signing  "to  order,"  the  system  may  be  even 
more  likely  to  be  used  than  in  the  third  party 
case.  However,  if  the  developer  takes  a 
"sales  approach,"  i.e.,  he  designs  "for  stock," 
his  prospects  may  be  much  worse.  The  extreme 
case  on  this  dimension  is  the  "pure  researcher" 
or  "independent  inventor"  who  may  even  be  un¬ 
interested  in  the  procurement  and  use  of  his 
product  [8:23]  [13:43]  [22:41]. 

The  specific  evaluation  system  of  concern  here 
is  under  third  party  sponsorship,  although 
there  is  a  close  relationship  with  potential 
owners  or  users  of  the 'system,  perhaps  as 
strong  as  many  which  exist  in  very  large  using 
agencies.  It  does  seem  clear,  however,  that 
the  relationship  between  the  developer  and  the 
ultimate  user  is  a  critical  dimension. 

It  should  be  noted  that  these  several  dimen¬ 
sions  contribute  to  the  complexity  of  assess¬ 
ing  the  costs  and  benefits  of  a  system  at 
various  points  in  Its  acquisition.  And  this  is 
true  whether  the  approach  is  to  compare  the 
costa  of  System  A  with  the  benefits  of  System 
A,  or  to  compare  the  ratio  of  costs  to  benefits 
of  System  A  with  the  ratio  of  costs  to  benefits 
of  System  B. 


SPECIFIC  STRATEGIES 

The  dimensional  characteristics  of  a  system  may 
serve  to  suggest  not  only  the  kinds  of  probleas 
which  procurement  (and  Implementation)  of  Che 
system  faces  but  also  strategies  which  may  be 
used  to  solve  them.  In  this  section  a  number 
of  conventional  strategies,  common  to  many  sys¬ 
tem  procurements,  will  be  discussed  briefly; 
following  this,  specific  strategies  which  have 
been  proposed  or  employed  in  the  procurement  of 
the  present  evaluation  system  will  be  present¬ 
ed.  It  should  be  clear  that  many,  if  not  all, 
of  these  specific  strategies  have  been  used,  or 
may  be  applicable,  to  procurement  of  other  sys¬ 
tems. 


Cortmon  to  most  systems  is  an  extensive  system 
definition  process,  based  upon  a  c  separably 
extensive  process  of  defying  the  need  fo’*  the 
system.  The  general  characteristics  previ¬ 
ously  mcntioned--8izc ,  complexity,  and  long 
time  to  Inventory — require  extensive  processes 
for  the  direction  and  control  to  provide  an 
acceptable  (and,  preferably,  the  "best"  ob¬ 
tainable)  combination  of  performance,  time, 
and  cost.  Various  types  of  contract  forms  and 
incentive  systems  may  be  employed,  in  some 
cases  parallel  development  will  be  pursued, 
and  direction  and  control  through  re.view  of 
phases  (and  mi lestonts) ,  paralleling  the  rc- 
search-development-prodtiction-use  spectrum 
(or  its  several  variations),  is  characteris¬ 
tic. 

Of  particular  interest  arc  the  following  se¬ 
lected  strategies  which  are  discussed  with 
respect  to  their  usefulness  in  the  procurement 
of  the  specific  evaluation  system  here. 


Contractor  Selection 

Because  of  the  novelty  of  the  proposed  eval¬ 
uation  system,  it  appeared  likely  that  neither 
the  government  nor  potential  contractors  would 
have  an  in-being  capability  to  design  and  de¬ 
velop  the  system.  For  this  reason,  among 
others,  the  method  of  procurement  involved  a 
lengthy  and  detailed  and  candid  description  of 
what  the  government  knew,  what  it  was  looking 
for,  and  how  it  would  select  the  contractor. 
The  purpose  of  this  full  disclosure  was  to 
minimize  misunderstandings,  to  provide  guid¬ 
ance  to  potential  contractors,  and  to  begin 
the  process  (with  the  selected  contractor)  of 
working  together  cooperatively.  This  strategy 
is  described  more  completely  elsewhere  [14] 
[15]. 


Liaison  and  Review 

Because  of  the  novelty  of  the  system,  and 
third  party  sponsorship,  liaison  and  review 
were  recognized  early  (as  a  matter  of  fact, 
in  the  contractor  selection  process)  os  crit¬ 
ical.  Emphasis  was  placed  on  on-going,  in¬ 
formal  exchanges,  with  the  intent  that  formal 
reviews  and  approvals  would  be  after-the-fact 
confirmations  of  previously  agreed  positions. 
Special  attention  was  given  to  liaison  with 
the  potential  user  (or  "owner")  of  the  system 
[5:5]  [12:7]  [14:171-2]  121).  but  this  was 
complicated  by  the  predominantly  software 
characteristic  of  the  system,  its  novelty, 
and  the  small  (but  still  uncertain)  number  of 
systems.  Potential  users  (and  others)  had 
difficulty  in  visualizing  (or  identifying)  the 
system,  including  understanding  what  It  would 
do  and  its  usefulness;  the  developer  had  dif¬ 
ficulty  in  identifying  specific  individuals 
who  would  be  potential  users,  and  there  was 
more  incentive  to  "develop"  than  to  be  con- 
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corned  with  Implementation. 


Identifying  User  (of  Owner) 


Because  of  novelty,  third  party  sponsorship, 
the  softwure  nature,  and  the  small  quantity, 
the  identifying  of  a  specific  user  who  could 
work  with  the  developer  to  assure  that  the 
system  as  designed  would  be  acceptable  took 
more  time  than  anticipated.  It  was  recog¬ 
nized,  however,  as  a  critical  priority.  Where 
the  "present  system"  to  be  replaced  is  not 
necessarily  a  specific  entity,  with  some  or¬ 
ganizational  element  (or  individual)  clearly 
responsible  not  only  for  the  present  system 
but  a. so  the  new  system,  the  identification  of 
the  spt  ;  if . i”'ividuals  who  will  be  responsi¬ 
ble  for  l...\  1»— ,-nt  itlon  and  use  may  be  very 
diffi.ult.  It  requires  specific  individuals 
Lo  provide  guidance  on  how  a  "novel"  system 
will  fit  into  o.her  existing  systems,  who  can 
plan  the  i raining,  budgeting,  personnel,  and 
space  requirements,  and  can  coordinate  the 
process  of  implementation.  And  even  under  Che 
best  of  circumstances  it  requires  the  "best 
people"  and,  usually,  with  strong,  senior  sup¬ 
port  (2 j  [9:121]  [12:7]. 


Key  Man  (or  Advocate) 


Because  of  the  small  quantity,  and  perhaps  be¬ 
cause  of  the  software  nature  and  the  novelty, 
it  is  critical  that  the  system  have  an  advo¬ 
cate  or  "salesman"  who  can  not  only  "push"  the 
system  into  existence  but  also  find  the  "pull" 
represented  by  the  ultimate  user  (or  owner) 

[A : 586 ] .  This  presents  a  potentially  diffi¬ 
cult  problem  in  a  novel  and  small  quantity 
system  because  development  engineers  with  spe¬ 
cial  technical  competence  may  find  It  diffi¬ 
cult  to  give  equal  attention  to  meeting  user 
needs;  similarly,  user  oriented  advocates  may 
be  less  interested  fand  loss  competent)  in 
tcclinical  development  [8:23]  [13:43]  [22:41]. 

In  large  systems  procurements  this  problem  is 
met  by  either  functional  specialization  or  em¬ 
ployment  of  systems  people  with  skills  in  both 
areas,  or  a  combination.  In  small  systems  pro¬ 
curements,  the  options  may  be  more  restricted. 


Prototype  System  Model 


The  procurement  contemplated  three  stages,  each 
centered  on  the  evaluation  system  as  it  devel¬ 
oped,  as  follows:  pilot  evaluation  system 
(essentially  the  Initial  design  of  a  "single 
thread"  system) ;  prototype  evaluation  system 
(a  contractor  operated  version  of  the  system  ns 
proposed);  and  on-line  evaluation  system  (a 
user  operated  version  of  the  system,  with  some 
contractor  assistance).  The  prototype  evalua¬ 
tion  o"aton  was  nlso  proposed  to  be  used  not 
only  I  leal  Hie  .system  design  blit  also  ‘is  n 
t limit  t  tnlilo,  visible  model  which  Hie  user 


’Tr¬ 


ee!)  id  "see"  In  operation,  which  he  could  us> 
as  the  basis  for  suggesting  refinements  and 
modifications,  and  which  he  could  use  as  a 
basis  for  planning  the  installation  and  opera¬ 
tion  of  the  on-line  evaluation  system. 


Particularly  because  of  the  non-hardware  char¬ 
acteristic  and  the  novelty,  it  was  cons.dered 
important  that  there  be  a  "visible"  system  Cor 
tile  user  to  "see."  This  capability  is  one  that 
is  provided,  even  for  hardware  systems,  in  the 
form  of  simulations,  mockups,  demonstrations, 
mortels,  and  various  graphical  representations. 
For  an  evaluation  system,  it  seems  clear  that 
the  need  may  be  much  greater. 


SUMMARY 


Experience  with  the  acquisition  of  an  •  lua- 
ti.on  system  has  been  presented  in  terms  .  C  a 
set  of  dimensional  characteristics  which  dis¬ 
tinguish  different  systems  and  specific  strat¬ 
egies  used  or  proposed  in  the  acquisition  of 
the  evaluation  system. 
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FIGURE  1 

SELECTED  DIMENSIONAL  CHARACTERISTICS  OF  SYSTEMS 
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PROCUREMENT  EXPERIMENTATION  IN  THE  VETERAN'S 
ADMINISTRATION 


Kathleen  R.  Flaherty 

Experimental  Technology  Incentives  Program 
Center  for  Field  Methods 
National  8ureau  of  Standards 


ABSTRACT 


The  procurement  area  of  the  Experimental  Tech¬ 
nology  Incentives  Program  (ETIP )  at  the  National 
Bureau  of  Standards  has  as  one  focus  the  impact 
of  procurement  incentives  on  innovation  in 
developmental  products.  The  medical  products 
field  is  thought  to  offer  considerable  potential 
for  procurement  experimentation.  ETIP  is  pur¬ 
suing  a  mixed  strategy  for  identification  of 
product  areas  as  targets  of  procurement  changes. 
The  strategy  involves  both  searching  within  a 
health  care  delivery  agency  for  user  needs  that 
might  be  met  through  procurement,  and  searching 
in  industry  for  new  trends  in  product  develop¬ 
ment  that  might  be  pulled  through  procurement 
incentives.  To  date,  the  Veteran's  Administra¬ 
tion,  the  largest  single  hospital  system  in  the 
United  States,  has  been  ETIP's  partner  agency 
in  medical  products  procurement.  This  paper 
will  outline  ETIP/VA  experience  in  developing 
and  conducting  a  program  of  procurement  experi¬ 
mentation. 


PROCUREMENT  EXPERIMENTATION  IN  THE  VETERANS’  ADMINISTRATION 
Kathleen  R.  Flaherty 

National  Bureau  of  Standards,  US  Department  of  Commerce 


ABSTRACT 

The  Procurement  Area  of  the  Experimental  Tech¬ 
nology  Incentives  Program  (ETIP)  at  the  National 
8ureau  of  Standards  has  as  one  focus  the  Impact 
of  procurement  incentives  on  innovation  in 
developmental  products.  The  medical  products 
field  is  thought  to  offer  considerable  potential 
for  procurement  experimentation.  ETIP  Is  pur¬ 
suing  a  mixed  strategy  for  identification  of 
product  areas  as  targets  of  procurement  changes. 
The  strategy  involves  both  searching  within  a 
health  care  delivery  agency  for  user  needs  that 
might  be  met  through  procurement,  and  searching 
in  industry  for  new  trends  in  product  develop¬ 
ment  that  might  be  pulled  through  procurement 
incentives.  To  date,  the  Veterans'  Adninistra- 
tion,  the  largest  single  hospital  system  in  the 
United  States,  has  been  ETIP's  partner  agency 
in  medical  products  procurement.  This  paper 
will  outline  ETIP/VA  experience  in  developing 
and  conducting  a  program  of  procurement  experi¬ 
mentation. 


BACKGROUND 

ETIP 

The  Experimental  Technology  Incentives  Program 
(ETIP)  within  the  National  Bureau  of  Standards 
is  tasked  with  developing  knowledge  on  the 
impact  of  government  policies  on  private  sector 
technological  innovation.  One  area  of  con¬ 
tinued  emphasis  has  been  to  examine  Federal 
and,  to  a  timited  extent,  state  and  local  acgui- 
sition  policies  as  barriers  or  incentives  to 
product  innovation  in  Industry.  The  principal 
means  of  examinirg  acguisition  policy  impacts 
has  been  the  administrative  experiment,  a 
cooperative  arrangement  in  which  the  product 
procurement  needs  of  an  agency  are  met  while 
simultaneously  allowing  ETIP  to  develop  data 
regarding  industry  response  to  such  procure¬ 
ments  (Thompson,  1974;  Thompson  and  Rath,  1974). 
To  facilitate  acguisition  experimentation, 
partnerships  have  been  formed  with  agencies  who 
have  acguisition  responsibility  as  a  principal 
component  of  their  missions. 


VA 

A  partnership  between  the  Veterans' Administra¬ 
tion  and  ETIP  was  formalized  during  the  initial 
years  of  the  Program  to  develop  experience  in 
the  procurement-innovation  link  in  health  care 
delivery,  the  largest  service  industry  in  the 
U.S.  economy.  The  VA  was  considered  the  appro¬ 
priate  agency  for  th.s  particular  focus  of  the 


ETIP  Procurement  Area  because  the  "VA  supply 
service  supports  the  most  extensive  medical 
program  in  the  Federal  Government.. .(and)  the 
procurement  process  of  the  VA  can  and  should  be 
a  major  influence  in  contributing  to  improve¬ 
ments  in  the  natir“'s  health  care-  delivery  sys¬ 
tem”  (ETIP  Project  Plan  *8,  pp  1-2). 

Acguisition  experimentation  w’thin  the  VA  offers 
a  good  Illustration  of  the  administrative  experi¬ 
mentation  arrangement.  The  VA  Supply  Service 
through  its  marketing  center  is  able  to  apply 
procurement  tools  that  have  not  enjoyed  consis¬ 
tent  application  in  the  past  in  purchasing 
innovative  equipment  and  supplies  in  keeping 
with  its  mission.  At  the  same  time,  ETIP  is 
able  to  extend  its  procurement- innovation  know¬ 
ledge  base  in  areas  untouched  by  its  experimen¬ 
tation  with  other  agencies.  To  facilitate 
development  and  execution  of  acquisition  experi¬ 
ments,  an  office  has  been  established  within  the 
Testing  and  Evaluation  Division  at  the  VA  Market¬ 
ing  Center  at  Hines,  Illinois. 


FRAMEWORK  FOR  PROCUREMENT  POLICY  DEVELOPMENT 


An  ongoing  ETIP  effort  simultaneous  with  the  con¬ 
duct  of  specific  procurement  experiments  is 
development  of  a  framework  to  categorize  and 
aggregate  the  procurement  innovation  bits  of 
knowledge  resulting  from  those  efforts.  One  of 
the  earliest  formulations  of  this  framework 
recognized  aspects  of  the  VA  which  would  contri¬ 
bute  to  ETIP's  understanding  of  the  Impact  of 
government  acquisition  policy  on  innovation. 

One  feature  of  the  VA  procurement  function  Is 
that  it  acts  as  an  "owner/user  ourchase”;  in 
other  words,  the  VA  both  purenases  and  uses  the 
supplies  it  acquires.  This  is  in  contrast  to 
the  Federal  supply  Service,  another  partner 
agency  with  ETIP,  which  acts  as  a  broker  between 
users  in  other  government  agencies  and  industry, 
on  the  products  it  buys. 

As  work  in  the  procurement  area  has  progressed, 
attempts  have  been  made  to  incorporate  some  of 
the  literature  on  innovation  1r  industry,  in 
particular,  efforts  have  been  made  to  incorporate 
the  notion  of  the  "product  life  cycle”  or  "pro¬ 
duct  growth  curve"  as  discussed  by  Abernathy  and 
Utterbach,  Tilton  and  others.  Briefly,  this 
literature  recognizes  both  product  and  produc¬ 
tion  process  inn, vations  and  postulates  maximun 
policy  impact  on  product  changes  when  design 
alternatives  are  under  evaluation.  Once  design 
parameters  become  more  secure,  the  cost  o*  mak¬ 
ing  changes  becomes  more  expensive  and  the  inno¬ 
vation  focus  shifts  to  process  changes.  Finally, 
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as  the  product  matures,  emphasis  is  no  longer 
primarily  on  product  or  orocess  innovation,  but 
on  cos:  reduction  (Abernathy  and  Uiterback, 
19/r>). 

The  VA  seems  to  offer  an  opportunity  to  explore 
products  in  the  developmental  stage.  Aqain, 
this  is  in  sharp  contrast  to  the  FSS  example 
where  much  ETIP  work  has  been  done  with  mature, 
energy  intensive  ,roduct.. 


STRATEGY  FOP.  SELECTING  EXPERIMENTS 


The  r*-amework  elanents  will  ultimately  help 
guide  “Tie  selection  of  experiments  within  the 
VA  system.  Oowevor,  experime-  ts  were  initiated 
prior  to  teviof  .  -t  of  the  framework  and  a 
variety  of  sources  continue  to  contribute  exper¬ 
iment  ideas. 


Product  Champions 

Several  experiments  were  initiated  early-on  in 
the  ETIP/VA  relationship  as  "petti ng-our-hands- 
dirty"  experiences.  Most  of  these  ideas  were 
first  identified  in  a  consultant's  report 
exploring  trie  v'A  as  a  possible  site  for  acqui¬ 
sition  experimentation.  Three  products— 
surgical  qioves,  the  portable  oxyqen  producer 
and  the  pypodermic  device  destructor--were 
'elected  for  the  first  cycle  ETIP/VA  experiments. 

Sjirg ical  Gloves 

The  surgical  gloves  experience  was  an 
attempt  to  purchase  a  "preference  item,"  one 
for  which  different  uscro  have  different  con¬ 
cepts  of  desirable  qualities,  using  performance 
specifications  such  as  tensile  strength,  or 
stiffness  of  material.  There  was  no  particular 
individual  with  the  VA  system  who  was  actively 
involved,  or  ’’championing"  this  product.  The 
approach  taken  to  development  of  a  ,secification 
was  a-,  industry  symposium  followed  by  a  task 
f- jr.d  industry  effort  to  produce  a  suscifi- 
cation.  The  resu'Mng  speci'ication  was  not 
useful  for  purposes  of  procurement  and  the  exper¬ 
iment  was  dropped. 

Two  bits  of  knowledge  jre  gained  from  this 
exoerience  for  future  PTI  'VA  ventures.  The 
first  is  that  evaluation  of  the  impact  of  a  pro¬ 
curement  of  a  preference  item  would  have  bren  a 
complex  task  at  best.  Since  measures  of  satis¬ 
faction  would  necessarily  reflect  these  prefer¬ 
ences,  a  conclusion  as  to  whether  or  not  a 
better  glove  had  been  purchased  would  be 
extremely  difficult  to  draw.  Second,  the  sur¬ 
gical  gloves  experience  seemed  to  indicate  that 
it  was  difficult  to  get  an  experiment  go’nq  and 
sustain  its  momentum  without  an  identifiable 
individual  or  group  interested  in  obtaining  the 
result  if  product. 


The  concept  of  a  product  chamc'on  was  u'  -d 
in  two  subsequent  acquisition  experiments,  ■ 
portable  oxygen  producer  and  tne  hypodermic 
device  destructor.  Both  products  were  active’1.' 
sought,  by  the  Director  of  the  Department  of 
Medicine  and  Surgery  *n  the  VA  Central  Offi-c 
as  significant  contributions  to  the  delivery 
of  patient  care. 

Portable  Oxyqen  Producer 

The  portable  oxygen  producer,  was  an 
attempt  to  use  the  procurement  process  to  pul’ 
a  substantial  change  in  the  state-of-the-art. 

A  performance  specification  which  described  a 
device  free  from  an  external  po-  source  and 
light  enough  for  patients  with  polmonary  dis¬ 
abilities  to  carry,  in  addition  to  other  char¬ 
acteristics  related  to  noise,  safety,  and 
internal  oxyqen  storage  was  develop*-'.  ?ht- 
experiment  was  innovative  in  several  way' 
notably,  performance  specifications  were  rarc-ly 
used  in  VA  acquisitions,  and  the  particular 
product  sought  was  unavailable  at  tne  ti-“*  of 
the  VA  procurement.  A  two-step  prototype  of 
procurement  was  used  as  it  was  recognized  ir 
the  VA  as  providing  a  means  of  promoting  com¬ 
petition  for  new  or  improved  technologies 
under  the  ’provisions  of  the  VA  procurement 
regulations.  Technical  proposals  were  sub-1  • 
ted  by  two  firms;  both  were  unresponsive. 
Lessons  learned  from  the  effort  were  seven!. 
F„r  purposes  of  initiation  of  ETI°/VA  e*p-"i- 
ments: 

”  The  existence  of  a  product  ...namp’oo 
is  very  helpful. 

''  Future  experimental  efforts  ,hould 
involve  careful  pre-lFB  assessment 
of  market  trends  and  market  poten¬ 
tial  for  the  product  in  e-der  to 
ensure  responsive  bids. 

*  Careful  assessment  of  customer  needs 
and  priorities  within  them  should 
precede  experimental  procurements. 

*  The  degree  of  advancement  in  the 
state-of-the-art  should  be  explored 
and  the  following  alternative  acoul- 
si’ion  techniques  examined: 

--  for  i  series  of  small  statc- 
of-t-e-art  advances,  prototype 
procurement  wUh  a  prioritized 
set  of  performance  specif  !--• 
lions  may  be  appropriate. 

—  For  large  advances  in  the 
state-of-the-art  a  cost- 
reimbursable  R'.D  approach  nav 
provide  a  qrea’er  incentive 

for  P'-JOi.C’  ~P's  .■  i - *hm 

a  two-step  prototype. 
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—  For  no  real  change  in  the  state- 
of-the-art,  performance  specifi¬ 
cations  alone  may  suffice. 

(McEachron  and  Woodward,  1976) 

Hypodermic  Device  Destructor 

The  second  product  championed  hy  the  Depart¬ 
ment  of  Medicine  and  Surgery  was  tne  hypodermic 
device  destructor,  a  contemporary  of  the  por¬ 
table  oxygen  producer  in  the  ETIP/VA  procurement 
experimentation.  The  project  was  in  many  ways 
similar  to  that  of  the  portable  oxygen  producer: 
the  two-step  prototype  procurement  technique 
with  performance  specifications  was  used.  How¬ 
ever,  unlike  its  contemporary,  the  hypodermic 
device  destructor  procurement  sought  a  moderate 
advance  in  the  state-of-the-art.  In  fact,  the 
VA  was  the  procurement  as  a  means  of  spurring 
its  current  supplier  to  make  better  use  of 
existing  hypodermic  device  technology.  Again, 
the  procurement  was  not  completely  st.ccessful 
in  that  none  of  the  bidders  were  immediately 
responsive  to  the  procurement;  however,  the  VA 
expects  to  obtain  the  desired  device  through 
follow-on  with  several  bidders. 

Contrary  to  initial  expectations,  the 
bidders  offering  device  destructors  to  the  VA 
were  not  current  suppliers  but  rather  small 
compaction-equipment  manufacturers  who  were  not 
factors  in  the  medical  device  market.  The  VA 
has  made  efforts  to  bring  the  most  promising 
bidder  up  to  specifications.  In  the  meantime, 
anotner  small  concern  has  developed  and  demon¬ 
strated  a  device  destructor  that  v*ry  nearly 
meets  the  initial  specification.  Plans  are  to 
do  a  aetailed  case  study  of  the  circumstances 
under  which  this  device  was  developed  and 
offered  to  the  VA  market. 

There  is  some  indication  that  regulation 
was  a  prime  motivator  in  development  of  the 
hypodermic  device  destructors  offered  to  the  VA 
in  response  to  this  acquisition  experiment 
(McEachron  and  Chandler,  1976).  While  the 
small  firm  offering  the  most  promising  bid 
seemed  to  feel  that  Federal  regulations  were 
moving  in  the  direction  of  more  stringent 
syringe  and  needle  destruction  specifications, 
the  larger  firms  already  !n  the  industry  did 
not  regard  this  as  the  trend.  Furthermore,  the 
larger  firms  were  moving  in  the  direction  of 
cheap,  simple  destruction  devices  without  decon¬ 
tamination  features  sought  by  the  VA. 

Many  of  the  lessons  suggested  b.y  the  por¬ 
table  oxygen  producer  were  again  suggested  by 
the  hypodermic  device  destructor: 

0  The  existence  of  a  product  champion 
within  the  VA  is  extremely  useful  in 
initiating  and  completing  acquisi¬ 
tion  experiments. 

°  Careful  market  trend  and  market 
potential  asse'suxnts  should  precede 


experiments  to  maximize  the 
likelihood  that  the  desired  pro¬ 
duct  is  obtained. 


Agency  Problems 

Another  approach  which  is  frequently  used  by 
the  ETIP/VA  in  identifying  candidate  products 
for  acquisition  experimentation  is  to  make  use 
of  existing  products.  Those  approached  offer 
the  advantage  of  identifying  a  champion  for 
the  product  as  discussed  above.  Two  such  sys¬ 
tems  are  the  QIR  (Quality  Improvement  Report) 
and  the  Hazard  Reporting  System.  Both  offe"* 
opportunities  for  the  ETIP  office  within  the 
VA  to  pinpoint  products  with  which  users  have 
had  problems  and  to  screen  them  for  products 
that  have  promise  for  technological  improvement 
and  conmercialization  in  keeping  w’th  the  ETIP 
mission.  The  VA  has  also  been  used  as  a  site 
for  testing  of  a  system  developed  at  the  FSS  to 
match  user  product  improvement  ideas  with  indus¬ 
try  ideas.  Four  candidate  products  have  come 
from  this  source. 


Industry  Problems 

A  special  effort  was  initiated  by  ETIP/vA  to 
determine  the  workabil ity  cf  investigating 
industry  improvement  ideas  first,  then  matching 
them  with  agencies  with  procurement  responsi¬ 
bility.  A  Medical  Products  Search  was  con¬ 
ducted  by  a  contractor,  which  identified  and 
ranked  ten  product  ideas.  ETIP/VA  is  now  in 
the  process  of  finding  champions  within  the  VA 
for  those  of  the  products  used  within  the  VA 
system.  The  process  has  not  yet  been  fully 
evaluated. 


SUMMARY 


The  program  of  experimentation  with  medical 
products  has  been  somewhat  slow  in  yielding  a 
proliferation  of  new  products.  A  number  of 
strategies  are  being  pursued  to  identify  can¬ 
didates  for  experimentation.  These  ideas  are 
then  matched  with  experience  gained  from  three 
early  "getting-our-hands-dirty"  procurements 
descrioeo  in  this  paper. 

The  VA  experience  has  offered  some  opportunity 
to  expand  elements  of  the  ETIP  Framework  for 
Procurement  Policy  Development  and  is  expected 
to  make  numerous  additions  in  the  future. 
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DUAL  AWARDS  AND  COMPETITION  -  YOU  CAN  HAVE  BOTH 


CAPTAIN  DARRELL  R.  HOPPE,  A-10  SYSTEM  PROGRAM  OFFICE 


BACKGROUND 


After  completion  of  a  competitive  prototype 
phase  and  a  formal  source  selection  with  nego¬ 
tiation,  the  A-10  System  Program  Office  (SPO), 
Wrighc-Patterson  AFB  OH  awarded  contracts  to 
Fairchild  Industries,  Inc.  and  General 
Electric  Company  for  the  A-10  Close  Air 
Support  Airframe  and  GAU-8/A  30mm  Gun  System 
respectively.  General  Electric's  contract 
specified  Full  Scale  Development  (FSD)  and 
Initial  follow-on  production  of  the  Gun  Sys¬ 
tem  and  30mm  ammunition.  At  that  time  (1973), 
General  Electric  was  teamed  with  Aerojet 
Ordnance  and  Manufacturing  Company  (Aerojet 
being  the  subcontractor)  for  ammunition  FSD 
and  production.  In  1974,  as  a  result  of 
DSARC  II,  GE  was  tasked  to  develop  a  second 
ammunition  source  and  thus  provide  the  frame¬ 
work  for  a  mobilization  base  and  competitive 
sources  of  supply.  The  premise  used  for  the 
dual  sourcing  was  that  the  Government  through 
competitions  (1)  obtains  fiscal  year  pro¬ 
duction  quantities  of  ammunition;  (2)  main¬ 
tains  defense  industrial  capability  and 
capacity;  and  (3)  procures  ammunition  at  a 
lower  total  cost.  The  second  source  developed 
was  Honeywell  Inc.  and  through  the  Joint  A-10 
SPO,  GE,  Aerojet  and  Honeywell  efforts,  the 
types  of  ammunition  presented  in  Table  1  have 
evolved. 

In  1976,  A-10  SFO  management  decided  to  pro¬ 
cure  FY77  requirements  directly  from  the  two 
ammunition  subcontractors.  Both  subcon¬ 
tractors  were  progressing  well  and  each  had 
been  awarded  at  least  one  production  quantity 
through  GE.  A  Request  for  Proposal  (RFP)  was 
issued  directly  to  Aerojet  and  Honeywell  pur¬ 
suant  to  10  U.S.C.  2304(a) (16),  "Pur;hases  In 
the  Interest  of  National  Defense  or  Industrial 
Mobilization".  The  RFP  contained  a  Minimum 
Sustaining  Rate  (MSR)  of  production  specified 
for  each  contractor  at  202  of  the  total  pro¬ 
curement.  In  other  words,  each  contractor 
was  to  receive  a  minimum  of  202  of  the  total 
rounds  procured  for  FY77.  Above  this  minimum, 
the  offerors  were  asked  to  propose  at  bid 
points  of  16%  intervals  (i.e.  20/36/52/68/84/ 
1002)  ol  the  total  buy.  The  evaluation  cri¬ 
teria  in  the  RFP  contained  two  factors  -  cost 
to  the  Government  and  support  and  planning  for 
mobilization  requirements.  The  RFP  also  in¬ 
cluded  the  requirement  for  Cost  and  Pricing 
Data  and  submission  of  a  Certificate  of 
Current  Cost  or  Pricing  Data  after  determina¬ 
tion  of  the  total  award  spilt.  Full  field 
analyses  (DCAS  Price  Analyat/OCAA/Tcchnlcal) 
were  accomplished  and  used  in  in-depth  dis¬ 
cussions  with  each  contractor.  After  con¬ 
clusion  of  discussions,  a  Best  and  Final  Offer 
(BAFO)  was  received  from  each  offeror  and  the 


award  process  continued  using  the  evaluation 
criteria  in  the  RFP.  The  end  result  was  that 
both  offerors  were  awarded  quantities  above 
t.  e  MSR  a„d  the  presence  of  competition 
weighed  heavily  in  the  determination  of  accept¬ 
able  prices  to  the  Government.  In  ummary,  we 
had  satisfied  all  of  the  objectives  of  the 
GAU-8/A  30n®  ammunition  program  which  were  as 
follows: 

1 .  Establish  and  Maintain  a  Defense  Mobiliza¬ 
tion  Base  -  This  was  accomplished  by  including 
an  MSR  in  the  RFP  pricing  structure  and  mobil¬ 
ization  support  factors  in  the  evaluation 
criteria. 

2.  Maintain  Two  Sources  -  Awards  above  the 
MSR  insured  two  viable  sources  would  he  able 
to  compete  on  an  equal  basis  for  future 
awards. 

3.  introduce  and  Maintain  Competition  -  The 
element  of  price  competition  was  present 
throughout  the  award  process. 

A  post-award  review  of  the  FY77  procurement 
process  revealed  areas  In  need  of  improvement 
for  the  future.  These  areas  were  identified 
as  follows: 

1.  Hlnlmlzc  Proposal  Points  -  'ihe  six  pro¬ 
posal  points  were  too  numerous  and  made  pro¬ 
posal  preparation  and  evaluation  unduly 
tedious  and  complex. 

2.  Specify  Interpolation  Hethod  Between 
Points  -  The  interpolation  method  for  ammuni¬ 
tion  prices  for  award  quantities  between  two 
points  was  unspecified  in  the  RFP.  The  only 
requirement  was  that  each  contractor  have  an 
interpolation  method.  This  open  item  in  the 
award  process  could  have  impacted  the  prices 
paid  for  ammunition. 

3.  Incentlvlze  Every  Potential  Award  Poi_m  - 
It  was  recognized  that  even  though  price  com¬ 
petition  was  present  there  was  little  competi¬ 
tive  pressure  on  the  MSR  and  it  was  poten¬ 
tially  to  an  offeror’s  advantage  to  make  the 
MSR  as  unattractive  as  possible  in  comparison 
to  the  other  award  points. 

4.  Capitalize  On  the  Competitive  hnv  ( rojtnont- 
Price  competition  was  present  in  Fill  but  we 
felt  the  competitive  pressure  was  dampened  to 
some  degree  by  the  RFP  structure  in  two  basic 
ways.  Pirst,  proposal  nolnts  were  t routed 
essentially  as  Independent  entitles  and  the 
offeror's  decision  as  to  price  at  one  point 
(the  minimum  quantity  for  example)  did  not 
necessarily  influence  hi-  price  decision  at 
another.  Secondly,  'he  RFP  as  previously  men¬ 
tioned  contained  subjeccive  evaluation 


fee  *.  ' 


criteria  for  award  and  the  offerors  knew  that 
price  was  net  the  only  determining  factor.  We 
lecognised  that  future  buys  would  have  to  make 
pi  icing  decisions  Interrelated  and  that  sub¬ 
jective  criteria  would  have  to  be  eliminated 
to  gain  true  price  competition. 


FISCAL  YEAR  fFY)  1978  DUAL  COMPETITIVE  AWARD 
METHODOLOGY  (DC AM) 


AACB  is  the  Average  Adjusted  Contractor  Rid 
ACB  is  the  Adjusted  Contractor  Bid  at 
U  35%/50%65%  respectively. 

After  an  AACB  is  calculated  for  each  of  fetor, 
the  A %  between  the  two  is  calculated  (Step  2)) 
as  follows: 

A%  **  Highest  AACB  -  Lowest  AACB  „  , 

■  —  —  "  1  —  A  1  Ulj 

Lowest  AACB 


As  a  result  of  the  FY77  lessons  learned,  the 
FY/8  RFP  was  structured  around  the  basic 
premise  chat  awards  to  both  offerors  would  be 
made  solely  on  the  basis  of  price  competition. 
As  a  result  no  Cost  oi  Pricing  Data  was  re¬ 
quired  and  Field  evaluation  of  proposals  was 
nor  conducted.  The  key,  of  course,  to  this 
change  w.“?  the  establishment  of  a  mechanism 
that  lnsur  •!  <wvi  h  ivo  prices  at  every 
possible  award  point.  'I he  RFP  established 
three  proposal  points  ro  be  used  in  the  award 
evaluation  and  required  that  each  of  these 
points  ho  on  a  single  continuous  logarithmic 
total  price  curve.  Each  offeror  was  required 
to  supply  the  equation  anu  plot  for  che  curve 
as  pail  of  the  proposal.  Tills  equation  was 
then  used  to  establish  the  contract  price  for 
any  quantity  ot  ammunition  purchased  at  or 
between  the  points,  in  essence  then,  we  had 
improved  on  our  shortcomings  in  FY77.  We  had 
decreased  the  number  of  proposal  points  and 
specified  the  interpolation  method  to  he  used 
between  points.  Proposal  points  were  no 
longer  being  treated  independent  of  one  an¬ 
other  and  prlie  decisions  made  at  one  point 
by  an  ot fetor  Influenced  all  ocher  points. 

Wo  now  had  to  Insure  that  increased  competitive 
oresMirr  was  applied  to  each  point.  The 
points  established  for  evaluation  were  35%, 
r>0%  and  65%  of  the  total  buy.  The  important 
factor  here  is  the  minimum  quantity  to  be 
awarded  to  each  otferoi.  The  minimum  quantity 
was  increased  from  20%  to  35%  of  the  total  so 
as  to  include  and  satisfy  all  of  the  subjective 
criteria  formerly  contained  in  the  FY/7  RFP 
(mobilisation  planning,  future  competitive 
post -re,  surge  capability,  etc.).  Once  these 
criteria  were  satisfied,  [^rice  became  die  onljy 
ova Juatioji  f actor  and  the  Dual  Competitive 
Award  Methodology  (DC AM)  evolved. 

(n  essence,  f)CAM  Involves:  (l)  averaging  the 
three  proposal  poinLs  afic  tdjusting  them 
for  competitive  advantage  •overnmer.t  Facili¬ 
ties,  Transportation  Factors,  Government 
Furnished  Material,  etc.);  (2)  determining 
the  percentage  difference  between  the  offeror's 
average  adjusted  prices;  and  (i)  applying  this 
percentage  different e  to  an  iward  decision 
matrix  to  determine  the  percent  award  for  each 
offeror.  Step  (1)  then  uses  the  following 
Dual  Competitive  Awaid  Formula  (D(AF). 


This  result  is  then  applied  (Step  3))  to  tire 
award  decision  matrix  given  in  Table  2.  Read¬ 
ing  tire  table  from  left  to  right  provides  the 
award  percent  for  each  offeror  given  delta 
percents  from  0  to  12%.  This  matrix  was 
developed  by  exam log  past  ammunition  data  and 
projecting  prices.  In  essence,  Cost  Improve¬ 
ment  Curves  in  a  reasonable  anticipated  slope 
range  of  85%  to  95%  were  "gamed"  on  *’'•«  com¬ 
puter  to  examine  the  range  of  reasonah U  peer¬ 
age  percentage  diffetences  between  two  com¬ 
peting  firms.  If  this  reasonable  ditfeienco 
exceeded  12%,  the  RKP  anticipated  the  D(  AM 
approach  would  he  abandoned  and  in-depth 
negotiation^  would  be  conducted  with 
each  <  ontr.ictot .  The  matrix  essentially  re¬ 
wards  the  offeror  who  is  tin*  most  lompeiitivc 
within  the  teasonable  range  or  penalizes  tin 
offeroi  who  is  less  competitive. 

The  total  DCAM  concept  improves  eveiv  area  of 
concern  identified  as  a  result  of  the  FY77  pio- 
curement . 

1.  Proposal  Points  Were  Minimized  -  Six  wen 
included  in  FY77.  Only  four  points  were  used 
in  FY78.  Three  for  the  evaluation  ( 1V50/63,.  i 
and  a  fourth  (75%)  foi  potent*<.l  in*  rcases  in 
quant ities. 

2.  ^ejtliocl  JJas  Spec  i  1  led  -  I  he 
logarithmic  equation  was  used  foi  all  pruts 
along  the  line. 

3.  Every  Award  Point  Was  1  iic  e  n  1 1  vi  zed  -  I  in 
DCAF  treats  all  points  equally  in  the  evalua¬ 
tion  and  uses  the  interdependence  of  prices  at 
ail  three  points. 

U  .  The  Competitive  Kn  v  1 1  o nine 1 1 t  Was  Uja  d  i  < » 
Better  Advantage  -  Minimum  award  quantities 
«. an  no  longer  be  unnecessarily  "loaded"  with¬ 
out  influencing  the  outcome  of  the  evaluation 
"Loading"  penalizes  «in  of  fe**ot '*  chances  of 
receiving  the  larger  share  of  the  award  dol¬ 
lars.  Adjusted  price,  is  the  only  thing  con¬ 
sidered  in  the  evaluat ion  and  the  degree  ot 
competitiveness  between  the  prices  offered 
dictates  the  award  quantity  tot  each  ottcror. 


AAU>  -  AHl.*  *  ACBcn  ■*  ACB, 
5a  5o  ( / 


The  FY7ft  DCAM  results  were  truly  dru.niu 
awarding  on  the  basis  of  price  competition. 
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procurement  cycle  times  were  decreased  dras¬ 
tically.  With  the  elimination  of  DCAA,  DCAS 
and  Aeronautical  Systems  Division  Pricing 
Involvement  as  well  as  factfinding  and  nego¬ 
tiation,  the  procurement  cycle  was  reduced 
from  322  calendar  days  to  158  calendar  days  - 
51%  less  time!  This  reduction  It.  time  allows 
us  to  better  plan  for  our  annual  procu*ements 
and  concentrate  on  the  requirements  to  be  met 
instead  of  the  mechanics  of  award.  The  system 
is  continually  being  evaluated  and  we  hope  to 
eventually  reach  a  cycle  time  of  less  than  128 
calendar  days  for  the  award  of  two  complete 
contracts  totaling  in  excess  of  $100  million! 
We  are  proud  of  this  accomplishment,  but  the 
real  proof  of  the  system  is  in  the  prices  wo 
pay  for  our  ammunition  as  compared  to  what  we 
might  have  paid  using  other  methods.  Esti¬ 
mates  for  FY78  savings  alone  point  to  a  poten¬ 
tial  ammunition  reduction  of  $17  million  below 
projected  dollar  amounts.  This  is  a  signifi¬ 
cant  reduction  considering  the  FV78  buy  was 
less  than  $100  million.  The  savings  were  so 
great,  in  fact,  we  were  able  to  buy  11S%  of 
our  original  requirement  for  less  than  the 
dollar  projection  for  the  100%  quantity.  This 
is  an  indication  that  we  can  indeed  have  dual 
contract  awards  -  with  a  guaranteed  minimum 
mobilization  quantity  -  and  still  have  price 
competition. 


POTENTIAL  AREAS  OF  APPLICATION 


The  OCAM  procedure  was  developed  specifically 
for  the  CAII-8/A  30mm  ammunition  program  and 
most  likely  cannot  be  used  on  ocher  programs 
precisely  as  presented  here.  For  example, 
minimum  quantities  would  change,  the  bid 
points  could  be  different,  the  award  matrix 
and  parameters  require  individual  analysis, 
etc.  depending  on  the  situation.  However,  Che 
principles  and  concepts  Involved  may  prove 
useful  in  other  procurement  situations 
especially  where  dual  sourcing  and  awards  are 
involved.  Within  Govamment  procurement,  the 
leader-follower  concept  may  be  able  to  use 
some  or  all  of  the  DCAH.  Also,  prime  con¬ 
tractors  who  dual  source  at  subcontract  level 
may  see  some  idvantages  and  benefits  to  OCAM. 
Of  course,  other  mobilization  base  programs 
within  the  Government  would  be  prime  candi¬ 
dates  for  DC AM  applications.  Future  applica¬ 
tions  of  DCAM  or  other  improved  procurement 
techniques  are  only  limited  by  the  imagination 
of  those  who  develop  them  and  the  willingness 
of  others  to  accept  and  implement  them.  The 
A-10  SPO,  ASD  and  AFSC  have  the  capacity  and 
management  capability  to  do  both. 


GAU-8/A  30MM  AMMUNITION 


Target  Practice  (TP) 

Training  (Live 

Fire) 

High  Explosive  incen 

- 

Fire  Start 

diary  (HEI) 

Armor  Piercing  Incen 

- 

Tank  Killer 

diary  (API) 

Dummy 

Gun  Cycling, 

Training 

TABLE  2 

AWARD  DECISION 

MATRIX 

AWARD  % 

AWARD  % 

A% 

LOWEST 

HIGHEST 

AACB 

AACB 

0  thru  .5 

50% 

50% 

.5+  thru  2.5 

55 

4' 

2.5+  thru  3.5 

56 

44 

3.5+  thru  4.5 

57 

43 

4.5+  thru  5.5 

58 

42 

5.5+  thru  6.5 

59 

41 

6.5+  thru  7.5 

60 

40 

7.5+  thru  8.5 

61 

39 

8.5+  thru  9.5 

62 

38 

9.5+  thru  10.5 

61 

17 

10.5+  thru  11.5 

64 

36 

11.5+  thru  12 

65 

35 

CREATER  THAN  12 

TO  BE  NEGOTIATED 

DUAL  SOURCING  IN  MAJOR  WEAPON  SYSTEMS  ACOUISITION 


Lieutenant  Commander  David  V.  Terv 
Naval  Air  Systems  Command  Headquarters 


I 

INTRODUCTION 


Dual  sourcing,  or  second  sourcing,  in  the  ac¬ 
quisition  of  major  weapon  systems  is  not  a  new 
concepc.  In  an  attempt  to  introduce  and  main¬ 
tain  competition  in  the  acquisition  process, 
various  methods  have  been  proposed  and  uti¬ 
lized.  Over  the  years,  the  methods  and  tech¬ 
niques  nay  change  but  the  6ane  problems  con¬ 
tinue  to  exist.  One  of  the  methods  which  has 
been  exp'or-d  for  introducing  competition  in 
the  production  phase  has  been  second  sourcing. 
The  acquisition  literature  lacks  a  uniform 
definition  of  second  sourcing.  For  the  pur¬ 
poses  of  this  article,  however,  second  sourcing 
is  attempted  where  the  specifications  have 
been  developed  and  a  sole  source  producer 
(usually  the  developer  and  original  source)  is 
currently  producing  the  item.  Thl6  would 
exclude  acquisition  actions  involving: 

.  parallel  developments  under  research 
and  development  programs  where  two 
contractors  are  usually  concur: ently 
funded  for  prototype  hardware  devel¬ 
opment  leading  to  a  "fly-off" 

.  obtaining  an  item  from  a  new  source 
subsequent  to  a  default  termination 


1.  In  some  cases,  there  has 
been  no  concerted  effort  to 
obtain  the  needed  technical 
data  package.  The  project 
manager  involved  fears  that 
money  will  be  wasted 

2.  The  cost  of  obtaining 

a  second  source  is  a  criti¬ 
cal  decision.  In  many  cases, 
adequate  planning,  information 
on  volume,  and  cost  data 
are  not  available  to  make 
that  decision 

3.  Much  of  the  technical 
data  prepared  during  ini¬ 
tial  development  is  of 
little  worth.  Contractor 
design  changes  depreciate 
the  value 

*4.  Project  offices  exper¬ 
ience  difficulty  in  obtaining 
and  maintaining  control  over 
technical  date  packages. 

Cases  have  been  cited  in 
which  the  Government  was 
not  certain  of  what  data  it 
had  and  whether  the  data 
was  adequate  for  use  by  a 
second  source 


.  component  breakout,  involving  the 
decision  as  to  whether  components 
should  be  purchase'"  by  the  Government 
directly  and  furnished  to  an  end  item 
contractor  as  Government  Furnished 
Material  (commonly  referred  to  as  CFE) 
or  purchased  by  the  contractor  (CFE) 

.  the  splitting  of  award  under  invita¬ 
tion  for  bido  procedures  usually  re¬ 
sulting  from  Small  Business  or  Labor 
Surplus  Area  set-asides  as  veil  as 
evaluations  of  bids  under  1FB  proce¬ 
dures  leading  to  multiple  awards 

Dual  sourcing  has  not  be  l  accomplished  without 
serious  difficulties.  One  researcher  identi¬ 
fied  the  following  problems  which  surfaced 
during  testimony  before  congressional  com¬ 
mittees  over  a  period  of  several  years: 


5.  Much  of  the  data  Is  not 
delivered  in  time  to  he  of 
use  by  the  project  office  and 
is  not  of  sufficient  quality 
for  use  by  a  second  source 

6.  There  is  a  question  of  data 
ownership.  Often  the  data 
needed  are  owned  by  the  con¬ 
tractor  and  he  is  reluctant  or 
refuses  to  sell 

7.  There  is  a  problem  of 
transferring  technical  data 
from  one  contractor  for  use 
by  a  second  contractor  be¬ 
cause  company  processes 
differ  (l:l!42-lli3) 
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II 

REASONS  FOR  DUAL  SOURCING 


Dual  sourcing  is  generally  initiated  as  a  re¬ 
sult  of  two  broad  policies  or  concepts:  coa- 
petition  and  mobilization  production.  In  the 
case  of  the  first  concept,  a  second  source  is 
sought  in  order  to  introduce  competition  on 
both  a  price  and  technical  basis  into  the  ac¬ 
quisition  process.  The  intent  here  is  to 
force  the  original  source,  as  veil  as  the 
second  source,  to  become  as  efficient  and  as 
lcrv  a  coat  producer  as  possible.  Naturally  the 
element  of  competition  alvays  puts  a  different 
complexion  on  the  procurement  and  it  generates 
those  market  place  factors  so  visibly  lacking 
in  the  sole-source  environment.  In  this  sit¬ 
uation,  the  developer  (the  original  source) 
vill  participate  in  the  competition  with  the 
avard  made  to  that  responsible  and  responsive 
firm  with  the  lowest  price. 

The  second  major  category  of  second  sourcing 
is  that  involved  for  purposes  of  meeting 
mobilization  production  capacity  requirements. 
The  Defense  Acquisition  Regulations  (DAR)  pro¬ 
vide  general  authority  to  develop  and  imple¬ 
ment  plans  and  programs  to  provide  an  indus¬ 
trial  mobilization  base  vhich  can  meet  pro¬ 
duction  requirements  for  essential  military 
supplies  and  services  and  specifically  accom¬ 
modates  the  division  of  production  requirements 
between  two  or  more  contractors  to  provide  for 
such  a  base.  In  such  a  case,  the  Secretary 
must  determine  that  the  Interest  of  industrial 
mobilization,  in  ease  of  national  emergency, 
would  be  subserved  by  negotiation  with  a  parti¬ 
cular  supplier. 

It  is  important  to  note  that  the  Government  has 
no  obligation  to  make  the  second  source  fully 
competitive,  a  mistaken  idea  that  many  con¬ 
tractors  vehemently  maintain.  This  is  not  to 
say  that  competition  isn't  an  objective  because 
one  of  the  prime  benefits  from  second  sourcing 
is  major  price  reductions.  The  second  source 
can  be  made  fully  competitive  only  if  the 
Government  can  substantiate  large  tooljng 
investments  above  the  minimum  sustaining  rate, 
e.g.,  large  enough  quantities  over  a  sufficient 
period  of  time. 

Mobilization  second  sourcing  is  accomplished  by 
a  competition  among  a  group  of  contractors  well 
established  as  producer*  of  tbe  items  to  be 
procured.  This  competition  specifically  ex¬ 
cludes  the  original  souro*  (current  producer) 
and  the  winner  of  the  competition  is  usually 
given  a  small  initial  learning  quantity  to  in¬ 
sure  ths  sscond  source  can  product  a  quality 
product.  This  contract  may  include  an  option 
to  procure  follow-on  quantities  when  ths 


learning  quantity  bas  been  successfully  tested. 
The  remainder  of  the  current  fiscal  year  buy 
would  then  be  awarded  to  the  original  source. 

In  subsequent  annuel  procurements ,  tbe  tvo 
sources  are  solicited  for  competing  proposals 
on  a  step-ladder  quantity  basis.  The  Request 
for  Proposals  (RT?)  will  generally  state  that 
the  K&vy  ii  lends  to  avard  on  the  most  econo¬ 
mical  basis  for  the  Government.  This  will 
usually  result  in  a  larger  quantity  to  the 
original  producer  and  a  smaller  quanity,  con¬ 
sistent  with  minimum  sustaining  rate  require¬ 
ments,  to  the  second  source. 

In  evaluating  the  quantities  to  be  avarded 
such  factors  as  existing  tooling  and  the  cost 
of  adding  tooling  and  test  equipment  for 
higher  levels  of  production  are  important.. 

It  la  obvious  that  in  the  production  of  a  com¬ 
plex  system,  the  second  source  vill  not  be  im¬ 
mediately  competitive  with  the  original  source 
During  the  first  few  annual  procurements, 
therefore,  it  might  be  necessary  to  determine 
the  reasonableness  of  prices  through  cost 
analysis  -  as  opposed  to  price  analysis  -  and 
to  require  submission  of  cost  or  pricing  data. 
If  one  or  both  contractors  cannot  be  avarded 
a  definitive  firm  fixed-price  contract  on  the 
basis  of  price  analysis,  tbe  usual  procedure 
would  be  to  ieeu*  e  letter  contract,  to  pro¬ 
tect  the  delivery  schedule,  and  to  immediately 
begin  the  deflnitlsation  process.  Letter 
contract  conversion  i*  planned  to  be  accom¬ 
plished  vi thin  »ix  month*  after  avard.  Per¬ 
forming  co»t  analysis  provides  tbe  Government 
an  opportunity  to  inspect  the  Contractor's 
estimating  and  costing  systems  which  might  not 
otherwise  have  oocurred  under  a  production 
environment  if  a  definitive  firm  fixed-price 
contract  had  been  avarded.  Such  analyses 
provides  a  basis  for  such  decisions  as 
learning  curve  applications  and  perhaps  fu¬ 
ture  "buy  out"  or  'Vinner  take  all”  compet¬ 
ition, 


III 

FEQUISDflfflTS  FOR  DUAL  SOURCING 

Some  basin  requirements  exist  vhich  must  be 
satisfactorily  met  before  embarking  on  any 
eecond  sourcing  effort*. 

Tbe  first,  and  perhaps  moat  important,  require¬ 
ment  la  an  extremely  good  technical  data  pack¬ 
age.  Even  with  the  most  tried  and  tested 
specifications,  new  sources  will  have  sotte 
technical  difficulties  as  a  result  of  dif¬ 
ferent  production  engineering  approaches.  It 
may  very  veil  happen  that  second  sources  who 
quote  tight  prices  in  competition  will,  sub- 
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sequent  to  award,  go  over  the  specif teat ions 
with  a  sharp,  bright  light  scrubbing  the  pack¬ 
age  intensively  in  order  to  support  deficiency 
claims .  This  is  not  to  say  that  evj.-v  second 
source  contractor  will  subnit  clains  gainst 
the  Government,  but  the  opportunity  clearly 
exists.  Whether  or  not  the  Government  owns  the 
data  package  is  yet  another  consideration.  If 
the  developer  has  propiietary  data  in  the  tech¬ 
nical  data  package,  the  cost  of  getting  un¬ 
limited  righto  or  reprocurenent  rights  must  be 
added  to  second  sourcing  costs.  In  most 
Instances  the  developer  is  usually  the  current 
producer  on  a  sole  source  basis  although  he 
may  have  won  his  sole  source  status  through 
earlier  competition.  The  item  should  be  in 
production  in  order  to  ensure  the  technical 
data  K-'kage  is  adequate  and  most  production 
problem*-  he. -e  b-  e  identified  and  resolved. 

A  second  requirement  is  that  large  enough 
quantities  to  cake  second  sourcing  worthwhile 
for  both  Government  and  industry  must  exist. 
Many  hardware  items  require  large  initial  pro¬ 
duction  start-up  costs  which  contractors  must 
he  able  to  amortize  over  future  annual  buys. 

The  potential  for  large  future  quantities 
might  Include  a  multi-year  procurement  package. 
Not  only  must  there  be  sufficiently  large 
quantities  but  these  quantities  must  exist  over 
a  period  of  several  years. 

A  third  requirement  is  that  in  the  case  of 
sophisticated,  complex  systems,  it  is  mandatory 
that  the  Government  have  qualified  technical 
personnel  to  assist  the  second  source,  parti¬ 
cularly  during  the  learning  quantity  or  pilot 
production  phase.  These  qualified  personnel 
have  to  know  "how  to  assist"  becauoe  in  some 
Instances  there  is  a  tendency  to  over-engineer 
the  problem  or  drag  it  out  extensively.  The 
original  source  (competitor)  usually  won't 
help  with  problem  areas  he  may  have  already 
learned  to  overcome.  It  is  important  that 
"take  apart  and  study"  models  of  production 
hardware  be  available  to  the  second  source  in 
order  to  facilitate  hi3  complete  understanding 
of  the  finished  product. 

The  fourth  major  requirement  is  that  interested 
sources  exist  to  compete  in  second  sourcing 
efforts.  It  may  very  well  occur  that  problem 
arc&n  experienced  by  the  r  -rent  producer  are 
of  sufficient  magnitude  t  discourage  any 
interest  in  competing.  Seme  contractors  have 
adequate  knovhow  to  compete  but  need  to  be 
talked  into  redirecting  their  resources  to 
this  new  buciness.  In  some  cases,  it  means 
demonstrating  to  a  potential  contractor  that 
the  risks  of  second  source  investments  ccn 
potentially  result  in  rather  profitable  bus¬ 
iness.  Second  sourcing  won't  work  if  serious 


sources  cannot  be  established  and  the  ori¬ 
ginal  source  is  keenly  aware  of  his  compet¬ 
itors. 

Fifth,  sufficient  administrative  lead-time  must 
exist  to  develop  the  second  source  without 
,;eopurdizing  delivery  schedule  requirements . 
Included  in  this  lead-time  are  such  efforts  as 
(l)  firt  article  qualification,  (2)  learning 
quantity  award,  (3)  pre-award  surveys,  (M  com¬ 
petitive  range  evaluations,  (5)  meaningful  dis¬ 
cussions,  both  written  and  oral,  and  (6)  best 
and  final  offers  (when  appropriate). 

In  summary ,  several  requirements  must  be  met 
lr.  ori***-  to  initiate  second  sourcing  efforts. 

It  is  import  am  to  note  also  that  only  under 
an  exception  16  (mobilization  base'  car.  the 
original  Bource  be  excluded  from  ***  -d  source 
competition. 


IV 

BENEFITS  OF  SECOND  SOUFCING 

Several  benefits  result  from  successful  second 
sourcing,  not  the  least  of  which  is  price 
reductions.  In  sole  source  procurement,  easy 
of  the  factors  found  lr.  the  competitive  market 
place  are  missing  and  must  either  be  simulated 
or  safeguards  against  commercial  abuses  esta¬ 
blished.  Second  sourcing  Introduces  the  com¬ 
petitive  environment,  ever,  though  not  always 
completely,  and  forces  contractors  to  sharpen 
their  estimating  pencils  and  scrutinize  cost 
efficiencies  as  a  necessity  rather  than  a 
luxury.  Cost  consciousness  frequently  spreads 
to  other  programs  in  the  contractor's  plant  ar.d 
is  even  forced  down  to  subcontractor  levels  in 
order  to  remain  competitive.  Ever,  beyond  this, 
other  major  firms  in  a  particuler  industry, 
e.g.  ,  missile  manufacturers,  observe  now  a 
particular  contractor  is  establishing  operating 
efficiencies  which  msy  stimulate  similar  ef¬ 
forts  in  their  plants  as  well  as  how  they  per¬ 
ceive  their  relative  strength  to  compete  in 
exicting  future  missile  programs. 

An  Improved  technical  data  package  and  improved 
equipment  performance  frequently  results  from 
second  sourcing.  A  fresh  new  examination  of 
the  hardware  by  a  second  group  of  competent 
engineers  often  results  in  technical  improve¬ 
ments  and  better  problem  solving  techniques. 
Because  the  program  is  now  competitive  (or 
becoming  competitive),  the  original  source  may 
shift  his  best  talent  to  the  second  sourced 
program  in  order  to  bcccce  more  efficient. 
Naturally  the  second  source  will  want  his  most 
cape.tle  people  on  the  project  In  order  to  be¬ 
come  competitive  aG  rapidly  as  posoiM*-. 
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Another  benefit  of  second  lourcing  is  the 
existence  of  tvo  sources  for  the  some  item  at 
the  same  time  which  acts  as  s  measure  of 
insurance  against  delivery  delays  due  to  such 
occurences  as  strikes,  natural  disasters, 
technical  problems,  and  similar  Instances. 
Further,  as  one  producer  discovers  a  problem 
with  the  technical  data  package  or  a  method 
of  improving  production  processes,  this  can  be 
incorporated  (by  change  order)  into  the  other 
producer's  item. 

Yet  another  benefit  of  second  sourcing  is  the 
orderly  development  and  maintenance  of  an  in¬ 
dustrial  mobilization  base.  Mobilization 
asset  requirements  can  be  met  while  achieving 
competition  at  tne  same  time.  Mobilization 
requirements  are  used  as  a  basis  for  second 
sourcing  in  the  first  place,  but  the  two  are 
self-reinforcing. 

Corollary  to  the  mobilization  benefit  is  the 
maintenance  of  a  resource  base  for  new  ini¬ 
tiatives  in  downstream  applications.  This  may 
involve  RID  studies  for  Government  developed 
applications  or  contractor  developed  prototype 
hardvare  for  concept  testing  and  evaluation. 
Additionally,  several  second  sourcing  efforts 
have  involved  small  businesses  such  as  fuze 
antennas,  safety  and  arming  devices,  and 
electronic  assemblies.  In  such  cases,  small 
business  objectives  can  be  achieved  while 
broadening  the  business  base  at  the  same  time. 


V 

EXAMPLES 


HAVAIR  procurements  fall  into  the  following 
major  categories:  airframes  and  engines,  mis¬ 
siles,  avionics  and  sonobuoya.  In  terms  of 
weapon  systems,  missiles  peculiarly  lend  them¬ 
selves  to  second  sourcing  because  it  can  be 
anticipated  that  a  large  enough  quantity  will 
be  procured  thus  making  heavy  contractor  and 
Government  investments  in  initial  start-up 
costs  profitable.  At  NAVAIR,  our  component 
breakout  policies  pewit  us  to  second  source 
both  expensive  and  relatively  inexpensive  mis¬ 
sile  components.  Our  major  primes  are  the 
guidance  and  control  ssetion  contractors.  Other 
missile  component  prises  include  the  warhead, 
target  detecting  device,  rocket  motor,  and  wing 
and  fin  producers.  large  quantities  and  mobil¬ 
ization  requirements  also  mske  sonobuoys  extre¬ 
mely  attractive  for  second  sourcing.  Almost  65Jf 
of  EAVAIR's  sonobuoys  are  currently  second 
sourced. 


As  an  example,  Contractor  A  developed  a  parti¬ 
cular  navigation  set  and  was  awarded  a  FY  75 
contract  at  r  unit  price  of  approximately 
$25,000.  The  EY  76  procurement  w»a  split  be¬ 
tween  Contractor  A  (unit  price  of  ♦27,150)  and 
the  winner  of  a  competition  (Contractor  B)  at 
a  dramatically  lower  unit  price  (♦13,785). 

One  could  speculate  that  competitive  forces 
sharply  reduced  the  unit  prices  both  to  Con¬ 
tractor  B  in  FT  76  and  in  EY  77  when  Contractor 
B  received  the  entire  annual  buy  at  a  unit  price 
of  $12,875. 

This  navigation  set  ie  an  example,  however, 
where  problems  in  second  sourcing  can  occur. 
Contractor  B  had  technical  difficulties  in 
first  article  approval  which  were  attributed 
by  the  contractor  to  the  data  package.  It  ap¬ 
pears  that  the  drawing  package  was  not  in  com¬ 
plete  agreement  with  the  model.  In  the  Ft  78 
requirement,  steps  were  taker.  to  highlight 
known  problems.  For  example,  a  provision  vas 
incorporated  In  the  RFP  notifying  bidders  that 
wiring  lists  and  teat  specifications  in  the 
technical  data  package  are  inadequate  for 
their  intended  uae  and  that  offerors  should 
take  this  into  consideration  in  preparing  their 
proposals  because  no  contract  adjustment  will 
be  made  for  the  deficiencies  noted.  In  another 
special  notice  regarding  drawings,  offerors 
were  advised  that  there  is  reason  to  belJ  ere 
that  defectB  may  exist  in  certain  drawings, 
that  other  drawings  not  specified  mty  also 
have  defects,  that  offerors  are  advised  to 
carefully  examine  the  data  package,  that  any 
such  defects  are  considered  "patent  defects " 
as  defined  in  the  parent  and  latent  defects 
clause,  and  finally  that  offerors  should  con¬ 
sider  these  facts  in  preparing  their  proposals 
(both  cost  and  schedule  impacts)  and  any  in¬ 
creased  effort  associated  with  correcting  de¬ 
fective  drawings.  These  notices  serve  to  warn 
the  bidders  that  known  defects  exist  end  should 
be  accomodated  in  proposal  packages. 

In  snother  example ,  although  a  particular  mls- 
silc  rocket  motor  is  not  currently  second 
sourced,  en  analysis  of  the  feasibility  and 
desirability  of  second  sourcing  this  item  in 
FT  75  was  inititated.  Wbsn  tbe  original 
source  discovered  the  existence  of  second 
sourcing  actions ,  it  commenced  some  significant 
cost  reduction  measures.  As  a  result,  tbe  FT 
77  unit  price  van  less  than  one-half  the  unit 
price  realized  in  FT  73/71*.  Some  of  this  is 
due  to  learning  and  other  operating  efficien¬ 
cies  ,  but  a  significant  percentage  of  the  re¬ 
duction  can  be  attributed  to  the  "threat"  of  a 
second  source. 
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VI 

LESSONS  LEAFJiED 


Several  lessons  have  been  learned  from  past 
and  on-going  second  sourcing  efforts.  The 
first  cardinal  rule  is  to  have  as  adequate  a 
technical  data  package  as  possible.  Second 
sourcing  efforts  any  be  advisable  in  all  other 
respects  'out  until  the  data  package  can  be 
pronounced  "completely  adequate",  serious  con¬ 
sideration  should  be  given  to  the  technical 
problem  which  could  develop. 


second  source  may  be  very  crucial.  Careful 
evaluation  to  either  continue  or  terminate 
second  sourcing  effort  is  essential ,  as  is 
true  with  any  iaportant  procurement  decision. 

It  is  even  more  iaportant  to  realise  that  se¬ 
cond  sourcing  has  United  application  in  the 
procurement  of  major  systems  and  requires 
thoughtful  reflection  upon  the  objectives  to 
be  achieved  and  the  methodology  for  proceeding. 
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Secondly,  there  aust  he  a  very  thorough,  com- 
petent  and  impartial  evaluation  of  tha  necond 
source  proposals.  It  is  extremely  important  to 
identify  the  overly  optimistic  cost  and 
schedul-  promises  cf  competitors. 

Next,  it  is  important  to  select  the  appropriate 
type  of  contract  for  the  second  sourcing  effort. 
The  specific  contract  type  depends  upon  the 
peculiar  facts  of  each  individual  procurement, 
however.  a  cost-type  contract  is  usually 
appropriate  for  the  "learning  quantity"  awarded 
to  the  second  source.  Progressing  from  a  cost- 
type  learning  award  to  a  fully  competitive  firm 
fixed-price  contract  deptnds  upon  a  number  of 
factors  including  the  contractor's  ability  to 
come  rapidly  down  the  learning  curve. 

Fourth,  it  must  he  recognized  that  consider¬ 
able  professional  demands  will  be  placed  on 
program,  technical  and  procurement  personnel  in 
order  to  achieve  a  successful  second  sourcing 
objective.  New  problems  corf  Lnually  arise 
requiring  creative  and  inno- ative  solutions. 

Care  must  be  taker,  to  avoid  compromising  the 
Government's  position  while  at  the  came  time 
complying  with  the  contractor's  rights.  Second 
sourcing  can  frequently  be  a  drain  on  Govern¬ 
ment  manpower  resources  vith  no  immediate  pay¬ 
off. 

Lastly,  in  some  painfully  obvious  cases,  small, 
low  cost  components  with  extremely  tight  toler¬ 
ances  may  realize  large  percentage  savings  due 
to  second  sourcing,  but  low  unit  savings  have 
not  offset  the  added  costs  of  late  equipment 
deliveries  and  technical  problems  demanding 
Government  attention. 

In  summary,  the  key  word  is  caution  and  an  un¬ 
derstanding  that  the  desired  results  may  be 
difficult  to  achieve.  Experience  has  shewn 
that  there  may  be  several  points  in  the  process 
where  the  decision  to  retain  or  ellminat'1  the 
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gressional  Criticism  and  Concern", 
unpublished  doctoral  dissertation , 

(The  George  Washington  University, 
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NEW  APPROACHES  TO  ■■iUITIPLT  AWARDED  CONTRACT  INC. 


John  Battan,  General  Services  Administration 
Ronald  Johnson,  Research  Triangle  Institute 


ABSTRACT 


This  oaper  presents  a  descriptive  analysis  of 
the  ro  e  of  multiple  award  contracting  in  fed¬ 
eral  procurement  practice*  end  possible  new 
directions  in  its  -se.  The  largest  (dollar 
value)  of  three  General  Services  Administration 
supply  programs,  multiple  award  contracting 
through  the  use  of  negotiated  discounts  with 
multiple  sources  of  supply  of  the  same  type  of 
product  relies  on  commercial  products  rather 
than  unique  government  specifications.  Propo¬ 
nents  argue  that  it  allows  agencies  greater 
variety  of  choice  and  brings  new  products  into 
the  supply  system  faster  than  other  methods. 
Opponents  argue  that  price  discounts  are  not  as 
qood  as  those  produced  by  competitive  bids,  that 
ordering  documents  are  confusinq  and  costly  to 
use,  and  there  is  no  assurance  of  minimum  qual¬ 
ity  standards. 

Potential  changes  in  multiple  award  contracting 
include  simplifying  basic  orderinq  documents 
and  introducing  quantitative  and  qualitative 
product  information  such  as  life  cycle  costs. 
Task  forces  in  the  General  Services  Administra¬ 
tion  have  been  set  up  as  a  result  of  December, 
1977,  action  of  the  Office  of  Federal  Procure¬ 
ment  Policy  in  support  of  recommendations  on 
commercial  products  and  multiple  awards  contract 
ing  of  the  Commission  on  Government  Procurement 
(1972). 


I.KADEI  /FOLLOWER  PROGRAM  -  ACES  11  EJECTION  SHAT 


Charles  L .  Clark,  Aeronautical  Systums  Division  (AFSC) 


INTI'.JmiCTIDN 


Tlio  Leader  Compnny  procurement  technique 
>!i*!ic v I hii!  In  AS  I’K  Section  4,  Part  7,  has  tradi¬ 
tionally  been  iii.ril  when  the  quantity  of  sup- 
plle  i  lequlroti  exceeds  the  capacity  of  n  single 
firm.  The  technique  also  makes  provision  for 
hoc  In  clreiimatanceii  of  scarce  special  tooling, 
shortening  delivery  times,  soil  establishing 
additional  oourcen  for  (inch  reasons  as  geo¬ 
graphical  dispersion  or  hrotnlenlng  of  the 
piodnri  Ion  hnae.  II.kUv  tile  technique,  the 
ileve  I  opor  or  sole  m.imifnc tur er  of  an  Item  (the 
le.nli  i  'omp.iov)  furnishes  assistance  and  know¬ 
how  which  •  ■  i! -i !•  i ,-o  u  follower  company  to  become 
a  source  ol  supply.  The  pressing  needs  of 
nations]  security,  such  as  during  wartime,  and 
a  determination  by  the  Tender  compnny  that  he 
In  not  Jeopardizing  Ills  status  as  a  supplier 
arc  t.iie  usual  Ingredients  of  past  successful 
loader/ fol  lower  procurements.  There  Is  no 
record  of  Its  oso  solely  to  provide  for  future 
compc  till  or.. 

There  have  been  some  recent  variations  of  the 
technique  directed  toward  competition  by  the 
U.  S,  Army;  one  of  which  wus  the  proofing  of 
the  data  package  by  a  second  source  with  assis¬ 
tance  from  the  original  supplier.  This  was 
accomplished  In  high  volume  grenade  launcher 
purchases  where  some  question  of  capacity  was 
present.  The  Army  Missile  Command  also  uses 
an  active  program  o.  component:  breakout  with 
nan  Istance  contracts  to  new  suppliers  pro¬ 
vided  by  the  Integrating  systems  contractor. 

Thu  program  ol  leader/follower  procurement 
being  utilized  for  tbe  ACES  II  Ejection  Scat 
is  noteworthy  from  several  aspects.  It  rep¬ 
resents  an  unique  Initiative  to  provide  for 
future  competition.  It  further  required  a 
reassessment  of  motivations,  both  government 
and  contractor,  as  they  were  perceived  to 
operate  within  the  framework  of  the  authorizing 
regulation.  A  competitive  dllummn  exists  in 
procurement  programs  for  sophisticated  systems 
and  stihsyij.tcnm .  Despite  the  very  real  prog¬ 
ress  made  In  maintaining  competition  in 
development,  ami  even  Lb  igh  prototyping,  con¬ 
tinued  competition  In  on  .uctlon  Is  rarely 
achieved.  The  root  cause  of  this  condition  Is 
the  high  risk  of  transferring  manufacturing 
from  one  firm  to  another  on  the  basis  of 
reprocurement  data.  A  number  of  factors  con¬ 
tribute  to  the  genera t  Inability  to  success¬ 
fully  use  reprocurement  Jata  In  more  sophisti¬ 
cated  equipment  purchases.  These  include 
quality  of  tbe  data,  its  timeliness  Is  rela¬ 
tionship  to  program  budget  decisions  and  ita 
utility  by  another  firm,  lly  recognizing  those 
dof iciem  lea,  the  header  Company  technique  can 


serve  as  u  method  of  sugmant lng  the  data,  or 
serve  as  its  replacement. 


PRELIMINARY  CONSIDERATIONS 


Key  factora  in  considering  the  uac  ol  a  lcsd- 
er/followcr  program  in  the  ejection  seat  pro¬ 
curement  were  ItH  planned  long  production  run, 
high 'front  end  costa,  the  availability  of 
Initial  competition  and  the  ability  to  uv.il- 
uate  Its  Impart  during  eource  select  Ion.  Tbe 
High  Technology  Ejection  Seat  program  bad  as 
one  of  Its  primary  objectives  standardization 
ol  new  fighter  aircraft  escape  synii,'a.  This 
concept  of  stsndai dizatlon  would  provide  not 
only  significant  logistic#  benefits  and  allow 
large  quantity  ourchasns  us  Government- 
Furnished  Equipment,  but  ulao  u  production 
run  which  matched  the  combined  A-10,  F-15  and 
F-16  programs.  It  was  considered  highly 
desirable  that  such  a  lengthy  production  run 
be  uuhject  to  continuing  competitive  pres¬ 
sures.  To  accomplish  this,  and  maintain 
standardization,  reprocurement  of  ejection 
seats  identical  to  the  selected  design  would 
be  necessary.  Howe'er,  giver.  th.i  considera¬ 
tions  of  high  front  end  costa  due  to  man-rat¬ 
ing  the  seat  and  the  priority  of  supplying 
c lie  production  lines  of  three  front  line 
fighters,  n  decision  to  abandon  the  proven 
suppLler  for  another  source  would  be  virtu¬ 
ally  Impossible  to  make.  It  was  also  obvious 
that  motivating  the  selected  contractor  to 
participate  In  a  program  designed  to  facili¬ 
tate  future  competition  would  be  a  hurdle  of 
no  small  magnitude.  In  fart,  It  wan  only 
through  the  competitive  for res  at  work  in  the 
Initial  production  competition  and  uac  of  a 
structured  leader/ fol  lower  program  aa  a  source 
selection  factor  that  this  unique  cone  pi 
survived  the  "good  Idea"  stage. 


IMPLEMENTING  GUIDELINES 


la  addition  to  having  available  In  a  procure¬ 
ment  the  factors  discussed  above,  certain 
guidelines  were  established  which  study  shows 
would  be  generally  required  to  Implement  a 
competitive  leader/ follower  program.  The 
four  considerations  discussed  In  the  following 
subparagraphs  were  determined  to  lie  basic 
groundvules  for  a  successful  program. 

a.  The  issue  of  contractor  proprietary 
rights  or  any  other  legal  bar  to  transferring 
manufacturing  capability  bad  to  tie  addressed. 
It  makes  no  sense  to  expend  slgnlM-  n" 
effort  In  embarking  on  the  planning  lot 
future  competition  without  clear  title  to  the 


qpst  Available  Con' 


: 


design.  An  assessment  luring  the  source 
selection  must  be  made  !  ■'  restrictions  placed 
on  design  transfer.  The  necessity  to  procure 
a  component  or  even  pay  a  reasonable  royalty 
for  a  process  to  the  Leader  Company  does  not 
necessarily  invalidate  Che  program.  Such 
restrictions  as  well  as  risks  accepted  by  the 
government  for  product  liability  must  be 
weighed  against  the  objective  of  future  com¬ 
petition.  In  the  ejection  seat  program, 
government  sponsorship  of  the  competing 
designs  and  special  attention  In  Che  Request 
for  Proposal  (RFP  to  legal  rights  provisions 
rendered  an  acceptable  posture  for  the  leader/ 
follower  program  structure. 

b.  A  reasonable  and  thorough  Statement  of 
Work  (SOW)  must  be  established  for  the 
follower  company.  Careful  considerat ion  of 
the  effect  that  ehe  assistance  provided  by 
the  leader  company  will  have  on  preproduction 
requirements  is  mandatory.  If  the  role  of 
the  leader  company  ir.’ preparing  the  second 
source  for  production  does  not  alleviate  most 
qualification  costs,  the  economic  benefits  of 
future  competition  arc  greatly  reduced.  The 
cost  of  the  lcader/follower  program  represents 
"investment11  and  must  have  clear  potential  of 
being  recovered.  This  recovery  potential  is 
directly  proportional  to  the  minimizing  of 
follower  nonrecurring  costs.  By  making  the 
leader  resnonsiblo  for  quality  control  as.u 
test  management,  the  follower  nonrecurring 
costs  were  held  tc  SI. 5  million.  This  was  not 
accomplished,  however,  without  several  itera¬ 
tions  between  management  and  the  technical 
community  on  a  "minimal  requirements"  SOW. 

This  process  must  be  tempered  with  enough 
confldenra  in  the  second  source  s  product  that 
the  government's  willingness  to  see  him  replace 
Che  leader  as  the  supply  source  is  not  hin¬ 
dered. 

c.  A  critical  guideline  for  leadcr/follower 
implementation  is  establishment  of  a  follower 
source  selection  plan.  The  ASPP,  mandates 
subcontract  approval  in  A- 702.  To  be  effec¬ 
tive,  however,  in  the  leadcr/follower  situa¬ 
tion  designed  for  future  comp<  tition,  an 
expansion  of  this  approval  to  c  .  oupass  the 
entire  source  selection  is  necessary.  This 
is  not  a  situation  with  a  leader  company  in  a 
full  capacity  market.  The  vested  interests 
of  the  leader  company  arc  presumed  to  be 
failure  of  the  follower  and  must  be  recognized 
as  such.  The  selection  of  the  follower  oust 
be  controlled  by  the  government  to  assure 
that  the  best  potential  second  source  is 
developed.  This  can  be  done  In  several  ways: 
(1)  directed  by  the  government  based  on  known 
capabilities;  (2)  selected  by  the  leader 
under  acceptable  controls:  or  (3)  otherwise 
selected  by  the  govern  icr.c  through  competition. 
Consideration  was  given  to  each  of  these 
methods.  The  decision  was  made  to  have  the 
follower  selected  by  the  IcaJer  so  that  respon¬ 
sibility  for  performance  would  be  retained  by 


the  leader.  A  source  selection  plan  was  re¬ 
quired  as  part  of  the  production  RFP  and  eval¬ 
uated  during  negotiations.  This  plan  then 
became  a  contractual  requirement  which  the 
government  could  monitor.  Control  of  the 
source  selection  would  be  balanced  against  the 
exercise  of  the  contractor's  judgment.  Spe¬ 
cial  care  wa6  taken  to  assure  that  government 
personnel  acted  only  as  monitors  during  fol¬ 
lower  selection.  Subcontract  approval  was 
issued  when  it  was  determined  that  selection 
was  In  accodance  with  the  establisncd  plan. 

d.  The  above  guidelines  were  worked  out  after 
extensive  study,  Business  Strategy  Panel  ses¬ 
sions  and  consultation  with  the  Staff  Judge 
Advocate.  The  procurement  team  was  satisfied 
that  with  a  proper  RFP,  realistic  SOW  and 
controlled  method  of  selecting  the  follower, 
a  viable  program  could  be  implemented,  ihero 
was,  however,  one  glaring  hole  in  rh.s  assess¬ 
ment  The  missing  factor  was  a  method  of 
assuring  actual  implementation  bv  the  Leader 
once  selected  anti  awarded  the  coni  race  for 
seat  production.  Traditional  positive  and 
negative  performance  incentives  we,  e  consid¬ 
ered  for  application  to  tills  situation.  All 
uere  discarded  as  ineffective.  For  a  positive 
incentive  to  work,  it  would  have  Co  offer  a 
reward  equal  to  less  of  the  firm's  future  sole 
source  business.  Sin^e  this  was  exactly  whs. 
the  government  was  attempting  to  attain 
through  the  leadcr/follower  program,  it  made 
no  sense  to  offer  it  back  as  a  performance 
incentive.  The  most  severe  negative  incentive 
is  Termination  for  Default.  Having  agreed  to 
a  leader/follovcr  arrangement  only  through 
competitive  pressures,  it  was  reasoned  that 
termination  of  the  program  even  for  Dcfaulr 
would  be  welctT-id  by  the  Leader.  Further, 
any  negative  action  affecting  seat  production 
would  be  a  hollow  threat  due  to  their  need. 
After  exhausting  the  various  r.ombinations  and 
possibilities  of  Incentives  between  the 
extremes  just  described,  other  intangible 
motivations  were  explored.  Such  considera¬ 
tions  as  industry  reputation,  unique  program 
participation  and  high  level  Air  Force 
management  persuasion  were  leviewed  and  also 
discarded  as  not  practicable.  The  procure- 
men:  ,  legal  and  policy  team  decided  to  go 
back  to  the  basic  motivator  of  a  free  market 
firm,  profit.  The  final  profit  earned  under 
a  contract  with  a  fixed  price  arrangement  is 
subject  to  many  factors.  Most  of  these 
factors  are  under  the  contractor's  control 
once  his  bid  is  accepted  and  the  contract 
awarded.  One  factor,  contract  financing.  Is 
assumed  by  the  government  and  r.ornally  not  in 
the  firm's  profit  equation.  So  long  as 
acceptable  performance  is  maintained,  prog¬ 
ress  payments  are  made.  Their  suspension  is 
usually  reserved  for  those  situations  where 
performance  has  deteriorated  to  such  a  point 
that  liquidation  isdouutiul.  Therefore,  the 
premise  was  posed  that  contract  financing 
could  be  utilized  as  a  profit  motivator. 


CONCLUSION 


This  would  be  done  by  1  elating  all  piogress 
payments  under  the  contemplated  $60  million 
contract  to  a  milestone  schedule  of  leader/ 
follower  events.  Tills  piemlse  was  accepted, 
and  a  spctlal  provision  written  for  the  RFP 
which  defined  the  interrelationship  oi  progress 
pavments  and  leader/ follower  milestones. 

C0-. TRACI  IMPLEMENTATION 


The  impleneniat ion  of  the  leader/follovei  pro- 
<>’ an  was  accomplished  as  a  priced  contract 
line  Item  described  by  a  SOW  and  definitive 
perfoi inanoo  schedule.  Included  in  the  award 
was  the  Incentive  provision  and  the  contrac- 
t.r's  source  selection  plan.  Pricing  of  the 
line  item  posed  a  leal  challenge  to  both  the 
contractor  and  vovernment  negotiating  teams. 
Because  the  rfini'.i'i  subeont  ructot  would  not 
be  selected  until  some  nine  months  after  award 
of  the  prime  contract,  it  was  essentially 
priced  "in  the  blind."  Competition  could  be 
relied  on  to  produce  effective  pricing  on  the 
ejection  seats,  but  Its  validity  on  the 
leader/fo l lowet  effort  t.as  In  question.  There 
was  conrern  that  an  unrealistically  low  esti¬ 
mate  would  force  the  leader  to  abandon  the 
program  during  nerfotmance  or  seek  a  price 
ire  ease  which  would  laopardlr.o  the  Air  Force 
commitment  to  the  program.  An  estimate  based 
on  a  detailed  work  breakdown  structure  of 
tasks  compared  to  actuals  experienced  oy  the 
competitors  during  their  own  development  pro¬ 
vided  the  best  insight  on  program  costs.  Once 
an  acceptable  range  of  risk  was  established 
for  the  subcontract,  the  contractors'  own 
estimating  systems  and  competition  were  relied 
on  for  the  liaison,  travel  and  technology 
transfer  effort  to  complete  the  line  item  cost 
estimate.  The  negotiated  perfoi mance  schedule 
also  relied  on  the  competitors'  judgments  to 
establish  a  qualified  second  producer  for  the 
Fiscal  Year  19d0  procurement.  This  reliance 
on  the  ■  management  provided  v  sibility  of 
Leader  Coir.panv  planning  and  strengthened  the 
enforceability  of  the  incentive  provision. 

Subsequent  to  award  of  the  production  contract 
fot  the  ACES  II  Ejection  Seat,  leader/ follower 
program  activity  commenced.  Initial  actions 
consisted  of  RFF  preparation  by  Douglas 
Aircraft,  the  selected  Leder  Company,  and  its 
icview  by  a  select  gove-  ient  team.  At  times, 
tne  role  reversal  expert,  ced  by  Douglas  per¬ 
sonnel  In  soliciting  their  own  product  from 
competitors  was  traumatic.  However,  a  competi¬ 
tive  source  selection,  jusi  as  planned  and 
scheduled,  was  completed.  The  selection  was 
ratified  by  the  government  and  In  September 
1977,  the  Weber  Aircraft  Company  embarked  on 
Its  role  as  the  Follower  contractor  of  ACES  II 
Eject  Ion  Seats. 


The  ultimate  su  ss  of  the  program  remains  ti 
be  seen.  Current  visibility  does  allow,  how¬ 
ever,  the  follow!;.,,  comments.  The  procedure., 
for  monitor  lug  the  follower  source  selection 
worked  well  and  accomplished  the  government'-, 
objectives.  There  is  also  evidence  tiiat  the 
Incentive  provision  received  management 
attention  and  has  been  effective.  And, 
finally,  the  subcontract  price  and  program 
costs  to  date  are  well  within  the  estimated 
tolerance  band. 

While  the  goal  of  future  cempetition  is  a 
desirable  position,  many  factors  must  he  ce  - 
stdered  to  r  .ie  a  leader/followe'  program 
realistic  for  such  a  purpose.  The  projected 
economic  benefits  must  be  weighed  acalnst  the 
costs,  risks  and  practicality  ot  i  program. 
Further,  there  are  such  issues  as  the  I'H’it 
of  Engineering  Change  Proposals,  timing  and 
extent  of  future  competition  and  aircraft 
program  changes  which  must  be  addressed.  lire 
final  success  of  this  leader/follower  test 
case  will  be  determined  when  the  judgment  > an 
be  made  that  effective  competition  provides 
ejection  seats  of  requisite  quality,  when 
needed  and  at  costs  clearly  recognisable  as 
advantageous. 
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ABSTRACT 

This  paper  explores  a  fundamental  cause  of  air¬ 
craft  non-availability.  It  shows  that  for  cur¬ 
rent  Air  Force  aircraft,  a  significant  portion 
of  the  lack  of  supply  availability  is  due  to 
not  stocking  items  at  the  base  level.  Basic 
research  on  methods  to  alleviate  this  problem 
in  a  cost-effective  way  is  reported.  It  is 
shown,  with  specific,  real  world  examples,  how 
these  methods  can  be  applied  to  current  inven¬ 
tory  aircraft. 

I.  INTRODUCTION 

The  Air  Force  has  a  sizeable  logistics  struc¬ 
ture  to  support  its  many  squadrons  of  aircraft. 
Two  key  objectives  of  this  support  are  (a)  to 
have  spare  parts  and  supplies  where  and  when 
they  are  needed,  and  (b)  to  minimize  the  cost 
required  to  do  this.  As  might  be  expected, 
there  is  a  tradeoff  between  these  two  objec¬ 
tives.  It  would  be  frightfully  expensive  to 
stock  all  parts  at  every  base,  so  they  would 
always  be  there  when  needed.  On  the  other 
hand,  if  parts  were  only  stocked  at  central 
depots  —  a  relatively  low-cost  strategy  — 
most  aircraft  would  not  be  operational  because 
they  would  be  awaiting  parts  to  be  shipped  from 
the  central  depot  to  the  bases.  Obviously  the 
best  strategy  is  somewhere  between  these 
extremes. 

The  problem  is  a  sizeahle  one  for  three  rea¬ 
sons.  First,  military  aircraft  are  so  complex 
that  failures  of  one  sort  or  another  occur 
quite  often.  Typical  flight  durations  are  from 
2  to  as  much  as  10  hours,  and  there  are  often 
one  or  more  failures  per  flight.  This  results 
ti.  surprisingly  few  mission  aborts  due  to  the 
considerable  redundancy  built  into  most  air¬ 
craft.  On  landing,  however,  the  failed  items 
must  usually  be  repaired  or  replaced  prior  to 
the  next  flight.  This  usually  requires  one  or 
more  spare  parts  to  be  available  at  the  base  or 
to  be  shipped  from  a  central  depot. 


*A  portion  of  the  research  reported  in  this 
report  was  funded  by  the  Air  Force  Office  of 
Scientific  Research  under  Grant  76-3011. 


The  second  reason  for  the  problem  being  size¬ 
able  is  the  large  number  of  different  equip¬ 
ment  items  and  parts  on  these  aircraft.  The 
typical  aircraft  has  about  2,000  work  unit 
coded  repairable  items;  that  is,  items  that 
can  be  either  replaced  or  repaired  directly  at 
the  aircraft  location.  In  addition,  there  are 
many  additional  parts  used  in  base  repair 
shops. 

The  third  reason  for  the  size  of  the  problem 
is  that  many  of  the  items  are  quite  expensive, 
with  most  unit  prices  in  the  range  of  $100  to 
$50,000. 

How  does  the  Air  Force  meet  this  significant 
logistics  problem?  At  present,  "fast  moving" 
items  are  stocked  at  both  base  and  depot 
levels,  while  "slow  moving"  items  are  stocked 
only  at  -he  depot.  Under  present  policy,  an 
item  is  stocked  at  base  level  if  there  has 
been  either  (a)  one  demand  for  the  item  in  the 
last  180  days,  or  (b)  two  demands  during  the 
last  year.  Otherwise,  the  item  is  not  stocked 
at  the  base.  (An  exception  occurs  when  special 
negotiated  levels  are  established,  but  this  is 
rare. ) 

How  effective  is  the  current  policy?  To  answer 
this  question,  Capt.  David  Dawson  recently 
analyzed  aircraft  NORS  (Not  Operationally 
Ready  —  Supply)  downtime  using  data  from  the 
D165B  reporting  system  (see  Reference  1).  He 
found  that  a  significant  percentage  of  report¬ 
ed  downtime  was  due  to  items  not  being  stocked 
at  the  base. 

Figure  1  shows  the  results  of  Capt.  Dawson's 
analysis.  As  shown  in  the  figuie,  about  34X 
of  B-52  supply  downtime  appears  to  be  for 
items  that  are  not  stocked  at  base  level. 
Similarly,  over  half  of  the  KC-135  supply 
downtime  hours  are  associated  with  such  slow- 
moving  .terns.  For  A-7D,  FB-111A,  and  F— 11 1 
aircraft,  about  331  of  supply  downtime  hours 
are  associated  with  such  items. 

Capt.  Dawson's  analysis  indicates  that  non- 
stockage  at  the  base  level  is  a  significant 
contributor  to  aircraft  supply  downtime.  The 
critical  question  is  whether  or  not  it  is  eco¬ 
nomically  desirable  to  reduce  this  downtime  by 
stocking  such  low  demand  items  at  the  base. 
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Figuto  1:  Percent  Supply 

Downtime  Due  to 

Not  Stocking  Items  at  Base 

Aircraft 

Percent 

Type 

Downtime 

B-52 

33.9 

KC- 115 

57.2 

i  A- 7 1) 

34.7 

j  KB-illA 

33.8 

F-lll 

34.7 

Sped  f  lea]  ly ,  is  the  value  of  potential  In¬ 
creases  in  aircraft  availability  sufficient  to 
lustlfy  additional  base  level  inventories? 


1.  ALGORITHM  DEVELOPMENT 

In  this  secLion,  we  present  mathematical  de¬ 
tails  of  a  model  to  evaluate  the  potential 
cost-effectiveness  of  stocking  low-demand  items 
at  base  level.  Section  1X1  then  reports  on 
application  of  this  model  to  locate  specific 
Air  Force  items  with  high  benefit/cost  ratios. 
Surprisingly,  the  special  case  considered  here 
eventually  leads  to  very  simple  benefit/cost 
formulas,  even  though  we  begin  with  the  very 
complex  mathematical  expressions  required  to 
predict  aircraft  availability.  Those  readers 
not  interested  in  the  mathematical  details 
should  proceed  to  Section  III. 


This  expression  follows  from  the  following 
arguments:  II  all  N  aircraft  are  to  be  opei.i- 

tional,  the  total  number  of  units  of  component 
J  needed  is  N-QPAi.  Recall  that  BOi(sj)  de¬ 
notes  the  expected  number  of  "holes"  in  ai:- 
ernft  due  to  buckorders  of  component  j  when  s 
Is  the  base  stock  level.  Hence,  BOj(Sj)/ 
(N-QPAj)  is  the  probability  that  a  parliculat 
"hole"  for  item  j  Is  empty  due  to  a  backorder 
on  that  item.  Hence,  one  minus  this  value  Is 
the  orobnbillty  that  a  given  unit  of  component 
J  is  not  causing  the  aircraft  to  be  Inoperable. 
Finally,  since  each  aircraft  contains  QPAj 
units  of  component  j,  we  mu..:  ta'se  the  prob¬ 
ability  that  each  component  )  unit  is  opera¬ 
tional  to  the  QPA<  power  to  determine  the  prob¬ 
ability  that  all  QPA,  units  are  operational 
simultaneously.  This  gives  us  the  above  ex¬ 
pression  for  q j . 

Once  the  component  availabilities  qj  are  known, 
we  may  determine  Q,  the  probability  that  a  ran¬ 
domly  selected  airctatt  is  opciallonal.  This 
is  given  by 


K 

Q  “  n  q 
j-1  J 


The  1.MI  NORS  Model 

Wc  used  the  Logistics  Management  Institute's 
(LMI)  NORS  (Not  Operationally  Ready  —  Supply) 
prediction  model  as  a  starting  point  for  our 
analysis,  nils  model  was  developed  by  LMI  as  a 
moans  of  relating  the  expected  number  of  opera¬ 
tional  aircraft  to  alternate  Air  Force  stocking 
policies.  Proofs  and  other  mathematical  de¬ 
tails  for  this  model  arc  presented  In  Appendix  3 
of  .Reference  4. 


that  is,  the  probability  chat  a  randomly  se¬ 
lected  aircraft  Is  operational  equals  the  prob 
ability  that  none  of  its  components  is  in  i 
backorder  status.  Finally,  the  expected  num¬ 
ber  of  operational  aircraft  in  a  fleet  ol  N 
aitcraft  Is  Q-N.  Hence,  the  expected  numbei 
of  operational  aircraft,  ENOA,  is  given  by 


The  LMI  NORS  model  may  be  stated  ns  follows:  Without  loss  of  generality,  we  may  assume  that 

|,( >t  each  item  i  Is  numbered  in  order  of  inci easing 

N  «  Quantity  of  aircraft  in  the  system  eemand  races.  Hence,  ENOA  may  he  written  as 


j  «  the  index  of  a  particular  component, 
or  Item,  of  the  aircraft,  J-1,2,...K, 
where  K  Is  th-  total  number  of  items 


°J  " 

QPAj  - 


unit  cost  o  component  J 

the  quantity  of  component  j  on  one 
operational  aircraft 


s 


J 


the  quantity  of  spares  for  component 
j  stocked  at  a  particular  location 


BVV 


the  expected  quantity  of  backorders 
on  component  j  when  the  stock  level 


for  this  component  la  > 


S' 


Now  let  qj  denote  the  probability  that  a  ran¬ 
domly  selected  aircraft  at  a  randomly  determin¬ 
ed  p  int  In  time  does  not  have  any  comp,  vents 
of  t  pc  )  missing.  Mathcmal lea! ly , 


where  .1  denote?  the  number  of  Items  with  veiv 
low  demand  races  (e.g.  Items  with  demand  rates 
icss  Chan  1  demand  in  180  days,  or  .0036  de- 
mands/day).  Thin  expression  may  be  furl  he: 

simplified  to  ENOA  ■  QB,QB,N,  where  Q*'  and  (>** 
denote  the  first  and  second  product  terms, 
respectively,  on  the  right-hand-side  of  the 
above  expression.  The  terra  Q*'  denotes  the 
probability  tlx:  a  low  ->nnd  item  Is  not 
causing  a  "hole”  in  a  rondos >v  -  ’cored  air¬ 
craft,  while  Q11  similarly  denot  •  -  tl..  probabil¬ 
ity  that  a  high  demand  rate  Item  Is  no:  < ana¬ 
log  an  aircraft  to  be  Inoperable. 


360 


If  no  backorders  ever  occurred  for  low  demand 
items,  the  expected  number  of  operational  air¬ 
craft  would  be  N0  "  qK-N.  Hence,  measures 
the  Impact  upon  aircraft  availability  after 
supply  problems  for  high  demand  rate  items 
have  been  accounted  for.  Combining  the  above 
relations,  we  obtain 


(1)  F.NOA  «  Nq-QL 


(6)  AENOAj  - 


Annual  Downtime  Hours 
Due  to  Supply/year 
8760  hours/year 


If  It  is  assumed  that  the  value  to  the  Air 
Force  of  making  one  more  aircraft  available 
is  the  purchase  cost  (unit  price)  of  that  air¬ 
craft,  then  the  benefit,  BENFj ,  is 

(7)  BENF.  -  AENOA  ‘UP 
3  J  8 


If  we  restrict  our  attention  to  items  with  de¬ 
mand  rates  of  no  more  than  2  units/365  days  or 
.0056  unlts/day,  and  base  repair  times  are  in 
the  order  of  10  days  or  less,  BO(sj)  will  be 
very  small  (less  than  .056  units),  even  when 
no  items  are  stocked  at  the  base  (s<-0).  Be¬ 
cause  of  this,  equation  (1)  may  be  greatly 
simplified.  Basically,  when  (1)  is  expan ‘ed 
to  explicitly  represent  all  terms,  we  observe 
that  all  quadratic  and  higher  terms  of  B0(sj) 
are  negligible.  Further  simplifications  are 
observed  when  we  compute  AENOAj ,  the  marginal 
change  in  the  expected  number  of  operational 
aircraft  if  the  base  stock  level  for  item  j  is 
increased  from  zero  to  one  unit.  Details  of 
this  simplification  process  are  presented  in 
Reference  2.  The  major  result  of  this  simpli¬ 
fication  process  is  that  for  low-demand  items, 
AENOAj  is  approximately  given  by 

(2)  AENOAj  -  XjTj-QH 

where  A.  is  the  daily  demand  rate  for  item  j, 
Tj  is  the  average  repair/resupply  time  for 
item  j ,  and  QH  is  the  probability  that  a  high 
demand  item  is  not  causing  an  aircraft  to  be 
unavailable. 


A  Benefit-to-Cost  Ratio 

Using  parameters  from  the  LIST  data  base 
(Reference  3) , 

Annual 

(3)  x  -  S£S22d8 

j  Year 

Downtime  Hours 

/4)  T  .  Pug_to_Sup.Bj&_ 

v  j  Annual  Demands 


Hence, 

(5)  AENOAj 


\>YQ 

Annual  Downtime  Hours 
Demands  #  Due  to  Supply 
Year  Annual  Demands 

Downtime  Hours 
Due  to  Supply  t  -H 
Year  '  V 


Also,  since  total  base  N0RS  rates  are  typical¬ 
ly  5%  or  less,  QH  should  be  greater  than  .95. 
Also,  since  there  are  8760  hours  per  year, 


where  UPS  equals  the  unit  price  of  aircraft 
type  s  and  where  AENOAj  was  previously  defined. 

The  investment,  INVST,  required  to  stock  one 
item  at  each  base  is  simply 

(8)  INVST,  «  UP  -NBASF.S 

j  i  s 

where  UP,  equals  the  unit  price  of  equipment 
item  j  and  NBASESs  is  the  number  of  bases  at 
which  a  type  s  aircraft  is  stationed. 

The  gross  benefit-to-investment  ratio  is  then 

BENF 

(9)  BTIRj  -  INVST^ 


III.  RESULTS 

The  algorithms  described  in  the  previous  sec¬ 
tion  were  programmed  or.  a  CYBER  6600  computer 
and  used  to  screen  through  the  over  22,000 
equipment  items  in  the  LIST  (Logistics  Invest¬ 
ment  Screening  Technique)  data  bsse.  This  data 
base  was  developed  by  personnel  of  PRAM  Program 
Office,  Wright-Patterson  AFB ,  end  is  described 
in  detail  in  Reference  3. 

The  data  base  contains  over  50  key  logistics 
parameters  extracted  from  six  different  Air 
Force  data  systems.  The  data  base  encompasses 
31  inventory  aircraft  and  over  120,000  work 
unit  coded  items.  It  is  based  on  data  for  Octo¬ 
ber  1976  to  September  1977.  While  data  for  sup¬ 
port  cost,  manpower,  etc.,  which  is  work  unit 
coded,  Js  available  on  all  120,000  plus  equip¬ 
ment  items,  data  on  demand  rates  and  unit 
prices  is  available  cmy  on  those  items  with  a 
cross  reference  between  work  unit  code  and  roas¬ 
ter  rtock  number.  At  present,  only  22,000  of 
these  items  are  cross-referenced.  Although  the 
percentage  of  cross-referenced  ItemB  is  snail, 
they  account  for  over  half  of  the  equipment 
failures. 

Of  the  22,000  Items  cross-referenced  In  the 
data  base,  our  analysis  indicated  that  159 
items  had  a  potential  benefit-to-investment 
ratio  greater  than  25:1.  A  much  larger  number 
of  items  occur  at  lower  ratios.  Also,  a  more 
complete  cross-reference  would  increase  the 
number  of  items  which  exceed  this  threshold. 
Table  1  shows  a  portion  of  the  results. 


TABLE  1 


ADDED  SPARES  STOCKING  POLICY  ALGORITHM 


Aircraft 

Work 

Unit 

Code 

Master 

Stock 

Noun 

Demand 

Rate 

Annual 
Demand 
Per  Base 

NORSG 

Hours 

Unit 

Price 

Equipment 

Benefit 

Dollars 

Investment 

Dollars 

Benefit 

Investment 

Ratio 

It 

Kan 

ALC 

em 

a  ger 
COOK 

,vD071) 

ITAAB 

Door 

.0026 

.715 

835. 

1324. 

285959. 

10592. 

27.00 

OC 

BHX 

KC135A 

14AE0 

Panel  Ay 

.0046 

.300 

1200. 

707. 

684932. 

22624. 

30.27 

oc 

CT1 

Fill  A 

45AAJ 

Pump  Hand 

.0229 

1.947 

111. 

333. 

139384. 

667. 

209.10 

OC 

NED 

C130A 

47211 

Regulator 

.0118 

.797 

174. 

197. 

93356. 

3154. 

29.60 

oc 

NTD 

B052D 

41ACI. 

Valve 

.0157 

1.005 

200. 

741. 

253425. 

3705. 

68.40 

oc 

NTG 

A  sample  <>!  iturs  with  an  estimated  return-on- 
investment  ratio  greater  than  25:1  is  shown. 
(Note:  In  these  runs,  QH  was  set  to  1.0). 

Each  equipment  item  is  identified  by  the  air¬ 
craft  tvpe  (MDS) ,  equipment  work  unit  code, 
and  the  master  stock  noun. 

The  demand  rate  per  100  equipment  flying  hours 
as  reported  in  D-041  is  shown  next.  Knowing 
the  quantity  per  application  (QPA) ,  annual 
fleer,  flying  hours,  and  the  number  of  bases, 
the  average  annual  demands  per  base  are  calcu¬ 
lated  and  displayed.  Note  that  this  is  always 
less  than  2.00.  If  the  demands  per  base  was 
2.00  or  greater,  we  assumed  the  item  is  stock¬ 
ed  at  the  base,  and  excluded  the  item  from  fur¬ 
ther  analysis.  The  N0RSG  hours  (annual  fleet 
grounding  hours  due  to  supply)  is  then  shown, 
followed  by  the  unit  cost  for  each  item. 

Finally,  the  benefit,  investment,  and  benefit- 
to- investment  ratio  for  each  item  are  display¬ 
ed.  These  were  calculated  using  the  algorithms 
presented  In  the  previous  section. 

To  illustrate  oar  results,  consider  the  third 
item  in  Table  1 .  This  line  indicates  that  a 
hand  pump  used  on  the  F-H1A  accounted  for  111 
NORSG  hours  during  the  one  year  period  covered 
by  our  data  base.  This  item  has  a  demand  rate 
of  .0229  units  per  hundred  flying  hours,  and 
has  an  nvetage  base  demand  rate  of  1.947  units 
per  year.  This  item  costs  $333  per  unit,  and 
an  Investment  of  $667  would  be  required  to 
stock  one  unit  of  this  pump  at  the  two  user 
bases.  As  shown  in  th  .able,  if  each  NORSG 
hour  lo  priced  out  at  ae  equivalent  cost  per 
hour  of  a  new  ali craft,  a  benef It-to-investraent 
ratio  of  209  is  implied. 

Since  erroneous  data  can  creep  into  the  best  of 
data  systems ,  our  initial  listing  only  shows 
potential  candidates  for  additional  investiga¬ 
tion.  It  is  then  necessary  to  confirm  with  the 
icem  manager  that  an  item  is  actually  a  good 
candidate.  To  speed  this  process  the  item 
manager  is  identified  by  Air  Logistics  Center 
(ALC)  and  item  manager  code.  WiMi  the  ALC  and 
code,  a  phone  number  and  name  can  be  easily 
locut  d  on  f 'equently-updated  Item  manager 
hrbI>.  ment  lists. 


He  called  the  item  managers  on  over  a  dozen 
item'.  In  many  cases  we  found  that  at  any 
po*..w  in  time  only  a  few  of  the  bases  were 
actually  stocking  the  item,  while  most  of  the 
bases  were  not.  This  would  be  expected  i or 
items  with  an  average  demand  per  base  near  2.0. 
The  supply  downtimes  (MORS  hours)  were,  of 
course,  coming  from  bases  not  stocking  the 
Item.  This  indicates  that  our  estimate  for 
the  cost  of  stocking  items  at  the  base  level 
is  somewhat  conservative,  since  in  actual 
practice,  some  of  the  bases  would  already 
stock  the  item. 

In  several  cases  we  found  that  the  .stocks  on 
hand  at  the  depot  were  sufficient  to  allow 
stocking  one  at  each  base  without  any  new  pro¬ 
curement.  In  these  cases  the  cost  would  mere¬ 
ly  be  that  of  redistribution,  ""lere  was  even 
a  case  where  the  depot  stock  was  excess  and 
destroyed . 

On  the  other  hand,  we  also  found  n  cose  of  lra- 
proper  identification  and  one  discontinued 
item.  Vhlle  the  initial  sample  check  over  the 
telephone  increased  our  confidence  in  the  ana¬ 
lytic  results,  further  validation  is  required 
before  full  confidence  can  be  placed  in  the 
resul ts. 

Another  potential  problem  now  being  explored  Is 
that  our  cost-benefit  ratios  are  biased  in  that 
only  items  with  reported  NORSG  hours  were  in¬ 
cluded  in  our  calculations.  Hence,  our  esti¬ 
mates  of  NORS-relatcd  demand  rates  arc  biased 
upwards.  This  bias  is  smallest  for  items  th  ■ 
have  a  large  nun-bet  of  demands  across  all  bases 
(say  10  or  more),  but  still  less  than  two  de¬ 
mands  per  base,  and  is  largest  for  the  very  low 
usage  items.  Fortunately,  It  appears  that  mos! 
of  the  attractive  investment  oppot tunlt les  fall 
in  the  higher  demand  rate  categories.  Neverthe¬ 
less,  despite  the  potential  bias  our  insults 
indicate  thar  the  formulas  described  earlier 
arc  useful  in  Idenr  i  f  vln  ,•  good  candidates  f< 
alternate  slocking  strategies 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


Reference* 


Our  results  indicate  that  the  present  Air 
Force  policy  as  to  whether  an  item  should  be 
stocked  at  the  base  or  not,  may  not  be  optimal 
in  some  cases.  This  is  not,  of  course,  very 
surprising,  as  the  present  policy  is  based 
primarily  on  demand  rates  r..d  does  not  usually 
consider  whether  or  not  an  item  causes  air¬ 
craft  downtime  due  to  supply,  the  amount  of 
downtime,  or  the  cost  to  stock  the  item  at  the 
base  level. 

In  some  cases  it  appears  that  for  a  relatively 
small  investment,  the  more  glaring  discrepan¬ 
cies  created  by  the  present  policy  might  be 
plugged.  What  is  required  next  is  to  take 
specific  cases  uncovered  by  our  analysis  and 
examine  them  in  detail  to  determine  if  the 
benefits  indicated  in  our  analysis  are  realize- 
able  in  the  real  world.  We  recommend  such  an 
evaluation. 

Finally,  it  appears  that  in  the  long  tarm,  it 
might  be  beneficial  for  the  Air  Force  to  re¬ 
vise  its  policy  for  determining  whether  an 
item  should  be  stocked  at  the  base  or  not. 

In  addition  Co  item  demand  rates,  a  revised 
policy  should  also  consider  the  potential  im¬ 
pact*  on  aircraft  availability  and  the  econo¬ 
mics  involved  in  stocking  tha  item.  The  model 
discussed  in  Section  II  provides  a  mathemati¬ 
cal  framework  from  which  such  a  revised  policy 
might  be  developed. 
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THE  COMBINED  LOGISTICS  SYSTEM  MODEL:  CONCEPT  AND  IDENTIFICATION  PHASE 


Major  Robert  F.  Golden,  USAF 


The  Department  of  Defense  presently  has  a 
plethora  of  models  available  for  analyzing 
logistics  support  decisions.  In  the  Defense 
Logistics  Studies  Information  Exchange  1978 
Catalog  of  logistics  Models^  there  are  130 
different  models  listed.  1  These  models 
can  be  grouped  into  several  categories  such  as 
life  cycle  cost  models,  maintenance  posture 
models,  inventory  management  models  and  so 
on.  Each  of  the  models  was  developed  to  deal 
with  only  one  type  of  logistics  problem.  Each 
was  developed  independently  to  solve  one 
pioblcm  in  the  overall  life  cycle  of  a  weapons 
svstem.  Ihe  aoleis  are  treated  as  separate 
entities,  when  in  fact,  they  are  specific 
segments  of  the  overall  life  cycle  which  are 
often  closely  related. 

The  Assistant  Secretary  of  the  Air  Force 
for  Research,  Development  and  Logistics  has 
suggested  that  it  might  be  beneficial  to 
determine  if  the  individual  models  could  be 
combined,  and  If  a  combined  logistics  model 
would  give  logistics  managers  more  insight 
into  the  operation  of  the  logistics  system. 

till  TASK 

The  task  of  producing  a  workable  combined 
logistics  model  is  a  formidable  one  which  was 
not  attempted  by  the  author.  A  useful  first 
step  is  to  identify  specific  models  currently 
in  use  within  the  Air  Force 

The  purpose  of  the  combined  model  as  con¬ 
ceived  by  the  author  is  first  of  all  to 
describe  the  logistics  system  as  it  is,  rather 
than  as  it  should  be.  Ry  being  descriptive 
rather  than  normative,  the  model  could  be  of 
more  practical  use  to  logistics  managers. 
Additionally,  the  mode!  should  be  designed  to 
be  used  at  the  system  or  program  manager  level. 
HDD  Instruction  S000.1  clearly  places  the 
responsibility  for  achieving  the  objectives 
of  the  program  on  the  program  manager  by 
making  him  responsible  for  managing  the  per¬ 
formance,  cost  and  schedule.  S  A  combined 
model  might  help  the  prop  n  manager  to  plan 
logistics  support  more  i  ectivcly. 

Paulson  and  Waina  have  analyzed  the 
logistics  support  process,  and  the  weapons 
system  life  cycle  to  identify  key  decisions 
and  elements.  They  characterize  the  following 
typos  of  models  ns  describing  the  significant 
costs  nnd  logistics  events  inherent  in  n 
systems  life  eyclc  9 

a.  Life  cycle  cost  models. 

b.  Cost  estimating  relat ionship  models . 

c.  t'nintenanie  posture  or  level  of  repair 
mode  i. 

d  ‘  tares  poluv  models 
r.  1  -rse.ii.ic  1  models 


f.  Aerospace  Ground  Equipment  (AGE)  models 

g.  Operations  models. 

The  author's  objective  was  to  identify 
those  existing  models  which  might  describe 
the  logistics  life  cycle. 

METHODOLOGY 

To  identify  the  existing  models,  current 
literature  consisting  of  technical  reports 
and  management  journals  of  the  Air  Force  and 
Department  of  Defense  (DOD)  were  surveyed. 

The  Defense  Logistics  Studies  ir*orm  it  ion 
Exchange  developed  a  special  bxblioj r <phy  of 
DOD  logistics  systems  models  and  provided 
documents  on  the  various  models  to  the  author 
Additionally,  the  offices  of  primary  responsi¬ 
bility  for  the  various  models  in  the  Air  Force 
Logistics  Command  were  contacted.  As  a  result, 
four  models  which  are  in  actual  use  within  the 
Air  Force  were  selected,  which  when  taken 
together  include  all  the  significant  logistics 
events  set  forth  by  Paulson  and  Waina:  the 
AFLC  Logistics  Support  Cost  Model,  the  Optimum 
Repair  Level  Analysis  with  AGE  model,  the 
Logistics  Composite  model,  and  the  MOD-METRIC 
mode  1 . 


The  AFLC  Logistics  Support  Cost  Model 


The  Logistics  Support  Cost  (ESC)  Model  i->  at. 
accounting  life  cycle  cost  model  which  i>  used 
to  estimate  the  support  cost  of  a  -pacific 
weapons  system  or  equipment  design.  ESC  is 
used  for  differentiating  the  logistics  support 
costs  of  competing  systems  during  source 
selection,  and  for  evaluating  design  alter 
natives  during  prototyping  or  full  s«.ile 
development,  <> 


l.SC's  major  advantage  is  the  depth  of  cost 
detail  which  the  model  can  use.  ltc  major 
limitation  is  that  the  data  is  often  unwieldy 
because  of  the  detail  of  inputs  and  outputs. 

3  The  model  is  genera!  in  nature  and  has 
been  used  in  most  new  major  Air  Force  weapons 
systems.  Since  the  mode)  has  get  oral  appli 
cability  it  must  hr  tailored  for  use  on 
spool  lie  weapons  sy"<» ns. 


The  Logistics  Composite  Model 


The  Logistics  Composite  Model  (L-COM)  is  a 
computci  simulation  which  analyzes  the  impact 
ot  shortages  of  support  resources  on  the 
operational  status  of  a  wejpons  system  at  v. 
air  base  '  9  I,  COM  is  -iced  to  estimate 

maintenance  manpower  re,,.. > reme'  t  t  Air  1  orce 
weapons  systems,  both  undei  devei«.;e  ■  .  i.i 

in  the  inventory  II 


The  model  simulates  an  actual  base 
operation  with  support  resources  and 


operational  polici.s  defined  by  the  user.  The 
user  specifies  the  maintenance  trshs,  times, 
types  of  missions  flown,  mission  length,  etc., 
to  define  the  scenario.  7  L-CCM  is  flex¬ 
ible  enough  to  meet  the  needs  of  duYorent 
situations.  For  example,  it  can  process 
spares  on  either  an  iten-by-item  cr  a  complete 
subsystem  basis.  7 

L-COM  provides  the  needed  link  to  relate 
support  cost  effectiveness  and  operational 
readiness  in  an  operational  scenario.  For 
instance,  L-COM  will  track  the  percentage  of 
missions  requested  which  were  accomplished, 
in  relation  to  logistics  resources  and  levels 
available.  7  The  L-COM  program  output 
includes  various  support  and  operational 
effectiveness  parameters  for  the  simulated 
base  operation. 

The  user  must  input  a  large  number  of  data 
elements  to  define  maintenance  tasks,  opera¬ 
tional  parameters,  and  other  specific  activ¬ 
ities,  however  this  information  produces  use¬ 
ful  output  information  for  determining  main¬ 
tenance  manpower  requirements  of  a  weapons 
system. 

Optimum  Repair-Level  Analysis 

The  Optimum  Repair-Level  Analysis  I.ORLA) 
model  used  in  AFLC  is  a  single-item,  single- 
indenture  model  which  analyzes  the  main¬ 
tenance  posture  for  a  line  replaceable  unit 
(LRU)  (1:  1-3)  It  is  used  to  determine 
whether  a  spare  part  should  be  repaired  at 
the  base,  repaired  at  the  depot,  or  discarded 
at  failure.  ORLA  assumes  that  cost  consider¬ 
ations  are  overriding  in  this  maintenance 
decision  1 

The  user  must  define  parameters  which 
define  the  operational  and  maintenance  con¬ 
cepts  which  will  be  used  in  the  weapons  sys¬ 
tem.  Examples  include  number  of  squadrons, 
operational  ready  rate,  and  number  of  aircraft 
at  a  base.  1 

Items  are  screened  using  an  iterative  pro¬ 
cess  which  employs  different  screening  rules 
to  compare  the  costs  of  different  levels  of 
repair.  1  (2-10)  The  computer  model  sub¬ 

jects  the  final  maintenance  decision  to  a 
sensitivity  analysis.  10 

The  problem  of  allocating  costs  of  common 
aerospace  ground  equipment  (AGE)  has  been 
addressed  in  the  ORLA  computer  program, 

"ORLA  with  AGE"  written  by  AFLC’s  Warner- 
Robins  Air  Logistics  Center.  Another  limita¬ 
tion  of  ORLA  is  that  it  only  addresses  the 
repair  decision  at  the  LRU  level  and  does  not 
prove  useful  for  items  at  lower  indentures. 

11 

ORLA  is  used  for  making  repair  level 
decisions  on  weapons  systems  by  all  Air  Force 
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contractors.  1  This  accounting  model  is 
the  way  that  the  Air  Force  makes  its  repair 
level  decisions. 

MOD-METRIC 

MOD-METRIC  is  a  mathematical  model  for 
managing  recoverable  spares  in  a  mult i - item, 
mult i -echelon,  mult i -indenture  inventory 
system.  8  Unlike  other  management  models, 
MOD-METRIC  is  more  realistic  in  that  it  con¬ 
siders  the  effects  of  backorders  of  shop 
replaceable  units  (SRU)  and  line  replaceable 
units  (LRU).  2  A  backordered  SRU  might  only 
delay  repair  of  an  LRU  while  a  backordered 
LRU  can  ground  an  aircraft. 

Input  data  for  the  MOD-METRIC  computer 
models  is  required  on  the  flying  hour  pro¬ 
gram  and  each  recoverable  item.  Such  para¬ 
meters  as  item  unit  cost,  mean  time  between 
demands  and  depot  repair  time  are  used  in  the 
model.  2 

The  objective  of  the  model  is  "to  determine 
spare  stock  levels  at  each  echelon  which 
minimize  total  expected  base  backorders  for 
the  assembly  subject  to  a  constraint  on 
investment  in  spares."  11  l.agrangian  multi¬ 
pliers  apportion  a  budget  among  the  SRUs  ot  a 
particular  LRU  and  the  model  optimizes  the 
stock  levels  of  multiple  LRU’s  over  the  entire 
inventory  system  subject  to  budgetary  con¬ 
straints.  2  This  inventory  management 
technique  has  been  used  in  determining  spares 
levels  for  the  F-15  aircraft. 

RESULTS 


The  four  models  selected  arc  in  common  use 
in  the  Air  Force  and  therefore  represent 
reality  for  the  Air  Force  logistics  system. 
They  represent  how  the  existing  system 
operates  rather  than  how  it  should  operate. 

To  determine  the  synergistic  effect  of 
combining  the  models  several  steps  must  be 
taken.  The  first  is  to  investigate  and  define 
the  relationships  between  the  individual 
models,  and  resolve  any  inconsistencies  The 
next  step  should  be  to  program  the  combined 
model  on  the  same  computer.  The  program  will 
integrate  the  selected  models  into  one  inter¬ 
active  model.  This  will  allow  the  user  to 
change  parameters  at  any  time  during  the 
program  and  would  enable  him  to  perform  such 
things  as  intermediate  sensitivity  analysis 
during  the  program. 

Finally,  the  combined  model  should  be 
tested  by  using  it  for  logistics  planning  for 
a  new  weapon  system.  This  will  enable  plan¬ 
ners  at  the  program  or  system  management  level 
toobtam  a  long  tci.a  view  of  the  system 
logistics  life  cycle.  The  most  practical 
way  to  assess  whether  the  combined  model 
increases  the  logisticians  insight  into  the 
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logistics  process  is  to  see  what  the  model 
can  do  for  personnel  actually  involved  in  the 
process.  Actual  results  of  the  program  can  be 
compared  with  the  model  outputs  throughout 
the  various  phases  of  the  system's  life  cycle 
to  determine  the  validity  of  the  combined 
mode  1 . 

The  combined  logistics  system  model  should 
he  applicable  to  any  type  of  weapons  system 
or  even  to  major  systems  within  the  weapons 
system.  By  remaining  general,  the  combined 
mode!  will  >m*  more  widely  applicable  and 
useful  for  Air  force  logistics  personnel. 
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SPARES  ACQUISITION  INTEGRATED  KiTH.  PRODUCTION 

RALPH  W.  FOUNTAIN,  WARNER  ROBINS  AIR  LOGISTICS  CENTER 
F-15  ACQUISITION  DIVISION 


The  Air  Force's  acquisition  of  the  F-1S 
Fighter  Aircraft  incorporated  many  innovations 
to  improve  the  logistics  posture  at  a  lower 
cost.  One  of  these  was  the  manner  which  both 
initial  and  replenishment  (follow-on)  spares 
were  procured.  This  new  process  has  since 
been  formalized  in  Air  Force  Regulation  800-26, 
entitled,  Spares  Acquisition  Integrated  with 
Production  (SAIP) .  SAIP  is,  in  essence,  a 
procedure  to  decrease  spares  acquisition  cost 
through  concurrent  ordering,  production,  ship¬ 
ment  and  pricing  of  production  line  installs 
and  spares. 

In  1973,  aircraft  production  line  cost  for  an 
item  was  compared  to  the  cost  for  a  spare  and 
the  significant  lower  cost  for  the  production 
line  item  caused  an  intensive  research  program 
within  the  F-15  System  Manager  Division  at 
Warner  Robins  Air  Logistics  Center  to  begin. 

The  finding  wcs  the  cost  differential  basically 
occurred  because  the  spares  were  bought  out  of 
synchronization  with  the  production  line 
requirements.  This  caused  additional  produc¬ 
tion  line  set  up  and  tear  down  charges  and 
higher  piece  part  prices  for  the  spares 
fabrication.  If  the  orders  for  the  production 
line  and  the  spares  could  be  consolidated  and 
released  by  the  Prime  as  a  single  order,  the 
cost  differential  would,  for  practical  purposes 
be  eliminated.  An  example  of  one  sub-system 
is  reflected  below. 


FISCAL  YEAR 
NR  OF  ITEMS 
NR  OF  PIECES 
TOTAL  VALUE 
AVG  COST/PART 


CASE  1 

SPARES 
PROCURED 
CONCURRENT 
WITH  FY 
PRODUCTION 

1977 

32 

303 

$1,839,198 

$6,071 

SUMMARY 


CASE  2 

SPARES 
ORDERED 
AT  VARIOUS 
TIMES  DURING 
THE  PROD  YR 

1977 

32 

303 

$2,381,573 

$7,860 


CASE  2  COSTS  ARE  129Z  OF  CASE  1  COSTS 


The  System  Manager,  working  in  concert  with 
the  McDonnell  Aircraft  Corporation,  evolved 
the  procedure  currently  in  use  for  spares 
acquisition  for  the  F-15  Aircraft. 

There  are  four  specific  goals  to  be  achieved; 


(1)  Fiscal  economics,  by  procu  ’ing  spares 
concurrent  with  aircraft  production  releases, 

(2)  No  Impacts  on  current  Air  Force  computer 
systems, 

(3)  Minimize  impact  on  contractor  internal 
procedures,  and 

(4)  Retain  configuration  control  and  proration 
of  assets. 

To  achieve  these  goals,  a  contract  must  be 
written  having  specified  parameters.  These 
are: 

(1)  The  prime  manufacturer  must  submit  a 
production  line  sub-system  Purchase  Order 
release  schedule, 

(2)  Proration  of  assets,  when  configuration 
changes  occur, 

(3)  Configuration  control, 

(4)  No  early  deliveries,  and 

(5)  Unit  price  integrity 

The  Government,  on  its  part,  must  also  agree  to 
certain  restraints.  These  are: 

(1)  Once  the  basic  order  is  released,  the 
quantities  are  inviolate, 

(2)  Any  increases  will  be  treated  as  a 
separate  "stand  alone"  order  and  not  part  of 
the  basic  SAIP  procurement , 

(3)  There  will  be  no  decreases,  instead,  these 
overages  will  be  applied  to  downstream  require¬ 
ments,  and 

(4)  The  only  exception  to  (3)  above  is  where 
an  item  is  deleted  and  not  replaced  or  super¬ 
seded.  In  this  case,  the  Government  will 
accept  termination  charges  up  co  date  of 
approval  of  change,  deleting  the  item. 

These  features  are  new  in  most  instances  to 
Government-type  contracts,  but  there  are 
advantages  to  be  realized  by  both  Government 
and  Industry.  Implementation  of  this  tech¬ 
nique  on  the  F-15  Aircraft  has  both  fiscal  and 
logistics  advantages  to  the  Air  Force. 

Logistics  requirements  are  produced  concurrent¬ 
ly  with  the  installs.  There  is  a  simultaneous 
"cut-in"  design  change  that  results  in  produc¬ 
tion  of  properly  configured  spares.  This 
timely  proration  reduces  retrofit  costs. 
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Thcie  Is  certainly  an  avoidance  of  production 
line  "set  up"  and  "tear  down"  charges  with 
concurrent  production  of  installs  and  spares. 
i>>  procurin'.;  through  the  Prime,  design  changes 
.ire  documented  to  aircraft  serial  number,  not 
verdot  unit  serial  number;  "spares  support" 
becomes  a  more  viable  criteria  for  determining 
the  point  t*  de;.i:,i:  change  incorporation.  The 
i.overnment  receives  the  benefit  of  volume 
pri  lug  by  the  ,  umblnir.g  of  the  spare  and 
proju  tion  line  order.  Under  the  unit  price 
.ntigntv  clauses  ot  Liie  contract,  the  unit 
cost,  once  established,  is  only  subject  to  re¬ 
negotiation  when  conf i gurat ion/des ign  changes 
atfecr  an  ;iva  to  the  extent  that  it  bears 
11’ tie  or  ni  re* emblnnc e  to  tlie  item  ordered. 

The  pi  ire  manufacturer  oejoys  advantages,  also. 
Onbin  ig  -ion  lin-  and  spares  procure¬ 

ments,  to.  .  ^atvide  of  the  order  drives  the 
prodmtlor  line  install  cost  down  and  he  gains 
tlie  oatnings  «u  all  the  spares  orders,  last, 
the  vendor  acniiwi-  advantages  sucii  ns  one 
annual  ordet  tor  spares,  rather  than  piece¬ 
meal  e-rde-rf  throughout  the  vear.  lie  can 
collectively  older  piece  parts  for  pricing 
advantage'  ind  liie  scheduling  for  manufactur¬ 
ing  i  '  e* •  rnuel.  simplified. 

How  does  tills  SAIP  procedure  work  in  actuality? 
This  is  how  it  was  and  Is  applied  to  the  F-15 
Aircraft  at  Warner  Robins  Air  logistics  Center, 
Robins  APS,  Georgia. 

The  F-15  System  Manager,  utilizing  its  data 
base,  isolated  those  sub-systems  where  most  of 
liie  dollars  rad  been  spent.  Ulneeton  sub¬ 
systems  accounted  for  some  elghty-f ive  percent 
of  the  spares  budget.  The  determination  was 
made  that  SAIP  procedures  would  be  applied  to 
these  systems  at  t’’e  LRl’/SRU  indenture  level 
only. 

McDonr*ll  Alrcralt  Corporation  (McAir)  submits 
•.hell  until  il  Purchase  Order  Release  Schedule 
to  the  System  Manager,  UiO  days  prior  to  chclr 
first  P.0,  release.  The  System  Manager, 
a,  ting  at  a  foi  si  soint,  submits  co  tlie  Item 
Managers,  at  each  o:  the  five  logistics  Centers 
listings  of  those  items  which  are  to  be 
procured  under  the  SAIP  technique.  They,  in 
turn,  send  the  procurement  requirements  for 
•hese  Items  co  the  Sysco-  Manager.  The 
Purchase  Request  Is  tin-  prepared  and  sent  to 
Procurement  for  Contr  ct  Award.  The  Due-In 
Asset  System  is  energized  and  all  configura¬ 
tion  management  of  these  items  is  maintained 
jy  tlie  System  Manager. 

Usually,  this  Purchase  Request  Is  released  to 
coincide  with  the  latest  requirements  computa¬ 
tional  eye'e  to  ensure  the  most  current  pro¬ 
curement  requirement  is  released  to  production. 
To  date,  this  timeframe  itas  caused  Procurement 
to  award  letter  Contracts  to  meet  deadlines  oi 
Purcha- e  Order  releases  by  McAir. 


These  Contract  Awards  averaged  25  days  f:.- 
date  of  receipt  of  the  Purchase  Request  t 
award  of  Letter  Contract.  With  this  type  of 
document,  100%  obligations  and  lengthv  dtt'ini 
tization  of  schedules  caused  the  Atr  Force  to 
author! ze  the  Warner  Robins  Air  Logistics 
Center  to  prepuce  a  specialized  Basie  Order¬ 
ing  Agreement  for  SAIP  procurements,  it 
contains  provisions  for: 

(1)  Priced  Orders 

<2 >  Unpriced  Orders 

•3)  Unlimited  delegation  of  authority  to 
W..-.Vr  Commander  to  approve  priced  and  un¬ 
priced  SAIP  0.2‘TS 

(4)  ilq  AFLC  alter  the  fact  rev.cv 

(5)  Only  WR-ALC  can  issue  SAIP  Orders 

(6)  Multiple  pricing  it.  thods.  FI' I S  is 
primary  with  FPIF  and  FFP  ns  options,  and 

(7)  All  the  parameters  of  a  SAIP  contract 
previously  discussed. 

This  BOA  gives  the  F-15  Program  the  responsi , 
ness  and  obligation  rata  desired. 

This  SAIP  approach  has  proven  to  be  a  most 
expeditious  and  economical  technique  for  the 
acquisition  of  spares.  Il  can  bo  eqnnllv 
applicable  to  both  the  Initial  and  Replenish¬ 
ment  area  of  spares  procurements .  The  F-15 
Program  lias  realized  the  follow1-  cost 
reductions: 

$  8.0M  -  1974 

S27.0M  -  1975 

$39. 0M  -  1976 

$31 .ON  -  1977 

$35. 0M  -  1978  (Estimated) 

Within  the  Air  Force,  the  A-10  and  F-16 
Aircraft  are  utilizing  the  SAIP  techniqie  md 
the  Davy  Is  considering  it  for  the  F-18. 
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PROJECT  METEOR:  MOTIVATING  EVEPYONE  TO  ENHANCE  OPERATIONAL  RELIABI L ITY /MAISTAIKAB I !. I TY 

Lt.  Cot.  Thomas  C.  Farrell,  United  Scares  Air  Force 
Edward  T.  Tircparlake,  The  Analytic  Sciences  Corporation 


INTRODUCTION 


This  paper  describes  a  project  that  is  being 
sponsored  by  the  Air  Force  PRAM  Program  Office 
in  conjunction  with  the  Aeronautical  Systems 
Division  (ASD)  office  responsible  for  providing 
program  control  support  to  the  Deputy  for  Aero¬ 
nautical  Equipment  (ASD/AE) .  The  paper  will 
discuss  the  macroeconomic  trends  and  DoD  direc¬ 
tives  that  provide  the  impetus  for  the  initia¬ 
tion  of  a  jointly  developed  program  between  the 
Air  Force  and  The  Analytic  Sciences  C>rporation 
(TASC).  The  developed  system  is  a  microecono¬ 
mic  management  structure  chat  provides  a  meth¬ 
odology  that  has  as  it's  fundamental  goal 
Motivating  Everyone  to  Enhance  Operational 
Rellability/Maintainabllity  of  procured  systems. 
(Project  METEOR). 

The  principal  elements  of  Project  METEOR  in¬ 
clude  the  use  of  a  Life-Cycle  Cost  concept  for 
selecting  production  contractors,  innovative 
techniques  for  testing  equipment  under  simula¬ 
ted  operational  conditions,  and  ar.  organized 
approach  to  acquiring  and  evaluating  data  from 
program  test  elements  that  can  be  used  to  help 
determine  projected  Life-Cycle  Costs  for  equip¬ 
ment.  All  of  these  techniques  are  used  to  sup¬ 
port  the  application  of  contractual  incentive 
features  such  as  the  Reliability  Improvement 
Warranty  (RIW) .  The  paper  will  discuss  each 
of  these  elements  of  the  project  and  will  pro¬ 
vide  an  explanation  of  detailed  case  studies 
where  the  project  elements  have  been  applied. 

The  case  studies  to  be  covered  In  the  paper 
will  include  the  acquisition  of  an  airborne 
navigation  system  referred  to  as  OMEGA,  pro¬ 
curement  of  a  standard  VHF  AM/FH  radio  for  Air 
Force  use,  and  certain  aspects  of  the  current 
Standard  or  Cormaon  Strategic  Doppler  (CSD) 
acquisition  program.  Although  the  elements 
used  in  all  three  cases  are  similar,  there  are 
particular  differences  In  terms  of  the  type3 
of  procurement  techniques  used  in  each  program. 
These  differences  will  be  highlighted  in  the 
context  of  the  decision  criteria  and  specific 
procedures  associated  with  the  various  cost 
control  or  incentive  schemes.  The  emphasis 
will  be  on  che  construction  of  the  procurement 
package  with  specific  discussion  centered 
around  the  lncentlvlzlng  techniques  that  were 
applied. 

The  motivational  techniques  which  will  be  dis¬ 
cussed  Include  the  Reliability  Improvement 
Warranty  (RIW)  and  organic  repair  concepts 
using  an  MTBF  Verification  Test  (HTBF/VT)  con¬ 
cept.  The  decisions  leading  up  to  source  se¬ 
lection  will  be  discussed  in  terms  of  che  use 
of  life-cycle  cost  estimating  schemes  and 
specific  procedures  associated  with  the  various 
procurement  concepts. 


The  role  which  can  be  played  by  an  independent 
agent  who  can  provide  objective  analyses  and 
support  will  be  outlined.  Finally,  recommen¬ 
dations  are  made  regarding  the  application  of 
these  techniques  to  future  programs. 


OVERVIEW 


A  Need  Exists  to  Reduce  O&S  Coses:  During  the 
last  decade  DoD  ha3  become  acutely  aware  of  i  c.e 
challenge  to  simultaneously:  reduce  jr.ii  .in¬ 
quisition  and  O&S  costs,  inc.ease  reud;:ies-.  ar.<: 
achieve  acceptable  military  performun-.e.  Ihr 
extent  of  this  challenge  is  illustrated  In  K:g- 
ure  1.  Both  Che  Five  Year  Defense  Flan  and  Ex¬ 
tended  Planning  Annex  forecast  signifj..,nt  re¬ 
ductions  in  the  ratio  of  OSS  costs  as  a  percent 
of  che  total  DoD  Budget.  However,  to  reverse 
the  historical  trend  strong  corrective  action 
is  required.  (3) 


HirroetcAL 


rUJOKD 


Figure  1  O&S  as  a  Percent  of  Total  DoD  Budge t 

A  primary  cost  driver  in  the  historical  rise  In 
the  ratio  has  been  increasing  manpower  costs  as¬ 
sociated  with  the  less  than  desired  reliability 
and  maintainability  characteristics  of  opera¬ 
tional  weapon  systems  and  equipment.  Therefore, 
considerable  emphasis  on  reducing  costs  by  im¬ 
proving  operational  equipment  reliability  and 
maintainability  Is  needed.  Certain  provisions 
In  DoD  Directive  5000.28  "Design  to  Cost"  were 
designed  to  provide  this  emphasis.  (2)  The  pro¬ 
visions  of  5000.28  ••  interest  In  this  regard  are 
chose  tnat  delineate  the  responsibilit-.  of  de¬ 
cision  makers  at  a.l  levels  In  the  acquisition 
community  to  sharpen  their  program  management 
tools  for  analysing  and  controlling  life-cycle 
costs.  This  paper  illustrates  practical  exam¬ 
ples  of  the  employment  of  DoD  5000.28  principles 
in  equipment  acquisition  activities.  It  must 
be  noted  that  life-cycle  cost  analysis  In  o..Iy 
a  part  of  the  total  cost  control  environment. 

The  use  of  other  techniques  and  principles  to 
motivate  equipment  manufacturers  to  reduce  O&S 
costs  are  also  Important. 
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il'.i-  following  busic  principle*  are  typical  of 
(bo :iu  being  applied  at  ASD/AE  to  provide  the 
basic  motivation  to  produce  modern  equipment 
which  satisfies  roqulrcmtuits  to  optimize 
liio  i  vi-lv  cost  characteristics:  (7] 

*  Itealgn-to-cost 

•  System  life-cycle  cost,  projections 
am)  controls 

•  Compet I t lve  procurement  through 
the  pro-product  Ion  and  production 
phases 

*  Improved  estimation  of  program  coats 
and  their  use  in  source  selection, 
budgeting,  etc. 


that  Incorporate*  u  spectrum  of  motlvaMoi  • If 
derision  technique*  Including  a  computer  I  ,  ' 
l.CC  model. 

It  should  b*  mentioned  here  that  funding  I >r 
the  OPLAN  METEOR  development  work  is  being 
provided  through  the  PRAM  program  office.  Thu 
office  he*  been  created  within  the  Air  Force  i 
provide  a  eource  of  funding  and  direction  for 
efforta  designed  to  reduce  out-year  coats. 

Thu  project  le  being  managed  Jointly  ae  a 
PRAM/ASD  venture  and  le  a  prime  example  of 
how  up-front  funding  can  be  applied  to  save 
significant  coats  In  the  future. 


METEOR  CONCEPT 


•  >i..'uu.irdlzation 

•  Kin  'lon-.l  system  specification 

•  Rol  .nbt  'ty  Improvement  Warranties 
.,nd  l.CC  0.  ’ran tees 

•  Design  for  enha,. --d  reliability 
and  maintainability 


One  of  ASO/AE’s  Solutions:  OP LAN  METEOR  -  In  be 
past,  equipment  has  entered  the  Air  Force  opera 
clonal  Inventory  with  unacceptable  Initial  re¬ 
liability.  Historically  the  initial  operational 
reliability  of  avionics  equipment  has  been  only 
10%  of  the  specified  reliability.  This  indica¬ 
ted  a  need  for  changes  to  the  business  strategy 
which  had  been  employed  in  the  past  within 
avionics  acquisition  programs.  [3] 


The  Joint-Denign-co-Cost-Gulde  [1:3]  defines  an 
acquisition  region  as  a  range  of  acceptable  solu¬ 
tions.  This  range  is  constrained  between  cer¬ 
tain  minimum  essential  performance  parameters 
which  must  be  obtained  for  the  system  to  be  mis¬ 
sion  capable,  and  certain  coat  ceilings  which  must 
not  be  exceeded  for  the  system  to  be  affordable 
in  the  quantities  required.  It  is  visualized 


Range  of  Acceptable  Solutions 


Perform, ..nee  Floor 


Therefore,  It  follows  that  a  procurement  manage¬ 
ment  system  that  Incorporates  the  previously 
mentioned  macro  considerations  should  provide 
the  decision  maker  with  the  ability  to  intelli¬ 
gently  optimize  a  solution  in  the  acceptable 
region.  Essentially,  METEOR  provides  the  pro¬ 
gram  manager,  engineers,  logisticians,  and  fi¬ 
nancial  analysts  with  a  coordinated  approach  to 
obtaining  such  an  optimum  solution.  An  Import¬ 
ant  is  lue  with  respect  to  OPLAN  METEOR  is  that 
It  Is  n  augmentative’ management  methodology 


Methoa  ’logy  -  The  methodological  .  .msldorut Ions 


•  To  appl,  consistent  l.CC  estimat¬ 
ing  ground  rules 

•  Motivate  Dislgn  efforts  to  reduce 

l.CC 

e  Test /Independent  Assessment  of 

R/\  urovth 

s  '.ae  procurement  techniques  to 

promote  LCC  reductions 

An  J  crinaic  element  In  the  methodology  Is  tlx* 
lXr  Model.  [6]  However,  the  methodology  ir, 

•  ,r  more  Inclusive  than  Juat  applying  a  com¬ 
puterized  declaion  tool  auch  as  LCCA.  Consid¬ 
erations  relevant  to  design  flexibility,  system/ 
subsystem  performance  characteristics,  repair 
level  analysis,  and  manpower  staffing  require¬ 
ments  are  also  Included.  The  level,  of  appli¬ 
cability  can  be  expanded  and  contracted  as 
needed.  Since  the  concept  has  been  used  on 
several  programs,  the  specific  procedures  are 
also  capable  of  standing  the  test  of  historical 
validation.  This  will  be  shown  In  the  next 
section  when  specific  case  studies  are  dis¬ 
cussed  . 

The  application  of  the  methodology,  even  In  a 
manpower  auatre  environment  at  ASD/AE,  has  had 
considerable  success.  The  ASD/AE  program  manage¬ 
ment  philosophy  places  full  accountability  on 
the  Program  Manager  for  all  aspects  of  the  Pro¬ 
gram.  Part  of  the  success  of  the  concept  is  re¬ 
lated  to  the  fact  that  It  has  helped  Program 
Manager's  coordinate  cnglneerlnR/deslgn  require¬ 
ments  with  loglstlcs/cost  considerations.  This 
has  been  done  In  a  way  that  allows  ileal gn  en¬ 
gineers  and  financial  analysts  to  communicate 
with  each  other  about  the  unique  Influences  rhot 
affect  coat.  A  lexicon  and  an  organized  approach 
If.  provided  which  both  contribute  to  a  common 
understanding  of  LCC  goals.  Various  signifi¬ 
cant  spin-off  benefits  hsve  been  noticed  from 
the  prcvloun  applies) Iona.  The  moat  slgnflcant 
Is  the  Introduction  of  l.CC  coiibIu.-i  .  t  ions  at  the 
working  level  within  ASP/AF.,  thus  cresting  .1 
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cadre  of  analysts  old  engineers  that  thinks  in 
terms  of  life-cycle  costs  as  well  as  satisfac¬ 
tion  of  technical  requirements.  What  has 
evolved  Is  an  organizational  memory  bank  that 
promotes  the  use  of  tested  concepts  in  subse¬ 
quent  equipment  acquisition  efforts. 

Model  -  The  foundation  of  any  life-cycle  cost 
program  is  an  estimate  of  total  program  costs 
which  can  be  used  to  identify  the  major  cost 
drivers.  Total  costs  are  estimated  so  that 
the  relative  weighting  between  cost  elements 
is  understood.  Tills  relative  weighting  can 
then  be  used  for  tradeoff  analysis  to  determine 
the  lowest  overall  program  cost  alternatives. 

Early  clarification  of  assumptions  underlying 
the  elements  of  cost  is  an  important  step  to 
take  in  the  estimating  process.  This  is  en¬ 
hanced  through  application  of  a  life-cycle 
cost  model.  For  most  programs  the  detail  nec¬ 
essary  to  support  cost  estimating  activities 
can  be  handled  most  efficiently  if  the  cost 
model  Is  computerized.  A  computerized  model 
also  helps  clarify  the  definitions  of  all  terms 
and  Input  factors.  If  the  coGt  model  is  well 
designed,  the  engineering  data  inputs  can  be 
designated  early  in  order  to  promote  understand¬ 
ing  of  the  basic  assumptions  underlying  the 
cost  estimates. 

A  computerized  model  also  makes  it  easier  to 
keep  up  with  design  and  program  changes  as 
they  occur.  Program  LCCA,  the  system  developed 
for  METEOR  and  Illustrated  conceptually  In  Fig¬ 
ure  2,  Is  written  in  Fortran  IV  for  Operation 
from  remote  terminals  using  telephone  access  to 
the  General  Electric  Mark  III  Time  Sharing  Sys¬ 
tem.  Convenience  of  operation,  file  security 
to  protect  sensitive  data  and  input-output 
flexibility  are  emphasized  in  Program  LCCA. 


ICCA  UIC AS  ICO  PROGRAM  MODULES  UXA  SPECIFIC O  OUTfUT 


Figuie  2  Overview  of  the  LCCA  System 


Once  a  baseline  set  of  Input  flies  has  been 
established,  the  effect  of  changes  to  any  of 
the  input  parameters  can  be  readily  investigated 
through  the  user  interface  structure  provided 
for  this  purpose. 

Using  the  baseline  files,  the  analyst  can 


•  Modify  program  inputs 

•  Request  specific  output  reports 

•  Conduct  sensitivity  analysis. 

A  nice  feature  of  LCCA  In  addition  to  the  LCC 
model  is  the  Cost-Exec  interface.  The  Cost- 
Exec  Interface  provides  a  flexible,  efficient 
and  convenient  user  interface  to: 

•  Simplify  data  entry  and  program 
execution 

t>  Allow  creation  of  multiple  runs 

with  a  minimum  of  input  Instruc¬ 
tion 

•  Accomplish  tradeoff,  sensitivity 
and  risk  analysis  with  a  single 
set  of  input  commends. 

The  total  LCCA  system  provides  the  analyst  oi 
design  engineer  with  the  capability  Co: 

•  Identify  the  major  cost  drivers 
during  the  system's  life  ry<  le 

•  Investigate  Lhe  sensitivity  of 
life-cycle  cost  to  uncertain 
parameters  (MTBF,  repair  cycle 
times,  etc.) 

•  Estimate  manpower  requirements 
for  logistic  support 

•  Determine  spares  required  to  meet 
specified  system  availability 
objectives 

•  Define  test  equipment  quantities 
at  all  levels  of  maintenance  and 
repair 

•  Compart  the  economics  of  alterna¬ 
tive  maintenance  support  concepts 
including  Reliability  Improvement 
Warranty  (RXW) . 

The  actual  ltfe-cyr.le  cost  model  configuration 
will  vary  according  to  the  system  application. 
Provisions  have  beer,  made  to  provide  firm  con¬ 
figuration  control  of  each  variation  of  the 
model  so  that  the  government  maintains  control 
over  the  relationships  used  in  the  LCC  calcu¬ 
lations.  However,  there  are  certain  basic  con¬ 
siderations  that  must  be  noted.  The  fundamental 
entity  in  the  LCC  Model  is  the  System  under  in¬ 
vestigation.  The  system  Is  a  self  contained, 
identifiable  collection  of  hardware  and  asso¬ 
ciated  software  whose  purpose  Is  to  perform 
specified  functions.  Associated  with  the  sys¬ 
tem  and  its  application  are  three  basic  con¬ 
siderations  which  form  the  foundation  of  the 
life-cycle  cost  model.  They  are  the  system: 

•  Hardware  Configuration 

•  Operations  and  Logistics  Scenario 

•  Life  Cycle. 

Hardware  Configuration  -  This  Is  defined.  In 

the  LCC  model  to  more  than  one  level  of  i den¬ 
ture  (subordination)  below  the  systen  level. 

Operations  and  Logistics  Scenario  -  This  is  In¬ 
clusive  of  three  echelons  of  repair,  the  flight 
line,  base  or  Intermediate,  and  the  depot 
(Government  or  contractor) . 
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1,1  * c  cycle  -  1H is  is  a  collection  of  signlfl- 
, ant  events  and  tine  dependent  parameters 
tssoolated  with  the  system's  acquisition, 
operation  and  support  process.  The  interac¬ 
tion  of  the  system  life  cycle  with  the  other 
two  basic  considerations  determines  the  time 
intervals  in  which  the  different  elements  of 
co.t  are  incut  red  and  the  magnitude  of  these 
t  os  cs  as  o  function  of  rime. 

Several  of  the  life-cycle  cost  computations 
depend  on  logical  relationships  established 
bv  input  parameters  that  define  the  support 
( oncept  for  the  system.  The  computation  most 
gnl t j candy  affected  are  the  base  and  depot 
repair  costs,  tile  determination  of  support 
■  j  iprv'tt  requirements,  and  Lite  initial 
spires  determination.  Other  computational 
areas  of  »ni t f  <  •  nice  are  the  calculation  of 
life-cycle  .oat-,  vhmi  a  warianty  Is  used  and, 
for  unclear  hardened  equipment,  the  Influence 
which  hardness  assurance  requirements  have  on 
support  costs. 

Ot her  M° 1 LOR  Elements  -  The  life-cycle  cost 
model  Is  only  part  of  the  concept.  In  Figure 
1  the  other  elements  are  shown  including  tiie 
role  aa  independent  agent,  plays.  An  independ¬ 
ent  agent  not  involved  in  the  procurement  com¬ 
petition  can  he  used  to  develop  and  maintain 
a  data  base  of  information  which  includes  con- 
figuiation  data,  test  data,  and  program  data 
from  all  potential  sources.  As  tests  are 
inirled  out  information  is  added  lo  the  data 
base,  l'he  darn  base  is  used  to  assess  relia¬ 
bility  and  determine  life-cycle  cost  parameters 
as  well  as  to  analyze  performance.  As  equip¬ 
ment  is  being  developed,  the  data  is  used  with 
an  ICC  model  to  evaluate  each  competitor's  work 
as  the  program  unfolds.  Contractors  are  con¬ 
tinually  encouiagud  to  do  all  they  can  to  mini¬ 
mize  life-cycle  costs.  METF.OR  also  includes 
the  use  of  Innovative  test  techniques.  A  Com¬ 
bined  environmental  Reliability  Testing  (CERT) 
chamber  was  used  on  OMEGA  program  204 1  and  Is 
being  introduced  now  within  other  equipment 
procurement  programs,  til  addition,  new  incen¬ 
tive  structures  are  being  appliel  us  an  option 
to  the  RIV.  Tile  one  used  on  the  VHF  radio  is 
called  an  XTBI'  Verilication  Test  (MTBF/VT) . 
These  and  other  features  will  he  discussed  in 
more  depth  in  the  specific  case  studies.  It 
should  also  be  noted  here  hat  the  METF.OR  Pro¬ 
ject  has  as  a  primary  objt.  ivc  the  requ  treraeni  to 
pioduce  a  set  of  appli  at  on  guidelines  that 
will  allow  Program  Managers  to  se'ect  appropri¬ 
ate  elements  of  the  concept  for  use  on  future 
programs.  These  guidelines  will  be  coordinated 
with  various  ASD  agencies  including  the  l.CC 
Advisory  Group  of  the  Comptroller's  Office 
(ASD/ACC). 


APPLICATIONS 


OMEGA  Pi  'gram  2041  -  The  Omega  Navigation  set- 
was  a  a i stem  conceived  to  replace  the  Lornn  A 


receiver  on  C-130  aircraft.  So  far  the  progi in 
has  met  performance,  and  production  schedule 
goals,  and  use  of  a  highly  Innovative  procure- 
s.ent  process  resulted  in  greatly  reduced  costs. 

The  key  factor  in  the  Omega  2041  program  was  the 
application  of  cost  reduction  principles,  later 
incorporated  in  the  MF.TEOR  concept,  early  in  the 
acquisition  cycle.  Appropriate  parameters  were 
developed,  test  procedures  were  designed,  en¬ 
gineering  data  was  collected,  software  evalua¬ 
tion  was  performed  and  a  LCC  model  was  used  to 
make  key  procurement  decisions.  The  participants 
in  the  OMEGA  Program  consisted  of  an  Air  Force 
Program  Manager,  Air  Force  support  elements 
including  engineering  (AsD/EN)  and  procurement 
support  and  an  independent  engineering  firm. 

This  -OucGJi.iiod  approach  proven  to  be  extremely 
effective  in  motivating  the  participating  con¬ 
tractors  to  produce  relative',;;  low  life-cycle 
cost  equipment  which  has  also  pi  oven  tv  be  ef¬ 
fective  in  operational  use. 

The  relatively  short  time  between  completion 
of  testing  activities  and  the  pioduction  award 
required  an  innovative  approach  Lo  technical 
data  management.  An  Engineering  Data  Base  was 
created,  that  consisted  of  computerized  files 
of  performance,  reliability  and  operations  data. 

All  critical  program  data  was  organized  and  made 
available  for  use  by  the  source  selection  team 
in  time  to  support  the  selection  process.  Manu¬ 
facturer  supplied  reliability  and  reliability 
growth  parameters  could  be  validated  using  the 
data  base.  The  success  of  this  constant  feed¬ 
back  between  manufacturers  and  the  Air  Force  In 
the  reliability  assessment  process  contributed 
to  a  protest-free  award  of  the  produetlon  contract. 

A  comprehensive  technical  evaluation  of  the  soft¬ 
ware  design  of  each  production  contractor  was 
also  performed.  This  was  done  In  such  a  way  as 
to  protect  each  contractor’s  proprietary  Inter¬ 
ests  while  still  identifying  potential  problem 
areas  so  that  corrections  could  be  included  in 
the  production  design  proposals.  In  addition, 
the  combined  procurement  team  constructed  the 
RIW  agreement,  solicited  contra-tor  feedback  and 
Chen  Integrated  these  requirements  with  the 
Utc-cycle  cost  procurement  approach. 

The  comprehensive  computerized  LCC  model  was 
used  by  t  le  Air  Force  in  si’irce  selection.  The 
model  was  also  made  available  for  competing 
contractors  use  or.  a  time-share  facility  (GF. 

Mk  III)  so  that  all  emblems  associated  with 
cost  calculations  were  resolved  in  the  prepro¬ 
duction  program  prior  to  the  final  phase  ol 
source  selection.  Simulcaneo-sly,  the  Air 
Force  Logistics  Command  (AFALD)  conducted  a 
preliminary  trade-off  study  of  RIW  versus 
organic  support.  However,  a  definite  conclu¬ 
sion  was  not  possible  from  this  study  3ince 
certain  cost  factors  crucial  to  the  trade  off 
(c.g.,  RIW  price)  iov'-1  not  *■  '  m  ,iM  l shed 

with  confidence  until  receipt  oi  cm."  ' ~r 
proposals.  Nevertheless,  the  study  was  of 
value  In  uncovering  the  critical  Issues  govern¬ 
ing  the  trade  off.  Finally,  source  selection 
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was  made  based  on  lowest  evaluated  life-cycle 
cost  of  qualified  designs. 

One  of  the  moie  difficult  but  interesting 
questions  was  the  resolution  01  an  MW  vs  or¬ 
ganic  support  issue.  Since  the  equipment  end 
program  satisfied  all  other  criteria  for  RIW 
application  as  stated  in  Air  Force  guidelines, 
the  decision  to  implement  the  RIW  application 
or  to  support  the  system  organically  became  a 
question  of  LCC  incentives.  While  several 
models  weie  in  existence  at  the  time,  none 
included  all  the  support  cost  elements  and 
the  logic  necessary  to  compare  RIW  to  organic 
support.  Tlie  cost  model  was  developed  and 
used  successfully  to  satisfy  the  need  to  per¬ 
form  these  types  of  analyses. 

In  summary,  It  can  be  said  that  the  production 
phase  procurement  action  of  the  OMEGA  Program 
2041  provided  a  test  case  for  a  new  DoD  pro¬ 
curement  approach.  Not  all  of  the  elements  of 
the  approach  were  new,  but  their  Joint  employ¬ 
ment  In  a  high  visibility  program  provided  a 
unique  opportunity  to  observe  the  ability  of 
such  an  approach  to  satisfy  DoD  procurement 
goals.  The  Important  elements  embodied  in  the 
OMEGA  Program  2041  included: 

•  Deslgn-to-cosc-turget 

•  Establishment  of  competitive 
prototvpe  development  (prepro¬ 
duction)  phase 

•  Qualification  of  performance  and 
evaluation  of  reliability  of  each 
design  prior  to  production  source 
selection 

•  Production  source  selection  based 
on  lowest  evaluated  life-cycle 
cost  of  qualified  designs 

•  Election  of  support  option  (RIW 
or  organic  maintenance)  during 
source  selection. 

A  primary  objective  of  these  initiatives  which 
were  formalized  into  METEOR  was  to  reduce  life- 
cycle  costs  through  reliability  improvements 
prior  to  fielding  the  first  production  unit. 

As  a  report  by  the  Institute  fer  Defense  Analy¬ 
sis  pointed  out,  the  need  is  "to  structure  a 
test  and  fix  program  which  will  result  in  relia¬ 
bility  growth  ...  the  teat  and  fix  process  can 
be  continued  after  system  development  but  the 
cost  of  doing  so  is  substantially  greater,  often 
by  a  factor  of  10,  than  the  coat  of  achieving 
the  required  reliability  before  equipment  de¬ 
livery".  [4] 

Standard  VHF  AM/FM  Radio  -  The  ability  to  apply 
the  ECO  Methodology  in  a  phased  manner  was  highly 
evident  In  the  standard  VHF  AM/FM  Radio  acquisi¬ 
tion  cycle.  The  selected  application  of  appro¬ 
priate  elements  of  the  METEOR  t  provided 

for  an  efficient  production  s  •«  selection 
process. 

A  Joint  AFSC/AFLC  life-cycle  coat  trade-off 
study,  conducted  in  September  1976,  determined 


that  a  standard  VHF  radio  which  provided  both 
AM  and  FM  modes  would  be  the  moot  coot  effec- 
l ive  method  of  satisfying  USAF  requirements  for 
VHF  radios.  Based  on  this  study ,  the  use  of 
a  now  stamldtd  VHF  AM/tM  i.tdlo  in  ns'tafv  I  he 
A-10  and  F- lb  alrcintt  toqulramtmtu  and  tm 
modernizing  the  current  Air  Force  VHF  radio 
inventory  was  validated. 

The  VHF  radio  program  was  driven  bv  a  critical 
delivery  requirement,  namely  the  need  to  pro¬ 
cure  the  radio  as  GFE  for  initial  delivery  of 
A-10  aircraft.  To  meet  this  schedule  without 
sacrificing  competition,  a  ono-step  procure¬ 
ment  approach  was  formulated  to  competitively 
select  one  contractor  for  award  of  a  firm 
fixed-priced  contract  comprised  of  the  follow¬ 
ing  requirements: 

•  Fabrication  and  qualification 

of  preproduction  units 

•  Engineering  and  maintenance  sup¬ 

port  for  Air  Force  conduct:  .1  DT4E/ 

IGT6E  testing 

•  Fabrication  of  initial  production 

units  for  the  A-10  and  F-16 

•  Options  for  foliow-on  production 
of  up  to  9000  units 

•  Support  equipment,  spares,  emitt¬ 
ing  and  technical  data. 

To  demonstrate  their  capability  to  meet  the 
schedule,  potential  sources  were  required  to 
provide  certified  airworthy  hardware  with 
their  proposal. 

Life-cycle  cost  was  a  primary  source  selection 
evaluation  factor  Cor  the  standard  VHF  radio, 
second  only  to  operational  acceptability.  The 
LCC  component  of  the  METEOR  approach  was  imple¬ 
mented  in  the  acquisition  program.  Program 
LCCA  was  made  available  to  all  potential 
sources  in  advance  of  the  R1T  package  in  order 
for  them  to  gain  familiarity  with  the  model  and 
perform  tradeoffs  for  their  hardware.  Simul¬ 
taneously,  the  Air  Force,  with  rhe  support  of 
on  Independent  engineering  conlisctor,  developed 
detailed  LCC  Instructions  for  Inclusion  In  the 
RFP  package.  These  instructions  Identified  Lhc 
acquisition,  operation,  and  logistics  scenario 
data  for  use  by  the  offeror  In  exercising  LOG'. 
In  addition,  detailed  groundrules  for  prepara¬ 
tion  of  offeror  provided  data  were  given.  The 
offerors  were  required  to  submit  LCC  proposals 
consisting  of  Program  LCCA  outputs  and  support¬ 
ing  rationale  for  all  input  data  used  in  de¬ 
veloping  these  outputs.  By  these  means.  LCC 
wa 8  evaluated  uniformly  and  fairly  across  all 
offerors,  and  the  LCC  proposal  for  each  offeror 
was  consistent  with  other  parts  of  the  ptoposai. 

As  was  Che  case  for  0MECA  Program  204,,  the 
Air  Force  elected  co  evaluate  both  the  RIW  and 
organic  support  options  for  the  standard  VHF 
AM/FM  radio.  RIW  provisions,  including  MTBF 
Guarantees,  were  developed  analogous  to  those 
used  for  OMEGA.  However,  a  different  approach 
was  required  for  the  organic  support  option. 
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Unlike  the  ease  in  OMEGA ,  che  VHF  radio  sched¬ 
ule  did  not  pemit  reliability  testi.i’.p  of  com¬ 
petitive  units.  Hence,  there  was  no  tes*-  data 
for  use  by  the  Air  Force  to  independently  assess 
tlie  MTBFs  quoted  by  the  offerors  for  Che  or¬ 
ganic  support  option.  In  addition,  with  no  in¬ 
centive  or  control  on  MTBF,  offerors  would  have 
no  motivation  to  submit  realistic  MTBFs  for  use 
:m  I'V  •'valuation  of  the  organic  support 
i  ;>t  i-  n. 

SLeps,  therefore,  were  taken  to  put  incentives 
into  the  organic  support  option.  An  innova¬ 
tive  provision  was  developed  which  eventually 
came  to  be  referred  to  as  the  MTBF  Verification 
,ri  it  'MTBF/VT) .  Under  this  scheme,  the  offer- 
>r'  TI'F  quotes  submitted  in  his  proposal  are 
latei  b'bjec'  to  verification  in  the  event  he 
is  awarded  r"o  c  r tract.  The  verification  is 
accomplished  by  selecting  a  sample  of  produc¬ 
tion  units  and  measuring  the  actual  MTBF  in 
operational  use.  If  the  quoted  MTBF  is  not 
achieved,  then  the  contractor  must  provide 
settlement  spares  to  the  Air  Force  and  an  ad- 
Tistmcnc  to  contract  price  is  computed  to 
iccount  foi  rhe  increased  cost  to  the  Govern¬ 
ment  associated  with  the  MTBF  differential, 
tm riel  provisions  for  the  MTBF/VT  were  drafted 
and  the  draft  version  was  provided  to  the 
bidders  to  -.elicit  their  concerns  and  comments. 
Thu,  coordinated  version  was  then  subjected  to 
Lhoi oiigb  review  and  revision  by  program  office, 
contractual,  and  legal  personnel  prior  to  in- 
< orporacion  in  the  RFP  model  contract. 

Embodied  within  the  RIW  and  MTBF/VT  provisions 
were  lormuias  for  determining  the  following 
adjustments  in  tiie  event  that  bids  were  not 
u'h  leved : 

®  Consignment  spares  due  to  a  de¬ 
ficient  achieved  turnaround  time 
under  RIW 

•  Consignment  spares  due  to  a  de¬ 
ficient  achieved  MTBF  under  RIW 

•  Settlement  spares  duo  to  n  de¬ 
ficient  achieved  MTBF  in  the 
MTBF/VT 

•  Contract  price  adjustment  due  to 
a  deficient  achieved  MTBF  in  the 
MTBF/VT 

Because  of  che  substantial  mpact  on  both 
Government  and  contractor  Isk,  special  pre¬ 
cautions  were  taken  to  iss  ire  that  these  formu¬ 
las  were  appropriate  and  understood  by  all 
pniiies.  Sample  calculations  in  which  the 
formulas  were  exercised  under  a  variety  ol  con¬ 
dition')  were  perfomed  and  documented.  (5] 
Furthermore,  all  offerors  were  required  to  per¬ 
form  analogous  calculations  and  enter  them  into 
the  negotiated  contract  provi* ions  to  show 
their  clear  understanding  of  the  result  should 
they  only  achieve  one-  ’If  their  target  values. 
This  was  to  Insure  that  the  offeror  was  fully 
consc  'ous  oi  the  impact  of  the  provisions  and 
to  prerj  le  potential  claims  of  mlainterprc  a  ■ 
i  io  i  at  later  date . 


Despite  the  innovative  procurement  techniques 
and  the  requirement  to  perform  the  RIW  vs  or¬ 
ganic  support  LCC  trade  off  during  source  se¬ 
lection,  the  tight  schedule  for  the  VHF  radio 
procurement  was  met  and  a  contract  was  awarded 
without  protest.  The  continuity  and  consis¬ 
tency  provided  by  the  application  oi  a  tested 
procurement  approach,  as  modified  by  adaption 
cr  the  MTPr/VT  concept,  proved  effective  in 
achieving  the  objective  of  reducing  life-cycle 
cost  without  sacrificing  specific  program  re¬ 
quirements. 


Figure  3  METF.OK  System  Concept 


Common  Strategic  Doppler  Program  (CSD)  -  Tile 
CSD  program  is  still  in  the  acquisition  cycie 
and  consequently,  because  of  proprietary  con¬ 
siderations,  specific  Issues  canno1  be  dis¬ 
cussed.  Rather,  some  generalized  .aatements 
.•an  be  made  about  the  structuring  of  the  CSD 
acquisition  program  that  reflect  the  current 
state  of  implementing  METEOR  concepts. 

These  concepts  are  being  used  extensively  in 
Che  CSD  acquisition  cycle  from  conception  to 
eventual  implementation  of  a  Common  Strategic 
Doppler  on  B-S2  and  KC-135  aircraft.  The  ori¬ 
ginal  OMEGA  2GA1  LCC  model  was  chosen  as  the 
baseline  and  then  specific  LCC  requirements 
incorporating  certain  considerations  relevant 
to  the  CSD  were  applied.  For  exjmple,  the  pro¬ 
gram  manager  needed  cost  analyses  performed 
for  nuclear  hardening  considerations.  LCCA 
proved  flexible  In  allowing  incorporation  of 
various  specifically  tailored  logical  analytic 
statements  in  the  l.CC  algorithm.  Again  as  in 
the  OMECA  and  VHF  situation,  an  independent 
agent  was  used  to 

•  Set  up  the  model  (with  appropriate 
specific  modifications) ,  provide 
access  by  contractors  and  government 
personnel,  provide  use  documenta¬ 
tion  and  maintain  i '•■'figuration 
control  (this  insured  u/w  i 

•  Perform  LCC  analyses  using  :u  mo¬ 
tor  CSD  design  inputs. 
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•  Assist  with  the  detailed  test 
planning  in  order  to  insure  all 
relevant  data  Is  obtained. 

•  Develop  and  maintain  an  engineer¬ 
ing  data  base  to  collcet  the  re¬ 
sults  of  both  the  government  and 
contractors'  tests  on  the  CSD.  Tn 
addition,  perform  auditing  and 
accuracy  verification  tests  on 
the  data  to  insure  it  is  bias  free. 

One  of  che  more  Interesting  aspects  of  the  pro¬ 
gram  was  the  use  of  an  environmental  chamber 
for  Combined  Environmental  Reliability  Testing 
(CERT).  The  goal  was  to  provide  a  close  ap¬ 
proximation  to  actual  flight  profiles  and 
realistic  simulation  of  environmontal/operating 
conditions.  The  chambeL  was  that  used  on  the 
OMEGA  program  and  the  tests  were  supported  by 
the  Air  Force  Flight  Dynamics  L’horatory  at 
Wright-Patterson  AFB.  The  experience  with  it's 
use  prompted  the  Inclusion  of  CERT  requirements 
in  the  CSD  RFP.  Specific  test  plans  were  de¬ 
veloped  by  ASD  engineers  and  the  data  being 
collected  is  providing  significant  inputs  into 
the  Engineerin  Data  Base  being  maintained  for 
the  CSD  program. 

In  addition,  a  logistlcs/maintenance  concept 
was  analyzed  which  is  a  modification  between 
the  traditional  two  or  three  level  maintenance 
normally  performed  by  the  Air  Force.  This  two- 
and-a-half  level  support  system  has  an  organi¬ 
zational,  intermediate  and  depot  maintenance 
structure  tn  which  che  intermediate  maintenance 
support  for  several  bases  In  a  geographic  region 
Is  consolidated  in  a  single  shop  at  a  selected 
base  in  the  region.  These  CSD  studies  evalu¬ 
ated  the  sensitivity  of  this  concept's  costs 
to  variations  in  spares  requirements  and  test 
equipment  costs.  A  simplified  set  of  RFP  re¬ 
sponse  requirements  is  being  developed  based 
on  the  results  of  these  studies. 


CONCLUSION 


Avionics  equipment  helps  to  maximize  the  combat 
effectiveness  of  aircraft  weapon  systems.  How¬ 
ever,  avionics  also  Increases  both  the  Initial 
acquisition  costs  and  O&S  costs  throughout  the 
system  life  cycle.  Failure  rates  are  a  serious 
problem:  a  system  down  for  maintenance  Is, 
at  the  time,  of  no  more  use  to  the  operational 
commander  than  a  system  that  was  never  produced, 
or  a  system  that  was  lost  in  combat.  Systems 
with  low  reliability  and  poor  quality  not  only 
reduce  force  effectiveness,  they  continue  to 
drive  support  cost.  Failures  and  maintenance 
of  avionics  equipment  account  for  approximately 
52*  of  all  aircraft  logiotlcs  costs  In  che  Aii 
Force  today.  Improved  reliability  and  quality 
assurances  are  not  of  sideline  interest  to  DoD. 
They  are  central  to  both  the  effectiveness  and 
the  cost  effectiveness  of  all  defense  systems. 


OPLAN  METEOR  Is  a  mechanism  to  help  solve  re¬ 
liability  problems.  As  one  ASD  response  to 
DoD  initiatives,  METEOR  can  help  both  program 
managers  and  contractors.  It  can  provide  the 
"front  end"  leverage  needed  to  reduce  life- 
cycle  costs.  As  previously  mentioned  the  con¬ 
cept  contains  three  basic  elements: 

•  A  methodology  that  provides  a 
structure  for  design  analysis,  to 
reduce  life-cycle  costs.  Tins 
methodology  is  supported  by  early 
testing  and  engineering  analysis 
where  it  can  do  the  most  good  and 
is  backed  up  by  contractual  Incen¬ 
tives  to  improve  operational  tc- 
linbllity . 

•  A  common  and  easy-to-use  LCC  analy¬ 
sis  framework  tailored  for  use  on 
each  program. 

•  Procurement  techniques  that  nave 
evolved  to  help  insure  life-cycle 
cost  competition  is  bias  free.  They 
include  independent  agency  review,  and 
assessment  and  feedback  of  I.CC  in¬ 
puts  from  the  test  program  where 
appropriate. 

The  OMEGA  program  provided  the  ground  work  fot 
the  formulation  of  the  METEOR  concept.  In 
OMF.GA  the  specified  MTBF  was  500  hours.  Prior 
to  pre-production  testing  It  was  20  hour6. 

After  completion  of  testing,  growth  was  me. .sored 
to  100  hours.  Under  the  provision  of  the  MW, 
the  MTBF  Is  guaranteed  to  grow  to  1000  hours 
after  5  years  of  operational  use.  With  business 
as  usual  the  life-cycle  cost  would  have  been 
24.7  million  dollars;  with  METEOR  It  is  esti¬ 
mated  to  be  15.6  million  dollars.  The  VHF 
Radio  case  study  illustrated  the  MTUP/VT  con¬ 
cept.  More  analytical  wo>k  is  required  in  Lius 
area  to  specifically  unde. stand  the  dynamics 
of  the  interrelationship  of  the  testing  provi¬ 
sions,  sparing  requirements  and  contract  incen¬ 
tives  that  actually  motivate  contractors  to 
increase  the  reliability  of  equipment  under 
the  MTBF/VT  contract  provisions.  The  GSD  is 
still  being  developed  but  the  important  of 
CERT  is  obvious  as  is  the  Importance  of  furthet 
work  with  the  2  1/2  level  maintenance  (oncept. 

It  is  possible  that  this  concept  will  have  ad¬ 
vantages  over  the  traditional  two  or  three 
level  philosophies  In  appropriate  deployment 
scenarios . 

In  summary,  based  on  the  experien.  e  to  da  e  and 
enhancements  now  in  process,  it  appears  tla’ 
contractors  can  be  motivated  to  enhance  the 
reliaoillty  and  maintainability  of  systems  being 
procured  today  to  satisfy  tomorrow's  require¬ 
ments.  The  principal  motivators  arc  competition 
and  the  knowledge  that  primary  downstream  cost 
drivers,  such  as  MTBF,  arc  to  be  measured  and 
appropriate  adjustments  made  such  os  consign¬ 
ment  of  settlement  spares.  Obviously,  the 
principles  embodied  in  Project  METEOR  are  not 
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a  panacea  for  all  problems  and  may  not  be  ap¬ 
plicable  for  all  types  of  programs.  The  appli- 
c.it  Ion  guidelines  being  developed  for  use  with¬ 
in  ASD/AE  will  emphasize  the  modular  nature  of 
tin  methodology  so  that  the  widest  possible  ap¬ 
plicability  is  achieved.  It  is  anticipated 
chat  the  degree  to  which  these  concepts  are 
applied  will  be  a  function  of  the  size  of  the 
program,  users  of  the  equipment  being  procured 
(S\C,  1'AC,  ADCCM,  etc.),  and  availability  of 
up-front  funds  to  support  multiple  sources, 
independent  agency  Involvement  and  the  pre- 
pt  iduction  tent-fix-test  activities  where 
appropriate.  After  more  experience  with  tvt 
,  on:  ept  lias  been  obtained,  quantitative  guide- 
Hi e-  an  be  developed  to  assist  managers  in 
0  t  ‘mining  which  elements  are  most  applicable 
tv'i  tin. ' r  -i  r grams. 


NOTE: 

MUCH  OF  THE  INFORMATION  IN  THIS  PAPER  IS 
THE  RESULT  OF  THE  AUTHORS'  PERSONAL  EXPERI¬ 
ENCE  WHILE  WORKING  FOR  THE  AERONAUTICAL 
SYSTEMS  DIVISION  AND  SHOULD  NOT  BF.  CONSID¬ 
ERED  A  STATEMENT  OF  AIR  FORCE  POLICY. 


The  potential  for  LCC  savings  has  been  establish¬ 
ed.  It  is  now  a  matter  of  wider  implementation, 
further  refinement  of  the  methodology  and  eval- 
nat Ion  of  r-sults  to  quantify  the  extent  to 
which  ICC  cost  reductions  are  actually  achieved. 
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CONTRACTOR  INITIATIVES  FOR  R&M/COST  IMPROVEMENT 
C.  David  Weimer 


Abiiasi 

This  paper  presents  a  synthesis  of  major  findings  and  conclu¬ 
sions  derived  from  four  years  research  in  electronics  subsystems 
.acquisition  Department  of  Defense  policy  statements  for  achieving 
improved  reliability  maintainability .  and  cost  art  reviewed  The 
application  and  implementation  of  these  policies  are  examined  and 
the  management  response  of  system  and  aubsystem  contractors  is 
described  in  areas  of  operating  policies  and  procedures,  project 
organization,  cost  management  and  control,  and  development  pro¬ 
gram  phoning  The  contractor  expenencts  during  their  engineering 
development  programs  are  subsequently  evaluated  in  terms  of  oper¬ 
ating  problems  or  policy  barriers  In  total,  the  experiences  of  43 
contractors  responding  in  25  separate  programs  are  examined  and 
anaKzed  Eased  upon  their  past  expenencts  and  management 
behavior,  the  appropriate  response  to  successfully  embrace  future 
policy  initiatives  is  postulated 

Introduction 

Dunng  the  past  six  yean,  the  Office  of  the  Secretary  of 
Defense  (OSD)  and  the  Services  have  been  attempting  to  change 
the  output  of  the  weapons  system  and  subsystem  acquisition 
process  In  particular,  these  offices  have  initiated  acquisition 
policies  designed  to  reduce  cost  growth  and  to  improve  equipment 
reliability  and  maintainability.  The  focus  of  the  policies  has  been 
the  cntical  design  and  development  phase,  where  basic  decisions 
influencing  future  product  cost,  reliability ,  and  maintainability  are 
msdc 

Electronics  system  and  subsystem  contractors  can  pursue  the 
objectives  of  the  polices  in  two  primary  ways.  (!)  throi*:h  the 
application  of  new  technology  which  promises  greater  simplicity, 
higher  reliability,  and  lower  cost  per  function  and  (2)  through 
improvements  in  the  planning  and  management  of  program  actrei- 
ties  for  reduced  cost  and  higher  reliability  dunng  development.  The 
pLmninf  and  management  function  is  believed  to  be  as  cntical  a 
determinant  of  program  outcome  as  new  technology  uUluation- 
there  is  considerable  evidence  that  the  benefits  pin*d  through  the 
use  of  advanced  electronics  technology  have  been  partially  offset 
b\  increased  performance  requirements  The  results  often  have 
been  greater  equipment  complexity,  leading  to  reduced  equipment 
reliability  and  increased  l»fe<ycle  cost. 

The  topic  of  contractor  response  to  defense  acquisition 
policies  can  be  desenbed  in  dugnmitic  form  as  <hown  in  Figure  I 
The  figure  illustrates  the  flow  of  policy  directives  and  subsequent 
implementing  instruction  from  the  government  to  the  contractor 
organization  and  eventually  to  functional  organizations  within  the 
contractor.  Even  in  this  umpUstic  new  of  the  process,  the  con¬ 
tractors  do  not  operate  in  a  vacuum  Outside  influences  exist 


AcauiamON  mauc'r  aa**ucation  amo  impcimgivt ation 


Figure  l  Policy  Application  and  Implementation  Framework 

ranging  from  other  forms  of  governmental  mtervention  to  the 
political,  economic,  and  competitive  business  environment  Thc*e 
external  forces  frequently  enter  into  and  alle*  the  form  of  con¬ 
tractor  response  This  paper  will  examine  some  of  the  key  con¬ 
tractor  functions  illustrated  to  identify  changes  which  resulted 
from  new  policy  application 

foBcy  Initiatives 

Major  DoD  policy  statements  take  the  form  of  DoD  Direc 
trees  or  Memoranda  to  Service  Secretaries  from  OSD  principals 
Table  I  lists  several  recent  policy  directives  and  implementing 
memoranda  which  are  directly  concerned  with  con.  reliability  o* 
mainumabibiy 

The  emphasis  of  these  policy  directives  has  been  on  cm: 
rather  than  reliability  or  mauttintbilily  The  first  DoD  Directive 
5000.1,  established  cost  as  a  primary  oengn  parameter  This 
launched  the  DoD  Deugn-to-Cost  (DTO  acqu  .mon  policy  Subv 
outnt  directives  and  memoranda  expanded  and  amplified  the  o rig 
in* I  concept 

Reliability  and  mam  tain  ability  (RAM)  ob/ccuves  usuailv 
were  contained  in  the  drecuvei  as  surrogate;  for  support  cost 
goals  Where  present,  they  were  to  be  given  emphasis  equal  to 
acquisition  costs  Specific  policy  guidance  tailored  foi  RAM  ha*, 
only  recently  surfaced  m  the  form  of  draft  directives 

The  major  RAM  policy  initiatives  to  Gate  have  been  the 
establishment  of  Reliability  Improvement  Warranties  iRf^s*  rein 
bibty  (MTBF)  guarantees,  and  Support  Cost  Guarantees  (SCC»si  as 
contract  options  to  equipment  production  contracts  These  require 
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ments  emphasize  field  RAM  through  equipment  performance  guar¬ 
antees  Application  of  these  techniques  to  new  system  procure- 
nvr/.s  increased  following  tht  19?3  RIW  memorandum. 

Two  tnw  draft  policy  directives,  presently  being  reviewed 
prior  to  issue,  deal  directly  wi*h  RAM.  They  call  for  methods  to 
predict  RAM  of  proposed  systems  and  consideration  of  RAM  as  a 
major  concern  during  all  phases  ol  the  acquisition  process 

Sole  that  -particularly  foi  DTC  policies -several  years 
elapsed  between  rnmal  policy  estanUshmcnt  and  more  specific 
guidelines  for  Service  implementation  Refinements  incorporating 
lessons-lcamed  or»  the  initial  experiments  or  trials  subsequently 
mulled  ir.  updated  and  revised  policy  directives  as  the  concepts 
matured  To  understand  contractor  response  to  these  policies  we 
will  »>ncfl>  examine  the  manner  Li  which  these  policies  have  been 
applied 

Policy  Application 

VJule  the  DoD  policy  d&tcthres  may  be  expHcit  m  their 
omectives  and  the  approach  to  be  followed,  changes  in  the  acquisi¬ 
tion  process  and  in  the  Twncaement  of  product  development  do 
not  occur  unless  the  poucies  are  translated  into  implementing 
instructions  and  contrrrt  cLitaes  reflecting  the  application  of  the 
policies  to  the  specific  program  No  matter  ho*w  much  publicity 
was  given  to  the  new  policies  the  response  of  many  contractors 
was  found  to  be  dependent  upon  their  specific  interpretation  of 
current  or  future  contractual  comm  tmentx 

Since  the  initial  policy  ;nts  were  oublished,  studies  at 
lt>A  and  elsewhere  ha/e  bee-  '  ducted  to  measure  the  progress 
of  these  initiatives  as  t  ley  were  applied  to  the  first  candidate 
development  programs  The  findings.  discnbed  below,  are  of  par- 
sinlar  mteres,  because  they  form  the  baas  for  explanatory 
rationale  for  subsequent  contractor  behavior 

Pcsicn-ltrCosl  Policies 

The  contractual  requirements  for  eight  original  programs 
designated  b>  •  it  armed  u  pnoe -limited  prototypes  were 
ar.alv/ed  Key  findingi  were 

I)  Sev*n  of  the  eight  pncc-Umited  prototypes  had 
entered  development  b'fort  being  designated  as  a 
design  to-vost  candidate  At  kan  four  of  eight 


experiments  were  well  into  their  engineering  dev<  imm¬ 
inent  programs  at  a  stage  where  most  of  the  cnticaf 
design  decisions  had  already  been  made  and  approved 

2)  Because  of  the  timing,  the  contractual  DTC  applica¬ 
tion  for  most  of  the  programs  resulted  in  cith  ' 
amended  provisions  to  the  initial  contract  or  incorr. 
plete  contract  requirements 

3)  A  key  ingredient  of  the  DTC  policv  is  development 
program  fiexibihtv  (cost  and  schedule)  m  order  to 
perform  design  iterations  for  goal  achievement  Otuy 
thirty  percent  of  the  programs  were  able  to  obtain 
additional  time  or  funds  for  design  iterations 

4)  The  most  inconsistent  contract  requirement  was  in  the 
area  or  equipment  cost  estimating  and  reporting  Tht 
Government  m  many  cases  had  little  visibihts  into  the 
status  or  progress  of  the  ptoducci.v-  «ost  management 
efforts 

Reliability  Guarantee  Pobcies 

In  a  manner  similar  to  the  dcsign-to-cost  pobcies.  the  initial 
prorams  containing  future  requirements  for  reliability  guarantees 
or  warranties  were  analyzed  The  findings  were  parallel  Most  of 
the  development  contracts  did  not  specify  requirements  for  the 
future  guarantees,  terms  and  conditions  were  negotiated  and  firal 
ued  during  the  terminal  stages  of  the  development  program,  at  a 
stage  where  little  development  program  impact  could  be  realued 
Unlike  the  DTC  requirements,  however,  the  finalized  contrau 
requirements  were  generally  complete  and  followed  uniform  guide 
lines  established  by  OSD  and  the  Services  1 

An  additional  contractual  ingredient  of  the  rrbabibty  guaran¬ 
tees  was  the  potential  financial  risk  associated  with  warranty  provi¬ 
sions  and  consignment  spare  requirements  if  future  field  reliability 
did  not  achieve  predicted  values.  Contractors  found  that  thev  were 
required  to  pnee  warranties  based  upon  specified  reliability,  and 
maintainability  levels  with  only  limited  development  program  data 
to  predict  their  ultimate  field  reliability  and  warranty  cost 

Summary 

In  the  two  pobcies  examined,  it  was  observed  that  transla¬ 
tion  cf  broad  pobey  directives  into  specific  contractual  reqjire 
ments  took  tunc  and  was  not  easily  accompbshed  during  an  on 
going  and  previously  planned  development  program  This 
particularly  critical  when  the  poiicy  was  intended  to  influence  the 
design  of  the  equipment  and  the  conduct  of  the  development 
program 

Contractor  Initiatives 

A  primary  objective  of  this  paper,  and  a  key  output  of  o*  * 
previous  researen.  i»  the  identification  of  contractor  rtspons-  or 
behavior  as  a  result  cf  the  pobey  directive.  It  will  be  several  years 
before  the  success  or  failure  of  the  policies  can  be  determined 
from  equipment  production  cost  or  field  operating  perfo r~>r»e 
Thus,  changes  m  the  management  or  conduct  of  the  develop  fie*’1 
program  going  emphasis  v>  policy  objectives  nay  be  re*  iMe 
indicators  of  future  pobev  success  Equally  important  mhlrn 
areas  or  oamers  that  prev-n'  rolicv  objectives  from  oe:n,  purs  m‘ 
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may  be  discovered  which  can  be  resolved  in  time  for  positive 
benefits  to  be  obtained  Finally,  the  aggrepte  experiences  ol  the 
contractors  in  responding  to  these  recent  policy  initiatives  ihould 
help  other  contractors  or  subcontractors  formulating  development 
program  plans  and  negotiating  contracts  containing  similar  policy 
requirements 

The  investigations  into  contractor  policy  response  identified 
several  areas  where  the  impact  of  the  DoD  policy  directives  could 
be  observed  Contractors  who  successfully  adopted  the  new  acquisi¬ 
tion  policies  did  so  through  the  formalization  of  their  own  new  or 
revived  operating  policies  and  procedures.  This  effectively  endorsed 
the  new  acquisition  mode  and  provided  credibility  for  the  internal 
changes  that  subsequently  were  implemented  Contractual  require¬ 
ments.  reflecting  the  new  acquisition  policies,  also  led  to  changes 
in  contractor  organizational  structures  and  their  internal  cost 
management  systems.  As  the  discipline  evolved  for  achieving 
greater  cost  and  reliability  visibility  dunng  development,  changes 
were  obxrved  in  the  planning  of  the  engmetnng  development 
program  These  changes  required  more  effort  to  be  spent  in  several 
ke>  functional  areas.  The  details  of  these  responses  will  be 
examined  m  the  following  sections. 


Corporate  Policies  and  Procedures 

If  permanent  changes  in  the  conduct  of  design  and  develop¬ 
ment  programs  were  to  be  accomplished,  we  expected  to  find 
either  new  or  revised  corporate  operating  policies  and  procedures 
that  reflected  the  new  Government  policies.  DTC  represented  a 
significant  change  in  development  program  priorities,  therefore, 
some  means  of  legitimizing  or  authorizing  program  planning  for 
DTC  was  anticipated  Our  investigation  found  that  sixteen  of  the 
rwenty-two  contractors  surveyed  had  either  developed  or  were 
preparing  new  DTC  operating  policies  and  procedures  Contractors 
who  were  not  responsive  stated  that  corporate  or  divisional  direc¬ 
tives  were  inappropriate  because  of  the  variety  of  programs  being 
accomplished  or  because  other  exist  mg  procedures  provided  the 
guidance  necessary  to  respond. 

Investigations  into  the  DTC  requirements  which  affected 
policy  establishment  identified  requirements,  illustrated  in  Table  2, 
which  apparently  led  to  the  formalization  of  the  DTC  process  All 
but  one  contractor  who  established  DTC  policies  and  procedures 
had  requirements  for  frequent  and  periodic  production-cost 
estimating,  tracking,  and  reporting.  Only  half  of  the  contractors 
without  policies  were  subjected  to  any  coct-reporting,  and  these 
requirements  were  mimmal-two  reports  per  program. 

Another  significant  difference  found  m  the  contractor 
requirements  was  provision  for  award  fees.  Most  of  the  contractors 
with  DTC  policies  and  procedures  were  abo  working  toward  award 
fees  based  upon  their  wfllmgness  to  negotiate  a  production  con- 
*ract  at  the  product  design  cost  (pnee)  Thus,  a  causal  relationship 
was  found  between  contract  requirements  for  cost  tracking  and 
reporting,  contract  incentives  for  achieving  production  cost  goals, 
and  the  policy  and  procedural  response  of  the  contractor. 

The  DTC  policies  and  procedures  furnished  by  eight  contrac¬ 
tors  were  examined  for  characttr.ctics  that  would  indicate  icope. 
Jevei  of  detail,  origin,  source  of  authority,  and  topics  covered  The 
results  of  this  analysis  are  presented  in  Table  3. 

The  final  area  for  analysis  was  functional  coverage.  Func¬ 


tions  relating  to  organizational  relationships,  cost  tracking,  product 
engineering,  and  production  were  covered  by  the  majority  of  con¬ 
tractors  However  uniform  coverage  of  coat  estimating  c?  valida¬ 
tion  testing-two  critical  ingredients  in  the  DTC  concept -weit 


Table  DTC Requirements  and  Contractor  Policies 
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TabU  3.  DTC  Policy  and  Procedure  Characteristics 


lacking  Emphasis  on  subcontractor  management  or  matenal- 
purchasing  functions  were  covered  by  six  of  eight  contractors 

Policies  or  procedures  governing  changes  to  design  and  devei 
opment  programs  for  improved  or  guaranteed  reliability  and  main¬ 
tainability  were  not  found  in  our  contractor  surveys  Based  or. 
our  experience  with  DTC  policies,  this  finding  was  not  rurpming 
In  tne  reliability  and  maintainability  area,  specific  new  reports  or 
program  activities  were  not  required  by  the  Government  dunng 
engj.ieenng  development  Therefore,  changes  for  increased  RAM 
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responsibditv  did  not  have  to  be  formalized,  each  program 
manager  could  take  whatever  steps  he  felt  necessary  *o  acquire 
R&.M  data  demonstrate  his  future  product  performance,  and 
quanitfs  his  potential  warranty  risk 

Proiect  Organization 

The  second  area  01  pobcv  impact  investigated  was  project 
sravuxation  Scleral  significant  organizational  changes  were  found 
a'  j  result  o*  the  new  policies  The  most  common  organisational 
r-sp‘*nse  to  OIC  pobcies  was  the  addition  of  DTC  staff  support  to 
the  program  manager  This  response  was  especially  common  in 
•jure  project  organizational  arrangements  Other  contractors  created 
DTC  {me  organizations  or  specialized  DTC  engineering  staffs  All 
contractors  who  added  to  then  engineering  staffs  were  organized  in 
t  •  atnx  form,  each  member  ol  the  project  organization  reporting 
•o  bon  their  function!  supervisor  and  the  program  manager 

T*  e  mo  .  -r  ~  -ntial  factors  believed  to  be  responsible  for 
the  oi •*::■. ua: tonal  change*  were  again  Government  requirements  for 
producMon  cost  estimating,  tracking,  and  reporting  Ten  contrac¬ 
tors  stated  this  requirement  to  be  a  principal  reason  for  their 
organizational  change  Contractors  also  believed  that  the  emphasis 
and  importance  attached  'o  DTC  by  the  Government  program 
office<  were  primary  motivating  factors  in  organizational  response 
Other  reasons  for  change  were  requirements  for  life-cycle  cost 
analyses  and  continuing  producibility  analyses  and  planning 

Several  contractors  who  reported  no  formal  organizational 
change  responded  to  DTC  requirements  through  establishment  (on 
a  period-:  or  need  basis!  of  ad  hoc  DTC  committees,  or  they  used 
existing  organizations  (c.g  .  systems  engineering)  to  provide  the 
necessary  response 

In  addition  to  organization  structure,  the  content  of  project 
organizations  was  found  to  be  influenced  by  the  new  policies 
Significant  additions  to  the  project  staff  were  observed  in  the 
functional  specialty  areas  of  production  engineering,  maintain- 
abihtv  engineering  and  reliability  engineering  These  functional 
disciplines  were  needed  to  help  predict  product  cost,  reliability, 
ina  nr.ainiAuiabditv  throughout  the  development  program 


As  the  policy  concepts  were  translated  into  specific  contract 
requirements,  it  became  necessary  for  contractors  to  devote  more 
attention  to  furure  production  cost  dunng  the  development  pro¬ 
gram  DTC  requirements  for  production  cost  estimates  at  the 
beguiling  of  engineering  development  and  the  requirements  for 
periodic  updates  of  the  initial  es'unates  meant  that  contractors 
would  develop  capabilities  to  estimate  production  cost  baaed  upon 
early  conceptual  descriptions,  track  these  estimates  at  detaded 
levels,  and  report  the  estimates  tc  internal  management  and  the 
Government  In  order  fot  the  d  ;n-«xott  goals  to  be  achieved, 
the  cost  estimates  had  to  be  v*  c  to  design  engineers  on  a  umcly 


and  in  the  case  of  guaranteed  MTBF  requirements,  the  ecs?  of 
consignment  spares  to  maintain  field  availability 

The  management  of  future  costs  during  ihe  design  phase 
required  that  the  contractor  become  proficient  m  at  least  thre- 
functional  areas,  cost  estimating,  cost  estimate  tracking  and  report 
ing.  and  cost  estimate  control  For  many  contractor  organizations 
these  requirements  were  new.  Contractors  were  just  beginning  to 
implement  the  latest  Government  requirements  tor  (he  manage 
rnent  and  control  of  on-going  development  programs  in  accordance 
with  DoD  Cost/Schcdule  Control  Systems  Criteria  tC/SCSCi 
Requirements  for  future  equipment  and  operations  cost  estimat¬ 
ing  represented  additional  efforts.  New  management  information 
systems  had  to  be  developed  and  existing  capabilities  in  cost 
estimating  augmented 


Development  Program  Planning 

The  final,  and  perhaps  the  most  important  area  of  contractor 
response,  is  development  program  planning  an-.*  execution  In  this 
case,  we  are  concerned  with  changes  made  to  development  pro¬ 
grams  as  a  result  of  the  increased  emphasis  on  cost,  reliability .  and 
maintainability 

As  a  frame  of  reference,  a  functional  work  breakdown  struc¬ 
ture  for  a  typical  engineering  development  program  has  been  con¬ 
structed  Figure  2  illustrates  the  thirteen  functional  elements  which 
were  analyzed  dunng  the  research. 


figure  2  Typtril  Electronic!  Development  Program  Functional 
Structure 

It  should  be  noted  that  the  finanaa!  management  and  con¬ 
tract  management  functions  usually  are  not  directly  chargeable  to 
specific  programs:  they  are  indirect  charges  Nevertheless  since 
previous  research  showed  these  functions  received  an  impact 
exhibiting  significant  responsive  changes,  they  have  been  included 
as  a  part  of  the  development  program  functional  structure 


basis  This  required  a  time«vp*Mve  management  information  sys¬ 
tem  that  would  provide  coc  estimators  with  new  design  concepts 
and  design  engineers  with  the  cost  estimates  of  tneir  designs 

Cost  management  changes  were  also  required  as  reliabditv 
warranties  and  guarantees  were  introduced  as  options  to  be  priced 
pnor  to  production  contract  award  *Urly  in  the  engineering  devel¬ 
opment  program  the  cost  of  contactor  repair  and  maintenance 
had  m  be  considered  so  that  rhev  factors  could  also  Influence  the 
ilMip1  C.hi  estimates  needed  *.i  influence  repair  ot  rvpla«e 
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The  equipment  design  efforts  were  increased  for  many  of  the 
contractors  responding  to  the  new  pobcies  DTC  pobcies  often 
resulted  in  several  design  iterations  to  maintain  or  achieve  the 
production  cost  goals  More  design  effort  also  was  required  under 
policies  of  potential  reliability  warranties  or  guarantees  because 
contractors  were  required  to  design  their  equipment  for  eif he?  '-eld 
ottanc  mam^'-snor  o*  »«'  *r*  !•**  m*  A'ru-  -r  The  povv-kdin  .*( 
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live  the  deygn  function  received  Urge  impacts  from  ooth  DTC  and 
warrant*  policies.  DTC  policies  created  the  largest  impact  whenever 
time  and  funds  were  available  to  perform  the  necessary  design 
iterations 

Analysis 

Analytical  efforts  supporting  designs  also  increased  as  a 
result  of  the  new  policies  New  tasks  were  undertaken  to  explore 
alternate  materials  and  anai>ze  additional  configurations  fo' 
lowering  cost  Additional  effort  w*$  found  in  reliability  and 
maintainability  analyses  to  prepare  for  possible  warrant)  or  guaran¬ 
teed  life-cycle  cost  obligations.  Thus,  analytic  efforts  increased 
together  with  the  design  efforts,  the  magnitude  of  the  increase  was 
tound  ro  be  proportional  to  the  tuning  of  the  polic>  application 
during  the  design  phase 

Materials  Management 

This  area  was  one  which  received  a  large  impact  as  a  result 
of  the  new  policies  DTC  policies  required  constant  updates  of 
projected  production  costs  that  scnificantly  increased  communica¬ 
tions  between  pnme  And  supporting  aubcontractors  and  vendors 
Warranty  requirements  also  caused  contractors  to  take  more  care 
with  material  inspections,  certifications  of  quality  control,  and  in 
some  cases,  plant  screening  and  acceptance  testing.  Contractors  also 
attempted,  with  very  limited  success,  to  pan  their  new  contractual 
requirements  on  *o  lower-level  subcontractors  In  general,  there  was 
a  marked  increase  in  supplier  communications  and  m  materials 
screening  and  testing  pnor  to  development  use. 

Prototype  Manufacture 

While  there  had  been  considerable  discussion  within  the 
industry  concerning  the  need  for  larger  numbers  of  development 
prototypes  to  support  increased  design  verification  and  test  require¬ 
ments  little.  if  any.  increase  in  prototyping  effort  was  observed  in 
practice  Possible  explanations  are  that  funding  for  Additional  pro¬ 
totypes  was  not  available  or  that  most  of  the  development  pro¬ 
grams  were  structured  without  recognizing  the  need  generated  by 
the  new  policies  Most  contractors  believed  they  could  benefit 
from  a  larger  prototype  or  pilot  production  program;  however, 
they  were  unable  to  obtain  the  additional  time  and  money 
required  1 

Equipment  Test 

This  element  received  a  significant  increase  m  effort  by  those 
contractors  who  were  preparing  for  potential  warn n lies  or  relia¬ 
bility  guarantees.  In  •  number  of  cues,  prototypes  were  objected 
to  additional  tests  not  specifically  required  by  contract  test  specifi¬ 
cations  The  DTC  policies  were  not  usually  responsible  for 
increased  test  effort,  most  of  the  design  iterations  were  accom¬ 
plished  prior  to  committing  hardware  to  the  major  test  programs 

Quality  Aaaurance 

Contractors  reported  snail  to  moderate  increases  in  quality 
assurance  efforts  primarily  because  potential  warranty  requirements 
made  it  imperative  that  materials  and  purchased  parts  be  screened 
more  carefullv  Added  effort  was  also  expended  to  insure  complete 
documentation  of  system  and  component  failures  during  develop¬ 
ment  testing  DTC  policies  did  not  appear  to  impact  the  quality 
aaiunnce  efforts  except  for  materials  certification  and  receiving 
inspection  functions 
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Program  Management 

The  program  management  element  consistently  rated  highest 
among  the  functions  that  were  affected  bv  the  new  ‘policy 
requirements  This  wit  not  surp  ruing  since  >t  »  the  program 
manager's  responsibility  to  interpret  the  requirements  of  the  con 
txactual  effort  and  parcel  work  packages  to  other  functional  organ¬ 
izations  When  new  policy  requirements  were  applied  it  was  mo't 
j  efficient  to  add  program  management  staff  rather  than  to  disturb 
1  an  on-foing  process  or  a  company  functional  group  that  is  handling 
many  other  projects  as  well  Thus.  :t  was  observed  that  the  DTC 
cost  tracking  and  reporting  functions  often  were  assigned  to  the 
program  manager's  staff  The  program  management  staff  -s  also  a 
logical  location  for  multi-functional  analyses  considering  cost,  per¬ 
formance  reliability,  main  tain  sbihtv .  and  development  program 
schedule 

Financial  Management 

TV  response  of  the  contractors  in  financial  managemen' 
occurred  as  a  result  of  the  DTC  policies  wmch.  as  discussed  earlier 
required  product  cost  estimation  at  frequent  intervals  throughout 
the  development  program  Additional  effort  wu  also  noted  unor 
warranty  policies  as  management  attempted  to  quantify  future 
financial  risks  associated  with  warranty  administration  All  of  the 
new  pol  cies  demanded  that  contractors  improve  their  cost  estimat¬ 
ing  and  forecasting  capabilities  Because  the  financial  management 
functional  area  was  most  often  responsible  for  providing  services  or 
accomplishing  this  task,  their  efforts  were  increased  substantially 

Product  Support  Planning 

Support  planning  is  a  function  tha;  ordinarily  does  not 
contribute  significantly  until  the  second  half  of  the  development 
progrim  when  product  designs  reach  the  cniical  design  review 
milestone  and  support  concepts  can  be  specifically  linked  to  the 
product  design  It  was  found  that  product  support  planning  began 
sooner  whenever  warranty  options  were  a  powbility  and  more 
total  effort  therefore  was  required  DTC  impact  was  found  to  be 
minimal  exoept  for  those  cases  where  life-cycle  costs  w*te  critical 
to  production  contractor  source  refection 

Production  Engine* rtng 

This  function  became  a  significant  part  of  the  development 
process  under  the  DTC  policies  when  produabibty  concerns 
affecting  production  cost  became  critical  Several  program  offices 
augmented  their  staff  early  in  the  development  program  with 
production  engineering  personnel  in  order  that  the  first  preliminary 
designs  would  benefit  from  production  engineering  visibility  Pro¬ 
duction  engineering  also  played  a  role  in  designing  equipment  that 
could  be  tested,  repaired  or  maintained  efficiently  under  a 
warranty  by  the  contractor  This  function  was  one  of  the  areas 
moat  affected  by  the  new  pokcies. 

Value  Engineering 

Value  engineering  (VE)  was  an  enigma  tn  our  studies  Some 
firms  placed  greater  emphasis  on  value  engineering  during  design 
while  others  replaceJ  the  traditional  value  engineering  function 
with  ad  hoc  task  forces  formed  to  reduce  costs  Our  analyses 
indicated  that  the  identification  of  value  engineering  with  only  the 
specific  requirements  and  incentives  of  a  contract  VE  clause 
restricted  a  broader  application  of  this  talent  Thus  the  overall 
impact  was  relatively  nominal  for  each  of  the  policies  examined 
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ment  the  wtnamy  impact  in  the  design.  analyses  materia  s 
management,  financial  management,  and  program  manageme' 
functions  Warranty  policies  which  focus  on  future  operation  and 
maintenance  experiences  (and  cost)  dominate  the  impact  m  anra* 
of  equipment  test,  quality  assurance,  product  support,  -nj  em’r in 
management 

It  is  difficult  to  quantify  the  observed  impair  in  terms 
cither  effort  or  cost.  For  the  warranty  policies,  our  research  tnd 
cared  that  those  contractors  who  reported  an  impact  estimate.; 
that  it  resulted  in  a  twelve  percent  increase  in  development  elf'.** 
and  a  comparable  increase  m  cost  However  onK  half  of  the 
contractors  surveyed  reported  an  impact  Most  of  the  others 


Pau  and  Repons 

All  of  the  policy  initiatives  resulted  in  additional  require¬ 
ment?  for  contractor  data  and  reports  DTC  requirements  surfaced 
pnrrarJy  in  the  form  of  periodic  production  cost  estimates  and 
con  variance  reports  Warranty  requirement:  resulted  in  more 
detailed  data  beinj  required  from  reliability  demonstration  test 
programs  and  planning  documents  to  support  the  proposed  con¬ 
tractor  repair  0'  maintenance  concept  These  policies  resulted  in  a 
moderate  increase  in  effort  in  this  area 


Contract  Management 

As  the  new  policy  initiatives  were  translated  into  contract 
reauuements.  the  contract  management  effort  increased  Contract 


clauses  calling  for  cost  goal  demonstrations  and  incentive  fee  provt 
uons  resulted  in  new  contract  analyses  The  negotiation  of  com¬ 
ply  and  detailed  warranty  or  CSC  clauses  to  be  applied  to  future 
production  contracts  also  represented  a  large  impact.  In  most  of 
the  program,  ex.  'lined .  the  formulation  and  mutual  agreement  on 
proposed  contractual  warranty  provisions  occupied  several  months 
of  intensive  and  sustained  effort  during  the  engineering  develop¬ 
ment  program 

Summary  of  Development  frogrtm  Rtaponae 

The  acquisition  policies  examined  in  this  paper  had  a  signifi¬ 
cant  impact  upon  the  planning  and  execution  of  many  engineering 
development  programs  DTC  policies  greatly  affected  the  functions 
of  design,  program  management,  materials  management,  and  pro¬ 
duction  engineering  while  policies  leading  to  rehabiiny  guarantees 
and  warranties  impacted  heavily  in  areas  of  design,  matena's 
management,  equipment  test,  financial  management,  proram 
management,  and  contract  management  There  is  evidence  that  all 
the  development  functions  were  affected  by  the  new  policies  to 
«ome  degree. 

The  relative  magnitude  of  the  policy  impacts,  together  with 
the  aggregate  impact  upon  the  development  program  functional 
elements  are  shown  in  Figure  3  It  cs  teen  from  the  figure  that 
the  policies  contribute  to  the  overall  impact  tn  different  wavs. 
DTC  policies  pnmarvy  concerned  with  acquisition  cost,  comple- 
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reported  that  program  or  institutional  bamers  prevented  takmg 
additional  development  actions  it  was  also  discovered  that  peculi¬ 
arities  uf  the  nrognm  or  bamers  prevented  most  contractors  fror- 
responding  fully  to  DTC  policies 

Contractor  Reapon*  and  Contractor  Success 

It  wis  not  possible  to  draw  conclusive  cause  and  ef'rc 
relationships  between  any  specific  development  program  charade ' 
istic  and  contractor  success  in  winning  the  production  contrac 
However,  the  consistent  behavior  of  the  winning  contractors  t* 
these  policies  is  interesting.  Stxty-five  percent  of  the  successfu* 
contractors  had  formatted  the  DTC  requirements  with  policies  and 
procedures  of  their  own.  While  there  seemed  to  be  no  recurring 
pattern  to  the  type  of  orgimrationa!  structure,  in  eve  >  c zx 
except  one.  production  or  producibiltty  er.gmecnnj  occup '  \ 

major  place  in  the  development  program  organuauon  Cos' 
management  also  was  a  strong  suit  for  the  ruining  contractor 
Another  common  characteristic  was  that  the  successful  contract 
developed  a  detailed  cost  estimating,  tracking,  and  it  porting  system 
independent  of  contractual  reporting  requirements  In  terms  » < 
program  element  impact,  the  tabulation  of  the  successful  contrac 
tors  was  also  noteworthy.  There  wis  a  ’hree-to-one  difference 
effort  reported  between  successful  and  unsuccessful  contractors  s 
almost  every  category  examined.  It  is  not  clear  whether  othc* 
program  characteristics  such  as  technical  performance  may  hsvr 
been  more  important  determinants  of  success  than  contra 
response,  but  it  is  believed  that  the  contractors  who  strong' 
embraced  the  intent  of  the  policy  initiatives  were  ir  a  more 
confident  posture  when  the  production  RFP  armed 

Barriers  to  Contractor  Response 
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Figure  S  Summer  \  of  Development  hnptm  Impact 


The  contractor  response  observed  for  the  recent  aoquisjtto? 
initiatives  was  usually  not  optimum  to  puraue  or  achieve  the  policy 
objectives.  It  was  commonly  observed  that  the  potential  f.-  a 
greater  or  more  effective  response  was  present,  but  institutional  o» 
program-unique  bamers  prevented  this  from  occumn*  TV 
problem  areas  o'  policy  bamers  encountered,  bsted  in  o*de*  cf 
their  reported  frequency,  are  shown  „•»  Table  4  below 

A  full  discussion  of  these  and  other  program-peculia*  - 

lem  areas  is  beyond  the  scope  of  this  paper  However  some  gr-c  a. 

observations  related  to  contractor  response  are  worth  mcr.t.jri"? 

A  recumng  problem  observed  ui  many  of  the  cases  examr- 
u  that  the  expected  pobey  Outcome  is  often  based  upon  *" 

premise  that  the  aequisitvjn  environment  is  fa»oraHie  <*r  V 

easily  modified  to  *tcr>m^od*Sf  'H*  '»ew  policies  txamp’"  o<  this 
•re  (11  the  expectation  that  there  »>*  jd-Vwma*  *.v<* 
money  avaUable  in  the  development  programs  tc  .re**te  equipm?-*1 
designs  m  order  to  meet  pre-set  dcs4n  cost  goals  «J*  the  e*p^  *i 
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lion  that  the  development  trlt  programs  will  provide  realistic 
indications  of  expected  operational  reliability  and  maintainability, 
and  (3)  the  expectation  that  new  policies  can  be  readily  converted 
to  contractual  requirements  and  will  instantly  implement  funda¬ 
mental  changes  in  contractor  behavior  These  expectations  were 
never  fully  realued  in  the  pro  -rams  analyzed. 

Another  problem  area  we  found  was  that  related  policy 
concepts  air  net  ueually  compatible  whenever  output  priorities 
conflict  A  policy  calling  for  fixed  pnee  guarantees  of  reliability, 
maintainability  or  support  cost  will  not  be  easily  jntegizted  into  a 
OTC  program  whose  firm  unit  production  cost  targets  have  already 
been  set  without  R&M  or  life-cycle  cost  considerations. 

Finally,  the  policies  we've  studied  are  designed  to  fundamen¬ 
tally  change  the  way  xyBeira  and  subsystems  are  developed  and 
acquired.  In  order  for  these  change!  to  occur,  the  need  for  change 
must  be  dearly  recognized  and  the  benefits  for  change  mutt  be 
dearly  viable.  These  ait  ingredient!  of  policy  credibility,  which  foe 
many  programs,  has  been  lest  than  desired.  If  the  contractor 
perceives  a  lack  of  credibility,  policy  response  will  be  reflective  and 
fundamental  changes  will  not  be  implemented.  In  this  c*ac.  credi¬ 
bility  (or  the  lack  of  credibility)  becomes  a  barrier  to  jaspietnent- 
ing  change. 


Future  Devejogment  Program  Planning 

Based  upon  what  we've  observed  for  three  recent  policy 
initiatives  and  the  subsequent  contractor  experiences  and  response, 
there  are  several  leaonajeamed  that  could  aid  contractors  m  future 
development  program  planning 

The  first  lesaondearr.ed  is  that  auccesaful  contract  on  took 
the  initiative,  interpreted  the  mter.t  of  the  policies,  and  translated 
pobey  intent  mte  operating  practice  in  advanc*  and  independent  or 
Government  contract  requirement!  This  procedure  was  riaky  and 
increased  financial  exposure  during  the  critical  early  development 
period  Successful  contractor  behavior  during  the  development  pro- 
gum  was  not  unlike  that  of  companies  who  were  developing 
products  for  the  commercial  sector.  However,  inatitiiUoaal  arrange¬ 
ments  effectively  blocked  e  full  commercial  mporm. 

The  second  ieaaon-kamed  >  that  these  new  policies  can  be 
implemented  much  eaner  if  major  banters  to  their  eiecution  are 
recognized  Vhe  foUomng  conditions  should  be  present  for  new 
acquisnion  policy  success. 


It  Th-  Govemm'n*  program  office  must  firmly  oebeve  in 

l.I  -  r  .11  -. 

sl  lilt  pullil  ltli-1  V.  ipptl't'iUlC  lu  til C  Ocvcivl'.li'  .1 
prop'll!  iiiulei  vonwdrrstion 

3)  Jufiliient  tunv  should  rsmasn  In  Ihf  tUvghipmant  pn» 
pern  to  e.vomptnh  the  goals  of  the  poU>l 

4)  Flexibility  should  be  incorporated  a>  pen  of  the  pro¬ 
gram  to  reverse  previous  decision*  if  the  new  pobev 
requires  x  chxnged  product  detign  or  development  pro¬ 
gram 

5)  Contractual  requirements  for  pobey  application  must 
be  analyzed  and  agreed-to  at  an  early  stage. 

6)  Artas  of  pobey  interference  with  present  propam 
pobey  and  planning  should  be  analyzed  and  resolved. 

^)  Additional  funds,  if  required,  should  be  available  to 
execute  the  development  program  in  accordance  with 
new  pobey  gtudebnea 

The  major  leseon-lcimed  is  that  pobewt  aimed  ai  reducing 
total  product  life-cycle  cosit  will  probably  require  more  tune  ar.d 
effort  during  development  than  otherwise  would  have  been 
expended  Basic  development  engineering  disciplines  such  as  design, 
analysis,  test,  and  evaluation,  together  with  program  mrntgement 
will  be  affected.  Indirect  functions  such  as  financial  management, 
materials  management,  and  contract  management  may  alio  require 
more  effort  to  property  analyze  and  implement  the  pobcies  Ways 
should  be  explored  to  efficiently  expend  these  valuable  front-end 
dollars  which  can  have  great  leverage  op.  the  con  and  outcome  of 
the  total  program. 


ConsJusson 

Contractor  response  to  recent  acquisition  pobey  initiatives 
was  examined.  It  waa  found  that  new  poUcy  application  to  the 
initial  programs  often  was  only  partially  effective  because  of 
improper  toning  and  delays  in  policy  acceptance.  Nevertheless, 
significant  contractor  responses  was  found  m  anas  of  pobcies  and 
pcooaduies,  organizational  structure,  cost  management,  and  devel¬ 
opment  program  plannhtg.  It  was  found  that  beneficial  contracicr 
response  usually  required  more  development  time  and  effort.  The 
potential  for  a  greater  and  mote  effective  response  waa  identified  if 
institutional  and  acquisition  environment  barriers  could  be  attenu¬ 
ated  or  abminatcd. 

Changes  in  contractor  behavior  leading  to  improvements  m 
system  and  aibtystem  cost,  reliability,  and  maintainability  are 
difficult  to  implement  txcluoveiy  through  new  policy  imtiativrs 
Fotstive  contractor  response  wgl  depend  upon  many  factors  tinging 
from  the  perceived  credibility  of  the  Government  to  the  successful 
accommodation  of  pobey  bimers  contacted  in  the  present  acquis 
lion  process 
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FAILURE  MODE  AND  EFFECT  ANALYSIS  AND  RELIABILITY  IMPROVEMENT 
Frederick  C.  Potce,  Capt,  IBAF 


ABSTRACT 

There  is  a  strong  link  between  the  essential 
aspects  of  Reliability  Improvement  Warranties 
(RIW)  and  those  of  Failure  Mode  and  Effect 
Analysis  (FMEA) .  Clearly,  it  is  the  f.'llure 
of  a  system  which  will  cause  down-time,  re¬ 
quire  logistical  supporc,  and  generally  In¬ 
crease  the  cos 1 8  and  support  efforts  required 
to  support  the  RIW.  The  evaluation  and 
elimination  of  failure  areas  early  in  the 
acquisition  process,  through  a  comprehensive 
and  thorough  Failure  Mode  and  Effect  Analysis, 
can  result  in  a  RIW  which  fulfills  its  purpose. 
A  new  analytical  tool  known  as  the  Failure- 
Criticality  Grid  is  presented  which  can 
provide  management  and  engineering  more  in¬ 
sight  into  the  value  of  FMEA  in  establishing 
the  various  aspects  which  comprise  a  RIW, 

FMEA  and  the  associated  Failure-Criticality 
Grid,  although  not  panaceao,  are  valuable 
tools  which  can  enhance  the  value  of  re¬ 
liability  improvement. 

INTRODUCTION 

Failure  Mode  and  Effect  Analysis  (FMEA)  is  a 
systematic  approach  to  the  analysis  of  the 
capabilities  and  performance  of  a  system  with 
respect  to  the  areas  of  its  possible  -allure. 

In  contrast,  a  reliability  analysis  is  con¬ 
cerned  with  the  probability  that  a  system  will 
operate  successfully  within  defined  specifi¬ 
cations  over  a  specified  period  of  time. 
Essentially,  the  FMEA  is  a  deterministic 
analysis  because  it  makes  the  basic  assumption 
that  the  system  has  failed,  regardless  of  the 
recults  of  the  reliability  analysis.  Then, 
the  FMEA  proceeds  with  a  hypothetical  de¬ 
termination  of  how  the  system  failed,  known 
as  the  Failure  Mode,  and  the  effect  that  this 
failure  will  have  on  the  system  capabilities 
and  performance,  known  as  the  Failure  Effect. 
Currently,  this  analysis  is  carried  out 
through  the  entire  system  •'tructure  from 
the  overall  system  level  to  the  lowest  level 
of  individual  components. 

The  purpose  of  this  report  is  to  ana  lyre  the 
Important  aspects  of  Failure  Mode  and  Effect 
Analysis,  relate  them  to  reliability  improve¬ 
ment  and,  consequently,  Reliability  Improve¬ 
ment  Warranties,  It  examines  the  structure 
and  use  of  the  FMEA  Failure-Criticality  Grid, 
a  new  tool  which,  when  associated  with  the 
FMEA,  enables  the  condensation  of  the  full 
depth  cf  the  Information  of  the  FMEA  and  pre¬ 
sents  in  a  form  which  1b  clear  and  easily 
evaluated. 

THE  CURRENT  ROLE  AND  FMEA 
Failure  Mode  and  Effect  Analysis  la  a  poten¬ 


tially  valuable  tool  for  the  acquisition  man¬ 
ager  and  reliability  engineer.  However,  an 
extensive  year-long  study  of  the  current  role 
of  FMEA  in  reliability  Improvement,  conducted 
by  the  author,  lias  shown  that  the  use  of  FMEA 
as  on  effective  management  tool  ia  hindered 
by  the  current  philosophy  which  surrounds  the 
process.  This  philosophy  lias  resulted  in 
procedures  which  tend  to  continue  to  limit 
the  scope  of  FMEA  utilization  and  which  con¬ 
tribute  to  the  developemnt  of  FMEA  as  a  pro¬ 
cess  which  becomes  increasingly  separated 
from  management. 

Currently,  FMEA  Is  primarily  a  reiteration  of 
the  quantitative  determinations  of  the  re¬ 
liability  analysis.  In  order  for  the  full 
benefit  of  the  FMEA  process  to  be  realized, 

FMEA  must  become  divorced  irom  the  numerics 
of  the  reliability  analyals  because  Its  full 
potential  lies  in  its  ability  to  provide 
information  for  qualitative  management 
decisions.  It  Is  recommended  that  the  re¬ 
liability  improvement  process  include  a  FMEA 
which  makes  use  of  a  technique  which  asso¬ 
ciates  failure  probability  and  failure  rate 
data  with  a  predetermined  sak  of  ranges,  l'lese 
ranges  allow  more  flexibility  in  the  decision 
making  process  because  the  dependency  of  the 
FMEA  upon  specific  numbers  la  reduced.  This 
technique  is  addressed  here  as  the  FMEA  Failure 
Criticality  Grid. 

FAILURE  MODE  AND  EFFECT  ANALYSIS 

A  system  operates,  or  fails  to  operate,  based 
upon  the  performance  of  certain  critical  com¬ 
ponents  or  subsystems.  The  key  in  evaluating 
the  ability  of  the  system  to  perform  s  requit¬ 
ed  mission,  or  achieve  s  desired  objective, 
is  the  identification  of  these  critical  areas. 
Many  times,  the  design  of  a  system  is  so  com¬ 
plex  that  a  simple  examination  is  not  suffi¬ 
cient  for  this  identification  process.  The 
Failure  Mode  and  Effect  Analysis  is  a  sys¬ 
tematic  method  of  identifying  and  classifying 
these  critical  areas  and,  subsequently, 
gaining  an  insight  into  the  feasibility  and 
extent  of  reliability  improvement  efforts. 

The  failure  mode  Is  the  manner  in  which  the 
component,  subsystem  or  system  hns  failed. 

The  analysis  also  involves  a  conslderstlon 
of  the  failure  cauae,  or  that  situation 
which  results  in  the  failure  mode.  Also  It  is 
necessary  to  determine  the  effect  which  the 
failure  mode  has  on  the  system,  or  on  those 
components  or  subsystems  directly  rela-ed  to 
the  failed  item.  In  order  to  improve  theeffec- 
tivenas  of  the  analysis  and  make  leadily  ap¬ 
parent  the  seriousness  of  any  one  particular 
failure  mode.  Each  failure  effect  is  classified 
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primarily  follows  Che  guidelines  of  Table  1. 

TAdLE  1 

CRITICALITY  CLASSIFICATIONS 


CUSS 

IV  CATASTROPHIC 


III  CRITICAL 


II  NON-CR1TICAL 


1  MINOR 


A  Hypothetical  System 

The  value  of  the  FMEA  lies  In  its  systematic 
approach,  and  by  using  the  proceeding  defi¬ 
nition!!  it  la  possible  to  establish  a  se¬ 
quence  of  events  for  the  development  of  a 
FMEA.  First,  the  aystem  being  analyzed  oust 
be  fully  identified  as  to  its  nomenclature, 
function  and  composition  including  a  de¬ 
scription  of  the  associated  subsystems.  In 
addition,  it  is.  necessary  to  identify  those 
associated  subsystems  which  are  to  be  ex¬ 
cluded  from  the  analysis.  For  our  purposes, 
we  shell  identify  Che  system  being  analyzed 
as  s  high  pressure  air  compressor  which  will, 
hypothetically,  be  used  to  supply,  all  the 
high  pressure  air  for  a  varied  number  of 
operation.  Thla  system  is  a  modification  of 
that  presented  by  Stump  (1)  in  that  it  in¬ 
corporates  a  more  comprehensive  indenture 
level  identification  acheme.  The  coopraesor 
will  be  an  electric  motor  driven  two  cylindor, 
four  stage  piston  type  »th  closed,  or  re¬ 
circulating,  water  coo  ,ng  and  eelf -contained 
lubrication.  Excluded  from  the  analysis  will 
be  the  power  controller  end  the  high  praeeuro 
storage  tank.  Figure  1  shows  the  block 
diagram  for  this  system,  which  breaks  the 
syetesi  Into  lte  functional  areas,  auch  aa 
motor  and  comprastor,  and  claarly  showa  tha 
input*  and  output#  of  tach  functional  araa, 
Thar* fora,  It  can  ba  easily  seen  that  tha 
motor  supplies  torque  of  4610  revolution#  per 
minute  (rpm)  to  the  compressor,  the  cooling 
end  moisture  separation,  and  lubrication 
stilts  and  that  tha  coispraaaor  supplies  out¬ 
puts  of  high  praasura  air  and  of  praaiura  and 


Any  single  failure  which  could  potentially 
cauee  the  complete  lose  of  the  system,  or 
cause  death  of  Injury  to  personnel. 

Any  failure  which  could  potentially  ceuen  any 
of  the  following: 

1.  The  function  or  mission  of  the  system  to 
be  aborted  without  lots  of  equipment  or 
endangering  personnel. 

2.  A  condition  which  elthoughenebllng  the 
system  tn  function,  could  become  more  serious. 

3.  A  hazardous  condition  which  is  repairable 
during  system  operation. 

Any  failure  which  degrades  the  performance 
of  tha  tyatam  and  result*  in  the  function 
or  mission  being  aborted  or  the  loss  of  any 
automatic  control  capabilities. 

Any  failure  which  does  not  degrade  the  per¬ 
formance  of  the  system,  any  type  of  failure 
other  than  those  of  Class  I,  II,  or  111, 
which  requires  corrective  action.  . 


temperature  signal*  to  the  lnetruaicnt  end 
monitor  stage.  Although  not  Included  In  the 
analysis,  the  relationship  of  the  electrical 
control  stage  to  the  over-all  system  is  also 
shown. 

Each  of  the  major  functional  areas  may  also 
consist  of  functional  aub-areaa,  and  In  a 
complex  system  thla  chain  of  Interrelation¬ 
ship*  may  be  quite  complex.  Therefore,  the 
next  step  of  the  analysis  la  to  establish 
some  means  for  the  ldentlf icntlon  of  the 
level  of  these  relationships,  or  the  Inden¬ 
ture  level.  The  first  Indenture  level  Is 
that  of  the  complete  compressor  system  and 
will  be  Indicated  by  'O'.  The  second  level 
Is  that  of  the  major  functional  areas,  in¬ 
strumentation  and  monitors,  compressor, 
motor,  lubrication,  and  cooling  and  moisture 
separation,  and  these  will  be  numbered, 
respectively,  0.1,  0.2,  0,3,  0.4,  0.5,  as 
shown  In  Figure  1.  The  third  Indenture 
level  consists  of  those  aubayatems  which 
comprise  each  of  theta  major  arses.  The 
breakdown  for  the  instrumentation  and  mon¬ 
itor  stage  la  ahean  in  Figure  2.  Each  of 
,the  subsidiary  block  diagram*  follow  lha  same 
concept  In  that  they  must  completely  Identify 
the  subsystem  function,  show  the  Input  end 
output  relationship*,  and  be  clearly  assort*- 
tad  with  the  next  higher  level  diagram.  This 
system  cen  be  easily  extended  to  the  full 
depth  of  any  aystem,  ss  shown  tn  Figure  3 
which  Illustrate*  tit*  breakdown  sF'the 
temperature  monitor  eubayetom  nv-Vtci  0.1.4 
In  Figure  2.  A  unit  design* tad  by  0.1. 4. 1.4 
can  be  readily  Identified,  tn  o  ton-down 
analysis,  aa  belonging  to  the  major  system 
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Figure  1  System  Functional  Block  Diagram 
Second  Indenture  Level 


0,,  or  the  compressor  system  major  functional 
ares  0.1,  or  the  instrumentation  and  monitor 
stage,  subsystem  0. 1,4 ,  or  the  temperature 
monitor,  subunit  0,1.4. 1,  or  the  temperature 
sensor  for  the  air  i.ilet,  and  finally  to  unit 
0.1. 4. 1.4,  or  the  fourth  stage  air  inlet 
temperature  sensor.  In  addition,  this  inden¬ 
ture  system  allows  each  input  or  output  signal 
or  function  to  be  precisely  designated.  The 
signals  for  each  individual  unit  csn  be  num¬ 
bered  consecutively  and  entered  as  a  dashed 
number  in  the  indenture  level  number.  For 
example,  the  oil  temperature  signal  shown 
in  Figure  2  would  be  designed  as  0.1. 4-3,  in¬ 
dicating  that  it  is  signal  number  three  for 
unit  0.1.4.  Although  the  system  arrangement 
seems  somewhat  complicated,  in  practice  it  is 
quite  simple  to  master  and  affords  the  analyst 
a  brief  end  precise  method  of  itemizing  and 
accounting  for  each  unit  and  signal  within  s 
complex  system, 

The  Failure-Criticality  Grid 

The  format  and  content  of  a  FMEA  done  by  one 
contractor  differs  in  form  and  content  from 
that  of  another.  However,  most  contain  either 


an  entry  for  failure  rate  or  failure 
probability.  Both  of  these  factors  are  de¬ 
rived  from  the  Information  in  the  reliability 
analysis  but  have  subtle  diffeientes.  Fail¬ 
ure  probability  is  the  probability  that  a 
failure  will  occur  during  a  specified  In¬ 
terval  ('f  time  and  failure  rate  is  the  fre¬ 
quency  at  which  failures  occur  over  a 
specified  Interval  of  time.  Failure  prob¬ 
ability  la  usually  expressed  as  a  number 
between  zero  and  one  and  failure  rate  is 
normally  expressed  as  he  number  of  failures 
occurring  per  unit  operating  hour.  This 
type  of  information  is  generally  beneficial 
because  it  provides  some  degree  of  cor¬ 
respondence  to  the  likelihood  of  the  occur¬ 
rence  of  a  failure  mode.  The  question  arises, 
however,  of  how  this  information  can  be 
effectively  employed  in  assessing  the  pro¬ 
gress  of  the  system  development,  establishing 
trade-offs  with  respect  to  the  factors  of 
co6t,  schedule  and  performance,  determining 
the  dollar  impact  of  changes,  or  establishing 
a  reliability  improvement  program. 

The  Failure-Criticality  Grid,  shown  in  Fig¬ 
ure  4,  is  a  modification  of  that  used  by 
Stump  (1)  in  that  it  more  effectively 


Figure  2.  Instrumentation  and  Monitor* 
Third  Indenture  Lc  -el 


Incorporate*  the  previously  stated  definitions. 
The  Failure-Criticality  Grid  la  intended  to 
provide  a  method  which  will  allow  tho  ac¬ 
quisition  manager  and  reliability  enjireor 
to  easily  visualise  the  relationships  of 
failure  probability  or  failure  rate  and 
criticality  classification.  Tht*  c»,n  ka 
especially' beneficial  in  effort*  In  deter¬ 
mining  the  capability  of  the  aystem  to  moat 
(pacific  design  goal*  and  objective*  al¬ 
locating  resource*  to  critical  areas  of  the 
procurement  effort,  establishing  the  impact 
of  design  changes,  and  in  determining  the 
progrear  »nd  maturity  of  the  aystem 


development  ,  The  Fh I  lure-Crltlcall ty  Grid 
uses  u  t c  hnlque  of  stratifying  the  failure 
probability  or  failure  rata  Information  into 
designated  ranges.  It  must  be  empheaiced 
tlist  the  following  dlacueeion  employs  failure 
ranges  which  are  for  example  only. 

Stret  iftcatton,  as  used  In  the  formulation  of 
th»  Fall  ite-C'ritlcallty  Crld  praaented  hare, 

Is  tho  proi'Coa  of  dividing  tlie  probability 
space  Into  dlflcient  rangaa  whan  iistm  .allure 
probabi Illy  data.  (1)  For  failure  rate  data, 
the  ares  ot  at  ratification  could,  for  example, 
cover  (rum  tero  failures  per  unit  time  to  the 


Best  Available  Copy 
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Figure  3.  Temperature  Monitor 

Fourth  Indenture  Level 


maximum  specified  failures  per  unit  time. 

The  ranges  are  flexible  and  can  be  adjusted 
in  size  and  number  according  to  the  system 
specification  and  the  requirements  of  the 
program  management.  The  stratification 
shown  in  Table  2  iu  ured  for  the  sample 
Failure-Criticality  Grid  presented  here. 

Again,  it  must  be  emphasized  that  the  failure 
ranges,  failure  probabilities  and  failure 
rates  used  herein  are  for  example  only.  In 
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actual  use  in  a  procurement  effort,  these 
factors  would  be  based  upon  the  specificatton 
and  the  requirements  of  the  particular  pro¬ 
gram. 

The  Failure-Criticality  Grid  is  a  method 
which  can  be  employed  to  quickly  and  ef¬ 
ficiently  determine  the  relationship  of  the 
criticality  classification  and  the  failure 
range,  as  determined  by  the  stratification 


TABLE  2 


STRATIFICATION  OF  FAILURE  RANGES  USED  IN  THE 
FAILURE -CRITICALITY  GRID 

RANGE 

1  Failure  probability  which  is  less 
chan  or  equal  to  0.01;-  very  low. 
Failure  rate  of  one  or  less  failures 
per  year. 

2  Failure  probability  which  is  greater 
than  0.01  and  less  than  or  equal  to 
0.10;  low. 

Failure  rate  of  more  than  one  failure 
per  year  and  ten  or  less  failures 
per  year. 

3  Failure  probability  which  is  greater 
than  0.10  and  less  than  or  equal 

to  0,20;  medium. 

Failure  rate  of  more  than  ten 
failures  per  year  and  twenty  or  leas 
failures  per  year. 

A  Failures  probability  which  la  greater 

than  0.20;  high. 

Failure  rate  of  greater  than  twenty 
failures  per  year. 


system.  The  Failure-Criticality  Grid  clearly 
fulfills  this  need.  The  primary  benefit  of 
this  method  is  the  immediate  visibility  of 
the  entire  system  development. 

If  a  reliability  engineer  should  establish  the 
goal  of  reducing  the  number  of  Category  III 
and  IV  failures,  as  well  he  should,  the 
Failure-Criticality  Grid  offers  him  a  vehicle 
with  which  to  measure  the  success  of  his 
effort.  In  addition,  he  can  determine  the 
change  in  status  of  the  failure  modes  for  the 
entire  system.  For  example,  if  a  design 
change  were  Implemented  to  eliminate  the  Cate¬ 
gory  Ill-Range  3  failure  mode,  referenced  by 
0.1-1  in  Figure  4 ,  and  this  change  resulted 
in  a  shift  of  this  failure  mode  to  Category 
IV-Range  1,  the  change  would  be  obvious  with 
the  use  of  the  Grid.  Current  FMEA  procedures 
require  that  a  large  portion  of  the  FMEA 
would  have  to  be  analyzed  before  such  a  change 
would  be  apparent.  The  Grid  of  Figure  A  shows 
a  large  cluster  of  failure  modes  in  Category 
IV-Range  1.  Perhaps  an  acquisition  manager 
might  want  to  allocate  resources  to  change 
this  situation.  Under  current  practices, 
tills  grouping  of  failure  modes  would  be  hidden 
in  the  complexity  of  the  FMEA.  Nearly  every 
occurrence  which  changes  the  criticality 
classification  or  failure  range  of  a  specific 
failure  mode  is  made  clear  through  the  use 
of  the  Fa llure -Cri t icall ty  Grid.  In  addition, 
the  Impact  of  such  a  change  upon  the  entire 
system  configuration  la  readily  r(.oarent. 
Essentially,  the  Grid  can  provlce  the  acquisi¬ 
tion  manager  and  reliability  engineer  with 


increased  visibility  ol  the  procurement  effort 
and  result  in  Increased  managerial  efficiency. 
The  benefits  to  be  derived  from  the  use  of  the 
Failure-Criticality  Grid  can  be  directly 
applied  to  a  comprehensive  program  of  re¬ 
liability  improvement. 

The  advantages  of  the  Fa i lure -Cri t lea  lit y 
Grid  in  enhancing  the  reliability  improvement 
of  an  acquisition  effort  are  apparent.  First, 
it  provides  the  leliabiiity  engineer  with  a 
clear  and  concise  presentation  of  the  major 
system  problem  areas.  Additionally,  it  shows 
tiie  distribution  of  these  critical  areas 
through  the  full  rungt  ol  criticality  classi¬ 
fications.  If  the  reliability  engineer  is 
careful  in  the  structuring  of  the  stratifica¬ 
tion  of  ihe  foilure  probability  or  failure 
rate,  data,  the  data  takes  on  added  meaning 
by  clearly  showing  the  relationship  between 
the  criticality  classification  and  the  fail¬ 
ure  data.  The  Failure-Criticality  Crid  can 
also  be  employed  by  the  acquisition  manager 
in  his  efforts  to  properly  allocate  re¬ 
sources  to  the  system  development.  Critical 
areas  which  demand  priority  attention  are 
no  longer  buried  in  the  complexity  of  the 
FMEA  and  become  obvious.  Most  importantly 
for  the  purposes  of  reliability  improvement, 
the  Failure -Criticality  Grid  provides  a 
vehicle  for  evaluating  the  chan.ges  which 
occur  due  to  design  changes  made  in  response 
to  reliability  improvement  icqulremen^s.  By 
showing  the  distribution  of  failure  modes 
across  all  major  subsystems,  the  impact  of 
reliability  improvement  efforts  become 
obvious.  When  used  in  conjunction  with  the 
Failure-Criticality  Crid,  the  FMEA  takes  "n 
increased  volue  and  cost-effectiveness. 

The  reliability  of  the  system  la  a  factor 
which  must  be  considered  throughout  the 
entire  acquisit'on  cycle.  Clearly,  If  the 
system  Is  not  rt  -iable  then  Its  feasibility 
for  fulfilling  the  defense  objective  is 
negated.  The  impact  of  design  changes 
the  types  and  distribution  of  failures,  the 
causes  and  effects  of  failures,  the  symp¬ 
toms  and  detectability  of  failures,  and 
the  interrelationships  of  subsystems  are  all 
factors  which  Influence  .eliablllty. 
Accordingly,  the  FMEA,  and  its  associated 
Fa Ilurc-Crltlc8li ty  Grid,  are  methods  by 
which  each  of  these  factors  cot.  be  assessed. 
However,  this  study  has  found  that  little 
use  is  made  of  the  FMEA  In  this  context. 

A  great  deal  of  the  Information  which  is 
used  is  evaluate  the  maintainability  of  a 
system  la  drawn  from  the  reliability 
analysis  because  of  the  numerical  determin¬ 
ations  made  for  such  fsetors  as  mean-tlmc- 
to-repalr  (MVTR) ,  mean-tlmc-betwccn-lallurc 
(KTBF) ,  mean-tlmc-bctwcen-rcpiacement  (MTBR) , 
maintenance  downtime  (MDT) ,  and  total  turn¬ 
around  time  fTAT) .  The  FMEA  is  not 
structured  to  provide  the  calculations  foi 
these  factors,  and  it  ahould  not  be. 
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However,  the  FMEA  can  provide  the  information 
needed  to  make  a  qualitative  evaluation  of 
reliability  improvement  because  if  does 
show  the  relative  impact  of  design  changes, 
and  emphasizes  those  areas  of  failure  which 
con  cause  * igni f leant  maintenance  problems. 
The  Failure  Mode  and  Effect  Analysis  also 
shows  Che  subsystem  relationships  Involved 
In  the  system  and  can  indicate  the  existence 
of  problem  nitas  which  may  not  be  apparent 
bv  the  nunc  r  alone. 

SUMMARY 


failure  Mode  and  Effect  Analysis  3nd  re- 
liab'ltty  improvement  are  closely  linked, 
flu  O'  h  a  description  of  t  hypothetical 
compressor  vt  ".  the  fundamental  com- 
ponor.-s  of  a  FMEA  have  been  considered. 

This  description  has  been  oriented  toward 
a  description  of  the  make-up  and  use  of 
a  new  analytical  tool,  known  as  the  Failure- 
Critical  ity  Grid.  The  Grid,  when  used  in 
conjunction  with  the  FMEA,  offers  the 
acquis! tion  manager  and  reliability 
engineer  a  voluahle  vehicle  for  the  clear 
end  concise  presentation  of  the  data 
contained  in  the  FMEA,  and  enables  an 
efficient  evaluation  of  the  effectiveness 
of  reliability  improvement  efforts. 

The  true  validity  and  cost  effectiveness 
of  the  FMEA  process  lies  in  Its  capability 
to  be  applied  10  a  diverse  number  of  areas 
of  the  procurement  effort.  This  study 
has  found  that  the  current  structure  of 
FMEA  and  the  general  philosophy  surrounding 
its  use  hive  acted  as  deterente  to  its 
be.ng  employed  to  its  full  potential.  This 
is  especially  line  'n  the  broad  area  of 
reliability  Improvement.  A  change  in  the 
current  philosophy,  and  the  subsequent 
change  m  the  procedures ,  can  result  in 
a  wider  osc  nnd  acceptance  of  FMEA,  As 
the  scooe  of  FMEA  use  increases  to  cover 
more  aspects  o!  the  procurement  effort,  its 
■..slid. tv  and  con  effectiveness  increase. 
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INTRODUCTION 


In  a  September  30,  1977 ,  General  Accounting 
Office  (GAO)  report,  entitled  "An  Organized 
Approach  to  Improving  Federal  Procurement  and 
Acquisition  Practices,"  it  was  reported  that: 

"Today  a  program  of  organized  research 
into  Federal  procurement  and  acquisi¬ 
tion.  practices  does  not  exist  on  a 
government-wide  basis  or  within  an 
executive  department.  The  present 
pattern  of  research  efforts  by 
executive  agencies  is  mixed,  ranging 
from  no  program  to  a  few  efforts  in 
DoD."  (11:2) 

The  formalization  of  procurement/acquisition 
research  within  the  Federal  Government  had  its 
start  within  the  Department  of  Defense  (DoD) 
approximately  eleven  years  ago.  One  of  the 
recommendations  of  the  Defense  Procurement 
Pricing  Conference  held  in  Hershcy,  Pennsyl¬ 
vania,  in  November  196V,  was  to  establish  a 
DoD  procurement  research  laboratory.  Although 
this  reconnendatlon  wes  not  Implemented, 
Individual  DcD  components  moved  to  set  up 
formal  procurement  research  organizations  and, 
recently,  DoD  Initiated  a  program  to  establish 
a  research  planning  system  by  organizing  the 
DoD  Acquisition  Research  Council  (ARC).  On 
the  civil  agency  side,  there  hove  been  no 
formalized  programs  to  the  extent  of  establish¬ 
ing  agency  procurement  research  centers  or 
organizations.  However,  there  has  been,  and 
continues  to  be,  procurement  research 
accomplished  and/or  sponsored  by  several  civil 
agencies.  Much  of  the  significance  of  this 
research  ic  being  lost  or  overlooked  due  to  a 
lack  of  understanding  and  a  clear  definition  of 
what  constitutes  procurement  research. 


BACKGROUND 


In  oreer  to  understand  the  state  of  procurement 
research  in  the  civil  agencies,  it  is  flrsc 
necessary  to  ret  lew  briefly  the  history  of 
procurement  research  in  DoD  and  the  other 
forces  and  organizations  leading  to  the  present. 

In  January  1969,  following  tnc  recommendation 
cr  the  Hershey  Conference,  Secretary  of  Defense 
Clark  Clifford,  In  his  prepared  statement 
regarding  the  1970  Defense  budget  and  Defense 
program,  proposed  that  a  procurement  research 
laboratory  be  established.  Later,  a  House 
Committee  on  Government  Operations  report 
(House  Report  No.  91-1719,  December  10,  1970) 


stated  that: 

"The  rationale  for  Mr.  Clifford's 
proposal,  we  surmise,  is  based  on  the 
consideration  that  so  much  of  procure¬ 
ment  research  today  is  done  essentially 
on  a  fast-reaction  basis,  In  response 
to  immediate  problems,  with  short-term 
results.  Innovations  or  improvements 
which  do  come  about  are  not  necessarily 
brought  to  the  attention  of  other 
procuring  activities.  Similarly, 
improvements  which  may  be  developed  in 
industry  or  in  the  academic  world  may 
be  missed.  Even  where  innovations  see 
the  light  of  day,  there  may  be  long 
delays  before  they  are  exploited  by  the 
Defense  Department's  many  procuring 
activities  or  agencies.  A  procurement 
research  laboratory  in  our  opinion 
would: 

Identify  and  exploit  new  and 
significant  business  methods; 

Develop,  test,  and  innovate  procure¬ 
ment  methods  on  a  systematic  and 
centralized  basis; 

Effect  coordination  of  such  efforts 
within  the  Department  of  Defense; 

Test  or  simulate  the  impact  of  malor 
..ew  policies  and  procedures  on 
government  activities  and  industry 
prior  to  their  issuance; 

And  provide  an  in-hou3e  consulting 
and  training  capability  to  hasten 
the  exploitation  of  significant 
developments." 

Although  the  Idea  of  a  DoD  procurement  research 
laboratory — in  several  forms — was  discussed, 
including  use  of  the  Logistics  Management 
Institute,  different  views  among  the  services 
postponed  Indefinitely  any  unified  effort. 

Wliile  the  above  events  transpired,  the  Army 
established  its  Procurement  Research  Office 
(APRO)  in  1969.  Subsequently,  the  Air  Force 
organized  the  Business  Management  Research 
Center  (AFBMRC)  in  1973;  the  Navy  Its  acquisi¬ 
tion  research  program  in  1977  (presently  being 
restructured) ;  and  the  Defense  Systems  Manage¬ 
ment  College  (DSMC),  also  in  1977,  initiated  a 
formalized  program  of  acquisition  research. 

External  to  the  DoD  efforts,  in  1970  Study 
Croup  No.  5,  Organization  and  Personnel  of  the 
Commission  on  Government  Procurement  (COOP), 
discussed  procurement  research  during  its 
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«<■! r  1  <» !i  of  civil  agency  visits,  and  found  that 
some  agencies  did  not  favor  Internal  agency 
retiearch.  This  was  due,  In  some  Instances,  to 
an  agency' o  low  volume  of  procurement  and,  in 
other  cases,  because  the  agency  felt  that! 

-  ad  hoc  management  studies,  in  lieu  of 
formal  research  programs,  are  more 
effective  in  solving  their  problems; 

-  an  agency  program  would  Impose  an 
undue  burden  on  Its  resources  snd 
could  result  in  research  duplication; 
and 

-  a  Joint  interagency  or  government¬ 
wide  approach  is  more  economical  and 
realistic  for  meeting  agency  reaearch 

needs.  (1:758) 

In  its  final  report,  the  COGP  recommended  the 
establishment  of  a  "Federal  Procurement  Insti¬ 
tute"  and  listed  its  responsibilities  in  the 
field  of  research  as  follows: 

"Conduct  and  sponsor  research  in  pro¬ 
curement  policy  and  procedure.  (This 
function  would  encompass  the  concept 
of  the  'Procurement  Research  Laboratory' 
as  discussed  in  House  Report  91-1719, 
December  10,. 1970.), 

"Establish  and  maintain  a  central 
repository  and  research  library  in 
the  field  of  Federal  procurement  and 
grants. 

"Offer  a  program,  similar  to  Sloan 
Fellowships,  for  Federal  and  industry 
personnel.  This  program  would  provide 
a  period  of  study  and  research  at  the 
Institute  or  related  institutions. 

"Maintain  liaison  with  professional 
organizations;  participate  in  inter¬ 
governmental  and  international 
procurement  conferences  and  related 
activities."  (2:52) 

The  Commission's  report  and  subsequent  inter¬ 
agency.  task  group  reports  to  establish  an 
executive  branch  position  on  the  Commission's 
recommendation  stated  th 

the  DoD  research.7  centers  will 
stress  DoD  procurement,  it  appeare 
that  a  gap  exists  insofar  aa  procure¬ 
ment  reaearch  in  other  agencies  ia 
^concerned.  The  Work  Croup  bellavcs 
this  gap  ahould  be  filled.  Aa  DoD  can 
best  meet  its  own  research  needs,  it 
should  proceed  with  Its  present  plans 
and  actions.  Other  egenclea  ahould 
also  be  encouraged  to  conduct  thalr 
own  research  in  tha  procurement  field. 

The  FPI  ahould  conduct  or  aponaor  that 
reaearch  which  la  of  Government-wide 
interest  or  which  is  beyond  the  scope 


of  individual  agencies.  It  might  nlcv 
conduct  research  relating  to  a  particu¬ 
lar  agency  at  the  requeet  of  the  agency 
concerned.  The  FPI  should  also 
coordinate  the  planning  and  imple¬ 
mentation  of  procurement  research 
conducted  or  sponsored  by  the  various 
Federal  agencies  to  avoid  duplication 
or  overlapping."  (5:8) 

The  next  milestone  in  the  evolution  of  procure¬ 
ment  research  (and  one  of  the  moat 
significant)  occurred  with  the  establishment 
of  tha  Office  of  Federal  Procurement  Policy 
(OFPP) . 

Public  Law  93-400,  enacted  on  August  10,  197/.,^ 
established  the  OFPP  in  the  Office  of  Manage- ‘ 
ment  and  Budget  (0MB)  to  provide  overall 
direction  of  procurement  policy  and  ti  Improve 
the  economy,  efficiency,  and  effectiveness  of 
the  procurement  of  property  and  services  by 
the  executive  agencies.  The  creation  of  OFPD 
as  the  focal  point  for  Federal  procurement 
policy  implemented  the  first  recommendation  of 
the  Commlasion  on  Government  Procurement. 

Public  Law  93-400  set  forth  six  functions  for 
the  Office  of  Federal  Procurement  Policy  and, 
although  only  one  is  directly  concerned  with 
procurement  research,  all  are  paraphrased 
below  due  to  their  interrelationship: 

1.  Establish  a  system  of  coordinated 
and,  to  the  extent  feasible,  uniform 
procurement  regulations. 

2.  Establish  criteria  for  soliciting 
the  viewpoints  of  interested  parties 
In  the  development  of  procurement 
policies  and  regulations. 

3.  Monitor  and  revise  policies 
relating  to  reliance  by  the  Govern¬ 
ment  on  the  private  sector  to  provide 
needed  property  and  services. 

4.  Promote  end  conduct  research  in 
procurement  policy  matters. 

5.  Establish  a  Government-wide 
procurement  data  system. 

6.  Recommend  and  promote  programs 
for  recruitment,  training,  career 
development,  and  performance  evalua¬ 
tion  of  procurement  personnel. 

For  the  first  time,  tj  a  result  of  the  Act, 
there  is  a  statutory  responsibility  to  promote 
and  conduct  procurement  research.  Although 
the  Act  does  not  describe  or  define  procurement 
research,  the  legislative  hl-tory  of  P.L.  93- 
400  makea  it  clear  that  Congress  “he 

responsibilities  of  OFPP  lit  t  broad  sense, 
encompassing  the  areas  covered  by  the  149 
recommendations  of  the  COGP.  Taking  the  Act  t 
and  the  legislative  history  into  consideration. 
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it  is  obvious  that  the  scope  of  "procurement 
research"  can  be  considered  in  a  very  broad 
context,  including  the  full  range  cf  functions 
and  activities  of  the  OFPP. 

In  July  1976,  Hugh  Witt,  the  first  Administra¬ 
tor  for  Federal  Procurement  Policy,  established 
the  Federal  Procurement  Institute  (FPI)  by  a 
"Memorandum  to  Heads  of  Executive  Departments 
and  Agencies,"  which  set  forth  the  following 
objective  for  procurement  research: 

"promote,  monitor,  and  conduct 
research  to  develop  business  methods 
and  management  techniques  that  will 
advance  the  state-of-the-art  Ip. 
procurement . " 

The  establishment  of  the  FPI  was  later 
endorsed  by  a  "Memorandum  of  Understanding  and 
Plan  for  Sponsorship,  Organization  and  Opera¬ 
tion  of  the  Federal  Procurement  Institute," 
originally  signed  by  20  agencies  during  1976 
(24  as  of  April  1978).  This  M01I  reiterated 
the  above  research  bjective,  stating  that: 

"...the  FPI  will  be  the  focal  point 
for  coordinating  the  Government-wide 
planning,  development,  implementation, 
and  evaluation  of  programs  in  the  areas 
of  procurement  research,  education  and 
training,  and  career  development." 

I:  further  stated  that  the  FPI  would  work  in 
cooperation  with  the  participating  agencies, 
the  Civil  Service  Conmission,  and  the  OFPP  in 
carrying  out  Its  stated  objectives. 


TOE  FEDERAL  PROCUREMENT/ ACQUISITION  INSTITUTE 
AND  PROCUREMENT  RESEARCH 


On  September  9,  1977,  Dr.  John  J.  Bennett  was 
sworn  in  as  the  first  Director  of  the  Federal 
Procurement  Institute  (changed  to  the  Federal 
Acquisition  Institute  as  of  March  1,  1978), 
and  plans  were  immediately  Initiated  to 
structure  a  procurement  and  business  research 
program  as  one  of  the  Institute's  primary  func¬ 
tions  (the  other  primary  areas  being  education 
and  training  and  career  development). 

Or.e  of  the  first  steps  taken  by  the  Federal 
Acquisition  Institute  (FAI)  to  build  its 
research  efforts  was  to  hold  a  Procurement  and 
Business  Research  Planning  Heeting  on  October 
27,  1977,  to  initiate  the  development  of  a 
"Federal  Procurement  and  Business  Research 
Planning  System."  Attendees  from  OFPP,  the 
Department  of  Energy  (DOE),  the  Department  of 
Housing  and  Urban  Development  (HUD) ,  and  the 
four  DoD  procurement  and  acquisition  research 
centers  met  informal Iv  to  discuss  OFPP  and  FAI 
research  roles,  review  DoD  experience,  discuss 
civil  agency  requirements,  and  to  consider  a 
broad  FAI  approach  to  research  planning.  One 


ot  the  moat  significant  things  to  come  out  of 
tills  meeting  was  the  definition  of  tile  role  of 
OFPP  and  FAI,  made  by  Mr.  LeRoy  Haugh, 
Associate  Administrator  for  Regulations  and 
Procedures,  OFPP,  who  has  the  responsibility 
for  procurement  research  within  the  Office  of 
Federal  Procurement  Policy.  Mr.  HauRh 
characterized  the  role  of  OFPP  in  procurement 
research  as  one  of  policy  making  and  program 
initiation,  and  chat  the  FAI  would  act  as  Its 
operational  entity  in  accomplishing  specific 
research  programs. 

As  a  result  of  this  meeting.  Air  Force  repre¬ 
sentatives  agreed  to  draft  a  research  guide 
with  Army  input  and  DSMC  assistance.  The  four 
DoD  centers,  OFPP,  and  FAI  agreed  to  meet  in 
late  November  to  begin  to  prepare  a  five-year 
annual  plan,  using  the  elements  of  a  planning 
system  prepared  by  the  FAI  as  the  initial 
framework. 

The  first  plan  was  to  reptesent  the  aggregate 
of  requirements,  projects,  and  funding  for  the 
six  participants  and  r.a  provide  the  procedural 
basis  for  future  growth.  The  FAI  agreed  to 
devote  one  man-year  of  effort  to  determine 
civil  agency  research  needs  that  would  be 
merged  Into  a  government-wide  plan  at  „  later 
date. 

The  second  procurement  and  business  research 
planning  session  was  held  on  November  29.  19/7, 
where  attendees  from  three  DoD  procures ent  and 
acquisition  research  centers,  the  Experimental 
Technology  Incentives  Program  (El IP)  of  the 
National  Bureau  of  Standards,  National 
Aeronautics  and  Space  Administration  (NASA), 
HUD,  and  DOE  took  a  fret  cut  in  structuring  a 
five-year  procurement  and  business  research 
plan  based  upon  real  and  perceived  rescr  h 
requirements. 

In  December  1977,  the  Acquisition  Research 
Council  (ARC)  was  formed  within  DoD.  The  ARC 
ie  chaired  by  Mr.  Dale  Church,  Deputy  Under 
Secretary  of  Defense  (Acquisition  Policy),  and 
includes  acquisition  executive  officials  from 
the  Office  of  the  Secretary  of  Defense  70SD) 
and  the  military  departments,  as  well  as  the 
Commandant,  DSMC,  and  the  Director  of  the  FAI. 
In  the  two  previous  planning  sessions,  the  FAI 
had  met  with  representatives  from  the  DoD 
procurement  and  acquisition  research  centers. 
Under  a  new  arrangement  discussed  at  the  first 
ARC  planning  session ,  the  FAI  was  now  tc  work 
Jointly  with  an.'  through  the  DSMC,  who  would 
act  as  the  executive  agent  for  DoD  acquisition 
research. 

The  Acquisition  Research  Council  then  held  its 
first  meeting  under  the  direction  of  its 
chairman,  Mr.  Church,  in  January  1978. 
Representatives  f:om  the  Amy,  Navy,  Air 
Force,  Defense  Logisti-s  Agcncv  (DLA),  DSMC, 
and  the  FAI  attended,  and  discussions  were 
held  on  the  propojed  membership  and  organiza¬ 
tion  of  the  Council.  The  Council’s  planning 
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arm  at  the  military  department  level,  Che 
"Acquisition  Research  Coordinating  Committee," 
also  held  its  first  meeting  in  January,  and  the 
Director,  FA1,  will  be  a  member  of  both 
organizations.  The  DoD  Is  currently  circulat¬ 
ing  s  draft  directive  (DoD  Directive  4105.68, 
dated  March  10,  1978)  which  describes  the 
procedures,  ■•esponsjbilities,  and  menbership  of 
both  the  ARC  an!  its  coordinating  committee. 


PROCUREMENT  RESEARCH  AND 
THE  CIVIL  AGENCIES 


Paralleling  the  initial  planning  research 
efforts  of  the  FAI  and  the  establishment  of 
DoD’s  sRo,  the  0A0  report  on  procurement 
research,  Organized  Approach  to  improving 
Federal  Procurement  and  Acquisition  Practices," 
dated  September  30,  1977,  wan  sent  to  Congress 
and  distributed  throughout  the  government. 

In  the  report,  the  GAO  related  that  procure¬ 
ment  practices  have  become  so  important  in  the 
scheme  of  Federal  operations  that  large 
government  agencies — such  as  Defense,  Energy, 
Transportation,  NASA,  and  GSA — depend  upon 
systems,  products,  and  services  obtained  from 
private  entei prise  to  do  their  job.  These 
activities  cost  about  $70  billion  annually  and 
involve  about  60,000  Federal  workers.  (11:1) 

The  GAO  report  also  pointed  out  that: 

-  over  the  past  30  years,  procurement 
has  becoce  more  complex; 

-  efforts  to  solve  problems  have 
resulted  in  a  complex  patchwork  of 
laws,  methods,  regulations,  proce¬ 
dures,  and  administrative 
requirements:  and 

-  not  all  the  old  problems  have  been 
solved  and  new  ones  continue  to 

at i3e. 

As  to  procurement  research,  GAO  related  that 
both  the  House  Government  Operations  Committee 
and  the  Commission  on  Government  Procurement 
recommended  a  continuing  -rograa  of  research  to 
make  Federal  procurener  jractices  work  better 
and  to  design  and  test  e  best  ways  to  carry 
out  new  policies;  i.t.,  using  a  scientific 
approach  to  improving  Federal  procurement. 

The  GAO  also  found  that: 

"Currently,  there  arc  no  procurement 

research  programs  in  some  agencies. 

In  others  there  are  a  few  relatively 

new  ones. 


DoD,  procurement  research  has  been 
going  on  for  about  6  years.  Even  so, 
the  general  condition  is  one  of 
instif ficiont  momentum. 

"Some  agencies  expect  the  newly 
emerging  Federal  Procurement  Insti¬ 
tute  to  carry  this  burden.  The 
institute  is  onlv  now  being  estab¬ 
lished,  however,  and  will  take  some 
tine  to  become  operationally 
effective.  Even  then  it  will  not 
perform  research  roles  for  the 
individual  agencies."  (11 : 1— i i) 

In  view  cr  its  findings,  the  GAO  recommended 
to  0MB  the  establishment  of  a  strong  program 
for  procurement  and  acquisition  r-  .earch  on  a 
government-wide  basis.  As  part  o'  •!■<*-  pro¬ 
gram,  those  agencies  dependent  upon  pi  ire- 
nent  and  acquisition  processes  to  carry  out 
their  primary  responsibilities  would  be 
required  to  establish  a  continuing  research 
effort  to  assure  effective  procurement  and 
acquisition. 

As  envisioned  by  the  GAO,  such  a  program  would 
enable  agencies  to: 

"o  Correct  and  refine  procedures  on  a 
continuing  basis  and  cope  with  pro¬ 
curement  problems  pecullat  to 
particular  agencies  as  the  diffi¬ 
culties  arise. 

'o  Evaluate  agency  experiences  In 
procurement  and  acquisition , 
achieve  lnnotative  Improvements , 
develop  training  materials  and 
participate  in  research  of  a 
government-wide  nature." 

Additionally,  GAO  discussed  various  uses  cf 
such  research  and  set  forth  a  framework  for 
organizing  and  operating  a  procurement 
research  program,  setting  forth: 

"o  Definitions  of  the  procurement 
research,  function  both  narrow  and 
broad. 

"c  Basic  prerequisites  for  operating 
the  program. 

"o  Roles  of  participants,  including 
Federal  agencies,  the  Federal 
Frocureaent  Institute,  3nd  the 
Office  cf  Federal  Procurement 
Policv. 

"c  Considerations  In  screening 

research  needs,  selecting  proioets, 
conducting  the  Tcsc.,r“t  •■nelf  and 
evaluating  results. 


"Civilian  agencies  generally  arc 
re'  uc tan',  to  undertake  procurement 
re-.earch.  Vithln  somt  quarters  of 


<500 


In  response  to  the  GAO  findings,  Mr.  Lester  A. 
Fettlg.  Administrator  for  Federal  Procurement 


Policy,  seated  In  a  letter  to  the  General 
Accounting  Office: 

"The  Office  of  Management  and  Budget 
shares  your  concern  that  not  enough 
attention  has  been  devoted  In  the  past 
to  research  of  procurement  problems. 

The  summary  of  research  activity  now 
being  curried  on,  and  the  framework 
for  an  expanded  program  suggested  In 
your  report,  will  be  useful  In  promot¬ 
ing  a  Government-wide  program. 

"In  the  second  paragraph  of  the 
digest,  you  state,  'In  retrospect, 
the  Improvements  have  not  been 
forthcoming  due.  In  part,  to  the 
lack  of  strong  and  sustained  agency 
research  efforts  to  get  at  root  causes 
and  make  breakthrough  improvements.' 

I  have  no  douht  that  a  strong  program 
of  procurement  research  will  result  In 
significant  improvements,  but  this 
should  be  coupled  with  operational 
implementation  considerations."  (11:48) 

As  a  next  step,  Mr.  Fettlg,  in  a  letter  to 
Dr.  Bennett  dated  February  14,  1978,  designated 
the  Federal  Acquisition  Institute  to  be  the 
focal  point,  particularly  for  the  civil 
agencies,  to  follow  up  on  the  GAO  report.  At 
the  same  time,  Mr.  Fettig,  by  a  memorandum  also 
dated  February  14,  1978,  requested  civil  agency 
FAI  Policy  Board  members  to  designate  a  pro¬ 
curement  research  representative  to  attend  an 
initial  procurement  research  planning  session 
and  to  continue  serving  as  their  agency's 
focal  point  in  working  with  the  OFPP  and  the 
FAX. 

The  first  civil  agency  procurement/acquisition 
research  planning  session  wss  held  on  March  2, 
1978,  and  chaired  by  Dr.  Bennett.  The  group 
was  addressed  by  Mr.  Fettig,  who  stressed  the 
importance  and  benefits  that  would  occur  from 
an  organized  program  of  acquisition  and 
procurement  research.  After  considerable  eis- 
cussion,  the  attendees,  representing  fifteen 
civil  agencies,  unanimously  agreed  to  consti¬ 
tute  the  groun  as  a  "Civii  Agency  Acquisition 
Research  Council"  and  to  organize  and  develop  a 
charter  as  an  FAI  Interagency  Specialized  Work 
Group  (ISWG).  During  the  discussions  on  a 
proposed  charter,  it  was  agreed  that  the 
council's  primary  focus  should  be  initially  one 
of  better  communication  and  coordination  among 
the  agencies  in  the  research  area,  and  that  the 
role  of  the  FAI  would  be  to  operate  the 
organizational  mechanism,  coordinate  activities 
between  the  DoD  ARC  and  the  council,  and  pro¬ 
vide  research  support  for  the  council  and  its 
agencies.  In  addition,  the  council  would 
recommend  specific  projects  and  recommend  a 
research  budget  for  these  efforts. 

During  the  ensuing  discussion,  it  became 
evident  that  there  was  a  need  for  definitions, 
and  the  ETIP  representative  agreed  to  take  on  a 


short-term  project  to  provide  a  working 
definition  of  procurement  research  and  to 
define  appropriate  policies  for  conducting  such 
research.  At  this  poirt,  Mr.  I.eRoy  Haugh, 

OFPr  stated  that  in  DoD  they  tried  not  to 
narre-  down  definitions  of  research  since  they 
did  not  want  procurement  research  to  become 
too  esoteric  and  removed  from  real  problem 
areas  He  further  stated  that  DoD  procurement 
research  wan  a  systematic  approach  to  problem 
solving;  which  is  what  we  are  aiming  for  here 
rather  than  trying  to  force  the  development  of 
formal  research  organizations  on  the  civil 
agencies.  The  next  planning  session  of  the 
council  was  set  for  April  7,  1978. 

If  the  first  civil  agency  research  planning 
session  could  be  characterized  as  one  of 
guarded  optimism,  the  second  session,  held  on 
April  7,  was  by  contrast  quite  enthusiastic. 

The.  second  meeting  was  also  chaired  by 
Dr.  Bennett  and  attended  by  representatives  of 
15  civil  agencies,  OFPP,  FAI,  and  one  observer 
from  the  DSMC. 

The  first  order  of  business  was  for  each 
council  member  to  discuss  procurement  and 
business  research  in  their  respective  agencies. 
Since  ETIP,  NASA,  and  DGF.  have  on-going 
research  projects,  their  representatives  had 
been  requested  to  prepare  more  extensive 
briefings  than  the  other  members,  and  they  led 
off  the  discussions.  Since  this  paper  is  con¬ 
cerned  with  procurenent/acquisition  research 
in  the  civil  agencies,  the  following  is  an 
agency-by-agency  summary  of  their  briefings 
and  remarks: 

ETIP.  National  Bureau  of  Standards.  Department 
of  Commerce. 

The  ETIP  procurement  program  objectives  were 
listed  as  twofold: 

o  To  determine  if  government  procurement 
can,  through  the  use  of  procurement 
incentives,  stimulate  private  sector 
innovation. 

o  To  develop  a  framework  which  relates  the 
use  of  incentive  techniques  to  agency, 
product,  and  industry  characteristics. 

The  strategy  employed  is  to: 

o  Conduct  procurement  experiments  with 
partner  agencies  that  test  particular 
incentives. 

o  Document  and  evaluate  results. 

o  Make  policy  recommendations. 
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On-going  programs,  products,  and  Involved 
agencies  were: 


technology  or  systems  design  growing  out  c' 
basic  research. 
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The  ETIP  Research  Process  was  discussed,  and 
the  fo1 lowing  outline  of  the  process  was 
presented: 

o  identify  the  Who  cares? 

decision  maker 


The  Comptroller  General's  report  to  the 
Congress  (PSAD-77-128,  September  30,  1977)  mad, 
it  very  clear  that  it  is  important  to  add  some 
formality  to  our  research  program.  With  more 
formality,  we  will  have  an  opportunity  to 
maximize  the  results  of  our  research  and  we 
achieve  a  positive  means  through  which  we  can 
identify  related  activities  being  conducted  by 
others.  Although  the  report  expresses  a  con¬ 
cern  relative  to  independent  agency  research 
since  It  tends  to  "fractionalize  and  duplicate 
cifwrt,"  we  have  been  performing  procurement 
research  and  pian  to  continue  to  do  so.  To 
the  extent  that  our  efforts  can  be  molded  with 
the  efforts  of  others  such  as  the  members  ri 
this  Council  and  the  Federal  Acquisition 
Institute,  we  should  all  benefit  and  Our  con¬ 
cern  will  vanish. 


o  Obtain  information 
needs 

o  Preliminary  feedback 
o  Design 

o  Implement 
o  Evaluate 


What  will  it  take 
to  convince  you? 

What  will  happen? 

What  data  do  we 
get?  Who  gets  it? 

Make  the  change 

What  happened? 


My  remaining  comments  will  relate  to  our  pro¬ 
gram  in  tnree  time  phases:  Past  (prior  to 
PSAD-77-128);  Transition  (the  "now"  period); 
and  Future  (how  we  plan  to  conduct  our  formal 
program) . 

Past  Phase:  We  have  a  long  history  of 
Independent  activities  relating  to  many  facets 
of  the  acquisition  process.  The  activities 
h3ve  been  performed  both  in-house  and  by  the 
private  sector. 


o  Recommendations 

The  ETIP  approach  to  Procurement  Research  war, 
given  as:  A  systematic  approach  to  problem 
solving.  Assumptions:  (1)  Currently  not 
enough  Information  to  make  a  decision;  (2) 
final  product  of  research  effort  will  be  a 
decision. 

NASA  (Prepared  remarks  were  furnished  by  the 
NASA  representative.) 

Although  NASA  has  not  had  a  formal  program  for 
conducting  procurement  or  acquisition  research, 
we  have  been  informally  performing  research  to 
support  our  acquisition  process  since  our  very 
earliest  days.  Some  of  i-  has  been  evolution¬ 
ary  end  stimulated  by  t'  more  general  growth 
of  our  profession.  Ana  -.omc  has  been  directed 
by  the  challenge  of  the  features  of  our  Space 
Act  and  the  unique  role  it  provides  NASA  as  we 
interface  with  the  private  sector. 

We  prefer  to  distinguish  between  procurement 
basic  and  applied  research.  Both  carry  the 
traditional  definition.  That  Is,  It  Is  a 
studious  inquiry  or  examination  aimed  at  the 
discovery  and  Interpretation  of  facto,  revision 
of  accepted  theories  or  laws  In  light  of  new 
facts,  or  practical  application  of  ouch  new  or 
revise'  theories  or  lava.  Basic  research  's 
considered  to  be  in  the  nature  of  social 
science  study  while  applied  research  is  the 


Examples  of  some  areas  of  prior  applied 
research  Include: 

Source  Evaluation  and  Selection  (1966) 

Cost  Plus  Award  Fee  Contracting  (1967) 

NASA  Acquisition  Process  (1971) 

Support  Service  Contract  Staffing  (1976) 
Procurement  Workload  Measurement  ( l 976) 

Following  are  some  examples  of  approaches  to 
research  that  we  have  carried  on: 

Undergraduate  work  with  several  universities, 
including  New  Mexico  State,  Stanford,  II. C. 
Davis,  and  University  of  Puget  Sound: 

University  Staff  Persons  (irA)  from  Colorado 
State  and  University  of  Washington;  and 

Through  Grants  and  a  Consortium  Agreement 
such  as  one  with  the  University  of  Santa  Clara 
to  study 

-  The  procurement  cycle  through  simulation 

-  Workload  scheduling 

-  Employee  development  procedures,  and 

-  Influences  and  apparent  Impact  ot  con'ratt 
type  ami  structure. 
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Transit  Ion  Phase:  We  are  currently  involved  In 
several  applied  research  activities  which  util¬ 
ize  computer  technology.  The  primary  programs 
which  have  agency-wide  Impact  include  workload 
system  development  and  analysis;  common  data 
base  regulations;  RFP,  Purchase  Order,  and 
Contract  Writing;  Sources  and  Capabilities  of 
A&E  Firms  and  Minority  Business  Firms;  and  a 
special  program  which  "key  words"  our  regula¬ 
tions  for  case  of  reference. 

Without  anv  sacrifice  to  on-going  proprams,  we 
are  also  developing  a  formal  organization 
structure  to  provide  direction  and  control  for 
our  continuing  program.  We  are  currently 
identifying  persons  within  both  NASA  headquar¬ 
ters  and  field  installations  to  serve  on  an 
acquisition  research  committee.  The  committee 
will  Include  persons  from  both  business  and 
engineering  or  scientific  disciplines.  Me 
plan  to  operate  with  a  chairperson,  plus  five 
to  seven  members. 

The  committee's  primary  duties  will  be  to 
identify  all  related  business  research 
sponsored  by  NASA  and  to  disseminate  its  re¬ 
sults;  maintain  liaison  with  other  agencies  and 
the  private  sector  so  as  to  keep  current  with 
the  efforts  of  others  and  to  inform  them  of 
our  results;  and  to  maintain  an  awareness  of 
the  needs  within  NASA  and  to  use  that  awareness 
as  guidance  toward  areas  which  may  be  benefited 
by  research.  When  an  area  is  identified,  the 
committee  will  develop  a  research  plan.  The 
plan  will  synopslze  the  need,  Identify  the  most 
promising  investigative  group  (in-house,  other 
agency,  university,  or  other  member(o)  of  the 
private  sector);  establish  the  funding  require¬ 
ment;  Identify  the  period  for  performance;  and 
recommend  che  principal  investigator  who  is  to 
manage  the  program.  The  plan  will  be  subject 
to  the  approval  of  the  NASA  Director  of  Pro¬ 
curement  (S.  Evans). 

Future  Phase:  We  expect  to  have  our  committee 
established  and  operating  within  the  next  two 
months.  Our  initial  activity  will  be  directed 
toward  explaining  what  business  research  is  and 
in  developing  an  agency-wide  awareness  of  its 
benefits.  As  we  perform  this  initial  activity, 
we  expect  to  develop  a  more  complete  inventory 
and  identify  additional  research  needs.  We 
will  then  be  in  a  position  to  establish  our 
research  plans  and  contribute  to  the  interface 
process  outlined  previously. 

DOE 

The  DOF.  representative  spoke  on  the  reorganiza¬ 
tion  and  restructuring  necessary  as  the  agency 
evolved  from  the  AEC  to  ERDA  to  DOE;  that  the 
agency's  primary  purpose  was  to  stimulate  new 
developments  in  the  energy  field,  and  that  it 
had  a  range  of  instruments  for  this  purpose, 
6uch  as: 


o  Contracts 
o  Grants 

o  Cooperative  agreements 
o  loans  and  loan  guarantees 

Currently,  DOE's  efforts  are  directed  toward 
simplifying  the  above  processes  and  several  of 
the  on-going  procurement  research  efforts  in 
these  areas  were  discussed,  and  are  summarized 
below: 

AUTOPRF.PS 

The  AUTOPRF.PS  is  currently  an  operational 
prototype  at  the  Space  and  Missile  Systems 
Organization  (SAMSO)  in  Los  Angeles,  for 
programmed  contract  writing,  and  procurement 
tracking  and  procurement  management  information 
(the  la6t  two  features  are  still  being 
developed).  Expanded  development  will  include 
(1)  programming  DOE  procurement  regulations  on 
the  system;  (2)  using  the  AUTOPRF.PS  cathode  ray 
tube  terminals  as  source  data  entry  devices  for 
MIS  data  flowing  to  headquarters;  (3)  direct 
access  to  TWX  and  mallgram  networks;  (4)  com¬ 
munication  to  large  computers  containing 
procurement  data  banks;  and  (S)  Issuance  of 
updated  legulatory  matter  requiring  changes  in 
AUTOPREPS-stored  text.  Two  prototype  organiza¬ 
tions,  to  be  operational  by  February  1979,  are 
planned.  (The  FAI  is  working  with  DOE,  NASA, 
and  the  USAF  on  this  project  as  part  of  a 
larger  automation  project.  It  will  be  dis¬ 
cussed  later  in  this  paper.) 

Vendor  File 

The  multipurpose  vendor  file  is  expected  to 
serve  industrial  relations  outreach  program 
needs;  procurement  operations  needs;  and  as  an 
extensive  data  base  edit  for  our  procurement 
management  Information  systems.  Our  approach 
is  to  build  on  vendor  information  existing  in 
our  Contracts  Information  System  (CIS)  through 
the  mailing  of  computer-generated  letters  and 
attached  questionnaires  (DOE  Vendor  Mailing 
List  form),  keypunching  of  questionnaire  res¬ 
ponses,  and  editing  up  to  a  complete  file  on 
existing  contractors.  New  firms  desiring  to 
be  added  to  che  vendor  file  will  complete  the 
same  questionnaire. 

Major  tasks  include  the  definition  of  data 
requirements,  development  of  a  new  DOE  Vendor 
Mailing  List  form,  and  software  development. 

We  expect  to  be  able  to  relate  potential 
vendor  capabilities  with  potential  agency  needs 
through  use  of  existing  budget  and  reporting 
codes,  and  to  be  able  to  relate  planned  pro¬ 
curements  to  Identified  small  business, 
minority  business,  and  labor  surplus  area 
business  capabilities.  The  multipurpose  vendor 
file  is  expected  to  be  available  In  September 
1978. 

Improved  Procurement  Management  Indicators 
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The  scudv  of  improved  procurement  management 
indicators  is  estimated  to  involve  up  to  one 
nan-vear  of  professional  contractor  effort  over 
a  10-monch  period,  with  final  implementation 
and  test  running  through  September  1979.  l>'e 
intend  to  Initiate  discussions  very  soon  with 
the  logistics  Management  Institute,  or  a 
similar  organization,  toward  drafting  the 
appropriate  agreement.  Generally,  we  believe 
that  procurement  management  indicators  should 
differ  between  management  levels,  with  separate 
indicators  at  the  secretarial,  headquarters 
procurement  and  technical  staff,  and  buying 
activity  top  management  levels. 


DOE  Fee  Curve  Study 


In  addition  to  the  foregoing,  DOE  also  has  a 
fee  curve  sc u;  ;  currently  being  performed  by 
the  logistics  Manag.ement  Institute  (LMI) .  The 
study  objective  is  to  perform  a  study  of  DOE 
declining  fee  policies  and  procedures  to  deter¬ 
mine  if  the  present  maximum  fee  curves  are 
lenllscte  and  adequate  to  accomplish  their 
Intended  purposes. 


The  remaining  agency  representatives  at  the 
council  mooting  briefly  discussed  their 
agencies'  Involvement  In  the  procurement  and 
business  research  area. 


General  Services  Administration 


0n-goln8  efforts,  by  in-house  staff,  Include: 


o  Buying  program  Improvements 
o  Multiple  award  contract  program 
o  Benchmark  system  for  evaluation 
o  Contract  form  simplification 
o  Test  case  on  tailor-made  contract  forms 
o  Annual  money  lease/purchase  of  personal 
property 

o  Marketing  Division  projects 
o  Value  Management  Division  projects 
o  E.TI?  Division  and  ET1P  programs 
o  LCC/OFPP  charter  to  GSA 


Several  other  departments  (Commerce,  HEW. 
Veterans  Administration,  Justice,  HUD,  and 
Transportation)  reported  on  various  on-going 
study  projects  which  are  being  accomplished  on 
an  in-house  basis  with  Tieir  existing  staffs. 


After  the  briefings  an  discussion  on  the 
agency  programs,  Dr.  Bennett  introduced 
Captain  Ron  McDlvltt,  USN,  who  heads  up  the 
research  program  at  the  DSMC  and  acts  as 
Executive  Secretary  for  the  DoD  Acquisition 
Research  Council.  Dr.  Bennett  proposed  that 
Captain  McDlvltt  be  made  a  member  of  the  coun¬ 
cil  to  provide  liaison  with  DoD  procurement/ 
acquisition  research  activities,  and  the 
council  concurred. 


A  proposed  charter,  prepared  by  the  FAI  staff, 
was  t.ien  briefly  reviewed  and  discussed. 

Agonc/  comments  on  the  charter  were  requested 


by  May  1,  1978,  in  order  that  a  revised 
charter  could  be  ready  in  time  for  the  next 
council  meeting  scheduled  for  June  8,  1978. 
The  proposed  charter  is  reproduced  below  In 
order  to  illustrate  the  type  of  organization 
and  functions  envisioned  for  this  group. 


CHARTER  OF  THE 

FEDERAL  ACQUISITION  INSTITUTE 
CIVIL  AGENCY  ACQUISITION  RFCEARCH  COUNCIL 


A.  The  Civil  Agency  Acquisition 
Research  Council  (CAARC)  is  chartered  as  a 
Federal  Acquisition  Institute  (FAI)  "tnter- 
agency  Specialized  Work  Group"  (TSUG),  to  act 
as  a  quasi-operational  arm  ot  tlw  FAI  In  older 
to  plan,  communicate,  coordinate,  un4  sponsor 
acquisition  research  among  the  civil  agency 
members  of  the  FAI. 


B.  The  CAARC,  composed  of  members  from 
all  FAI  civil  agencies,  will  report  to  and 
advise  the  Director,  FAI,  who  also  serves  as 
chairperson  of  the  council. 


II.  MISSION.  The  mission  of  the.  CAARC  Is  to- 


A.  Identify  research  needs  within  and 
across  its  member  agencies  and  to  communicate 
these  needs  to  the  council-at-large  and  the 
FAI. 


B.  Coordinate  and  sponsor  research 
(1)  within  a  single  agency,  (?)  among  sevetal 
agencies,  or  (3)  trhough  the  FAI,  which  will 
act  as  a  program  manager  to  oversee  the 
initiation,  progress,  completion,  and  pilot- 
testing  of  research  projects  as  necessary. 


C.  Develo-,  a  plan  and/or  planning  svs- 
tem  to  accomplish  A  and  B  above.  This  plan  or 
planning  system  will  include  a  proposed  yearly 
budget  for  review  by  the  FAI  Research  Standing 
Subcommittee  and  Budget  Subcommittee,  who  will 
forward  a  proposed  budget  to  the  Direcror. 

FAI,  Co  be  included  as  part  of  the  FAI  re¬ 
search  program  budget. 


III.  COMPOSITION. 


A.  The  CAARC  shall  consist  of  members 
representing  all  FAI  civil  agency  members  and 
the  FAI . 


1.  These  agencies  are: 


a.  Agriculture 

b.  CSC 

c.  Conmerce 


e.  F.Pn 

f.  GSA 

g.  HEW 

h.  HUD 


W&mmgg. 


dOd 


i.  Interior 

J.  Juctice 

k.  Labor 

l.  NASA 

m.  NSF 

n.  SBA 

o.  State 

p.  Transportation 

q.  Treasury 

r.  VA 

tf.  FAI 

t.  OFPP 

u.  DcD  (DSMC) 

The  term  for  a  member  of  the 
council  6ha31  be  at  the  discretion  of  his 
agency. 

B.  The  chairperson  of  the  CAARC  shall 
be  the  Director,  FAI.  As  chairperson,  the 
member  will  be  a  nonvoting  member  of  the 
council. 

C.  The  Assistant  Director  for  Research, 
FAI,  shall  be  the  executive  secretary  of  the 
council. 

D.  The  vice-chairperson  and  other 
positions  shall  be  selected  by  a  simple 
majority  of  the  council  membership. 

IV.  AGENCY  SUPPORT 

A.  The  Director,  FAI,  provides  technical 
or  administrative  assistance  needed  by  the 
council,  including  WAE  part-time  employees  as 
deemed  necessary. 

B.  Expenses  encountered  by  council  mem¬ 
bers  ohall  be  the  responsibility  of  the  parent 
agencies. 

V.  DESCRIPTION  OF  DUTIES 

A.  The  CAARC  advises  the  Director,  FAI, 
on  the  overall  aspects  of  acquisition  research 
in  accordance  with  its  mission. 

B.  The  council  responds  to  requests  or 
assignments  from  the  Director,  FAI  (as  chair¬ 
person  of  the  council),  and  from  member 
agencies. 

C.  Procedures  for  presenting  the  advice, 
findings,  and  recommendations  of  the  council 
should  be  flexible  yet  consistent  with  the 
group  s  purpose. 

D.  The  council  chairperson  shall  submit 
each  report  or  plan  through  the  Research 
Standing  Subcommittee  and  Budget  Committee  to 
the  IWC. 

The  number  and  frequency  of  the  meetings  will 
be  determined  by  the  council;  however,  during 
the  organizational  phase,  quarterly  meetings 
are  being  scheduled. 


The  charter,  after  -.gency  inputs,  ulU  be 
approved  by  the  coun  11,  the  FAI  IWC,  and 
Dr.  Bennett  as  the  Di.wtor,  FAI. 

Since  thn  Civil  Agency  Acquisition  Research 
Council  will  act  primarily  as  a  communication 
and  coordinating  body,  rt  wil  be  up  to  thu  FAI 
to  provide  overall  thrust  and  momentum  for 
specific  research  projects.  Two  on-going 
projects  will  serve  to  demonstrate  the  coordina¬ 
tion  role  that  the  FAI  will  play  in  relation  to 
the  council. 

One  of  the  firat  FAI  research  proje.cts  to 
demonstrate  the  benefits  of  overall  FAI 
research  management  occurred  during  its  first 
month  of  operation  In  September  1977.  Prior  to 
the  operational  phase  of  the  FAI,  the  OFPP  had 
completed  a  Federal  Government-wide  survey  of 
"coat  estimating"  techniques  enplovcd  by  the 
various  agencies  ur.d,  after  the  formation  of 
the  FAI,  OFPP  requested  that  it  manage  a 
contract  study  effort  in  thi6  area.  During  a 
review  of  other  proposed  research  projects,  it 
was  discovered  that  the  APRO  was  about  to  under¬ 
take  a  similar  in-house  Army  study  cn  cost 
estimating  techniques.  Discussions  were  then 
held  with  the  Logistics  Management  Institute 
(LHI) ,  the  support  contractor  for  the  OFPP 
study,  and  with  Dr.  Paul  Arvis,  Director,  APRO. 
Ab  a  result,  instead  of  two  isolated  studies, 
both  efforts  were  joined  into  one  project 
benefiting  from  the  combined  funding  of  OFPP 
and  APRO.  The  study  and  agencies  to  be  visited 
were  divided  between  LMI  and  APRO,  with  APP-0 
as  the  project  manager,  responsible  for  pre¬ 
paration  of  the  final  report  with  input  from 
LMI.  FAI  is  acting  as  the  overall  manager  of 
t-ht  study  for  the  OFPP,  and  the  project  has 
benefited  from  the  synergistic  effect  of  com¬ 
bined  funding  snd  the  merging  of  two  similar 
projects  into  a  larger  and  more  comprehensive 
effort. 

The  "Automation"  ISWG  being  formed  by  the  FAI 
is  another  project  that  is  setting  o  pattern 
for  future  efforts.  It  evolved  from  the  three 
DOE  automation  projects  previously  discussed 
(i.e.,  ADTOFREPS,  vendor  file,  and  improved 
management  indicators).  The  DOE,  in  February 
1978,  set  up  a  cooperative  effort  with  NASA  and 
the  Air  Force  to  install  and  pilot-test  these 
projects.  Upon  learning  of  them,  the  FAI  asked 
the  DOE  to  take  a  lead  agency  role  and  chair 
an  "Automation"  ISWG,  which  was  accepted  by  DOE 
in  a  letter  to  Dr.  Bennett  dated  April  7,  1978. 
Under  this  srrangement,  the  ISWG  will  oversee 
the  pilot  test  and,  through  a  part-time 
employee  supplied  by  the  FAI,  conduct  a 
government-wide  survey  on  automation  currently 
employed  in  the  procurement  and  acquisition 
process.  The  ISWG  reports  on  these  efforts 
will  then  be  furnished  to  ail  FAI  member 
agencies,  who  can  se  this  Information  to 
assist  them  in  the*,  own  automation  projects. 

The  CAARC  was  very  receptive  to  this  project 
since  several  member  agencies  were  planning  to 


develop  or  look  into  automation  of  their  pro-  several  interpretations,  some  misleading, 

cesses.  the  term  "procurement  research."  The  guide 

will  build  on  several  long-range  projects  that 

Civil  Agency  User  Needs  Study  have  been  in  progress  for  several  years  betvoi  ■ 

the  AFBRMC  and  the  Air  Force  Institute  of 
The  FAI  is  also  planning  a  direct  program  of  Technology.  These  concerted  efforts  have 

support  to  the  civil  agencies  by  undertaking  a  resulted  in  several  excellent  papers  and  two 

one-year  use.-  needs  study.  Dr.  Richard  student  theses  efforts  in  defining  procurement 

lorette,  ns  of  April  17,  is  on  an  intergovern-  research  (7:90-99),  construction  of  sequential 

mental  transfer  from  the  University  of  -esearch  needs  (3:2-A),  and  a  taxonomy  of 

Southern  California  for  a  period  of  one  year  research  for  procurement  (4:51). 

and  will  have  ns  his  primary  responsibility 

the  accomplishment  of  this  study.  On  a  day-to-day  basis,  the  guide  can  be  used  to 

, rovide  a  basis  of  cosmunication  between  user 
Using  th^  members  of  the  CAARC  as  starting  and  researcher  to  define  the  need  or  problem 

points,  Dr.  Lorette  will  visit  each  agency  to  ana  to  uncertain  the  level  effort  necessary 

discuss  their  procurement  and  acquisition  to  study  and/or  research  the  area.  One 

problems.  This  effort  will  include  recommends-  important  aspect  thai  the  ►;  de  wi  ‘  1  illustrate 

cions  for  r>,  rail  planning  system,  which  is  that  a  formal  organization  is  of  -  a  nrere- 

will  include  e  framework  of  contract  adminis-  qulsite  to  accomplishing  procurement  t-  .arch 

tration  research  necds/projecta  and  a  basis  since  the  levels  of  effort  can  range  from  a 

for  assigning  priorities,  allocations,  and  one-man  staff  study  to  ad  hoc  groups,  a 

resources  to  do  the  research  work.  master's  thesis,  contract  research,  tc  a 

doctoral  dissertation  (8:27).  This  type  of 

There  are  also  several  on-soing  and  proposed  information  will  be  particularly  valuable  in 

FAI  research  projects  on  developing  the  "tools  stressing  the  user  need  aspect,  of  procurement 

of  research"  that  will  be  of  benefit  to  the  research  ana  the  need  for  collecting  many 

procurement  community.  In  general,  and  will  be  agency  in-house  or  contracted  procurement  or 

of  particular  value  in  working  with  the  civil  business  research  efforts, 

agencies.  Among  these  tools  of  research  pro¬ 
jects  ore  the  following:  The  FAI  Library 


Federal  Research 


This  project  has  been  undertaken  for  the  FAI 
by  the  Army  Procurement  Research  Office  under 
the  direction  of  Dr.  Paul  Arviu.  The  initial 
effort  of  this  project  will  be  to  update  and 
expand  two  guides  that  the  APRO  prepares  for 
DoD  use  on  a  government-wide  basis.  These  two 
documents  arc:  (1)  "A  Guide  to  Source  of 
Information  for  Procurement  Research,"  and 
(2)  "Reeources  for  Performing  Procurement 
Research."  The  expansion  and  consolidation  of 
these  documents  will  be  of  obvious  benefit  to 
the  operations!  user  and  researcher  in  the 
civil  agencies  by  providing  them  with  informa¬ 
tion  on  research  resources  and  existing 
information  centers,  data  banks,  and  published 
materials. 


Procurement/Acqulaltlon  Research  Policy 
Planning  Guide 


This  project  is  also  a  Jointly  sponsored  effort 
undertaken  for  the  FAI  by  LTC  Daniel  Strayer, 
Executive  Director  of  the  Air  Fcrce  Business 
Research  Management  Center.  The  purpose  of 


Another  valuable  FAI  tool  of  research  is  the 
FAI  library.  The  library  is  unique  in  that 
its  collection  focuses  on  procurement  books , 
periodicals,  resear ..h  worse,  an1,  unpublished 
papers  generally  not  found  in  ot  >er  libiarles. 
As  the  FAI  end  civil  ngency  prog-ams  evolve, 
the  library’s  mat. -rials  and  servicer  will  play 
an  increasingly  valuable  role  ns  an  information 
renter,  clearinghouse,  and  reference  s?i>.  ice 
for  both  users  and  reseorchers. 


University  Research  Consortium 


The  FAI  is  also  planning  to  sponsor  t 
university  research  consortium  project,  ’n  its 
first  pilose,  a  consortium  would  focus  on  cext- 
b<ok  and  faculty  development,  then  evolve  to  a 
program  of  universit'  research.  Currently,  the 
FAI  has  three  activities  in  this  area  unde/wav: 
tracking  a  Georgetown  University  study  on 
Federal  management  research  sponsored  by  the 
Civil  Service  Commission,  working  with  Aoori.nn 
University  •■o  get  HUD  grant*  assistance  for 
Joint  American  University /FAI  degree  progrnn6. 
and  assisting  Harvard  University  to  obtain  a 
National  institute  of  Education  grant  to  (orm 


this  program  is  to  prepare  a  guide  which 
defines  procurement  and  business  research,  sets 
forth  Pederol  roles  and  responsibilit'es,  out¬ 
lines  various  research  processes,  identifies 
research  methods,  and  will  provide  other 
guidelines  for  accomplishing  procurement /acqui¬ 
sition  and  business  research.  The  need  for 
this  g  *ldc  has  heccmc  readily  apparent  when 
discussing  procurement  leoesrch  with  many  of 
the  ci-tl  agency  repreuentntlvcs  who  have 


the  lend  consortium  effort.  One  of  the  primary 
long-range  goals  of  this  program  will  be  to 
provide  a  source  of  procuremciit/acquisi  tior  nrd 
assistance  research  for  the  civil  agencies. 

Future  ProRrami 

As  the  efforts  of  the  FAI  and  the  CAARC  evolve, 
wc  con  expect  acre  Joint  agency  research 
projects  aid  p.rograms.  In  the  two  ml!  agonev 
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council  meetings  thus  far,  there  has  already 
been  a  strong  indication  of  a  commonality  of 
problems  and  needs  and  a  willingness  to 
communicate  and/or  cooperate  on  various  on¬ 
going  and  proposed  research  efforts.  In  order 
to  work  towaid  the  goals  discussed  in  this 
paper,  the  FAI  will  support  the  CAARC  with  a 
user  needs  survey  and  develop  recommendations 
for  a  planning  system.  These  efforts  will  take 
into  account  the  personnel  shortage  that  pre¬ 
cludes  formal  research  organization  and  will 
concentrate  on  developing  a  program  that  will 
make  maximum  use  of  existing  in-house  capabil¬ 
ities,  contracting  out  efforts  to  assist 
management  ir.  the  procurement/acquisition 
research  area,  and  the  use  of  the  proposed 
university  consortium. 

During  the  next  several  years,  ns  we  move  toward 
a  single  government-wide  acquisition  statute 
and  acquisition  regulation,  the  commonality  of 
problems  and  research  needs  will  serve  to  bring 
all  Federal  agencies,  civil  and  DoD,  into  a 
closer  need  for  cooperation  and  Jointly 
sponsored  research  programs  chat  may  eventually 
be  merged  into  one  Federal  acquisition  research 
planning  system. 
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DEVELOPING  A  PROCUREMENT  EXPERIMENTATION  SYSTEM 


Victor  Berlin,  National  Bureau  of  Standards,  U.S.  Department  of  Cownerce 


To  discuss  the  use  ot  administrative  experi¬ 
mentation  in  testing  changes  in  acquisition 
and  procurement  procedures  and  policy.  Tills 
p mei  will  serve  as  a  forum  for  describing 
past  and  current  experiments  as  well  as  for 
identifying  opportunities  for  new  experiments. 


INTRODUCTION 


Government  procurement  agencies  and  units  are 
faced  with  a  number  of  continuing  issues. 

They  include,  but  are  not  restricted  to,  the 
following: 


What  products  or  services  should  we  buy? 


How  should  we  buy  those  products  or 
services? 


a  How  should  chose  products  or  services  he 
stored,  delivered,  etc..’ 


»  How  can  l  make  an  award  to  the  best  bidder’’ 


How  can  I  effectively  spend  our  budget? 


because  of  changing  user  requirements,  changing 
technologies,  changing  market  structures  and 
the  like,  tnose  issues  must  be  regularly  re¬ 
visited. 


Tne  Experimental  Technology  Incentives  Program, 
National  bureau  of  Standards  is  interested  in 
how  government  agencies  answer  these  questions. 
In  particular,  ETIP  examines  how  the  answers 
adopted  by  government  agencies  Impact  the  com¬ 
mercial  sector.  KTIP  attempts  ti  identify 
those  jr.swers  or  solutions  to  the  above  ques¬ 
tions  which  seem  to  act  as  incentives  for 
technological  change  in  the  private  sector  (l). 


ETIP  carries  out  this  examination  by  working 
with  other  government  pro  irement  agencies  and 
departments  in  order  to  ist  changes  in  pro¬ 
curement  policies  and  pr.o  tiers  [2J.  These 
tests,  it  believes,  will  provide  answers  to 
the  above  questions.  However,  as  markets  users 
and  technologies  change,  periodically  new 
answers  and  solutions  have  to  be  tested. 


In  order  to  most  efficiently  conduct  such  perio¬ 
dic  testing  of  procurement  methods  with  other 
agencies,  ETIP  Is  developing  what  it  terms 
"procurement  experimentation  systems"  13). 

Such  a  system  specifies  In  great  detail  pro¬ 
cedures  for  defining  procurement  issues,  t»- 
collect. ng  background  data  In  agencies  and 
Indus'. i  ,  f  r  designing  tests  of  specific 


changes  in  procurement  policies  and  practice, 
and  for  analyzing  the  effects  of  such  changes 
on  the  agencies  themselves  and  on  the  private 
sector  f 3 j .  What  follows  is  a  brief  deserl;  - 
Cion  of  one  approach  used  bv  ETIP  to  devtuj. 
such  i  system. 


WHAT  IS  A  PROCUREMENT  EXPERIMENTATION  SYSTEM’’ 


A  procurement  experimentation  system  can  bes: 
be  described  by  outlining  the  kind0  of 
services  it  can  provide  ro  pote.t’  i  I  govern¬ 
ment  ard  Industry  users.  These  service-  are 
broken  down  into  four  categories: 


•  Identifying  opportunities  for  procurement 
tests  or  chanpcs  for  government  agencies. 


Determining  the  feasibility  of  such  tests. 


•  Designing  the  tests. 


•  Assessing  the  effect  of  the  tests  on  the 
agencies  conducting  chcr..  and  the  Industrie 
affected  f-'t). 


IDENTIFYING  OPPORTUNITIES 


An  opportunity  for  a  procurement  :.“t  o: 
experiment  exists  when  individual  within  a 
governme-t  agency  attempt  to  resolve  one  ot 
the  five  issues  ourltned  at  the  leginning  of 
this  paper  and  when  they  ar-  Ir'erssted  in 
carefully  testing  potential  solutions.  T’«e 
"identification  procedures"  of  the  system  t  e 
collect  data  to  help  them  determine: 


•  What  new  products  or  services  they  ought  t. 
he  buying? 


What  old  products  or  services  they  ought  : 
stop  buying? 


•  What  products  or  services  might  better  be 
bought  lr.  a  different  way7 


Such  Identification  procedures  ran  be  used  to 
identify  newly  emerging  technologies  ir.  the 
private  sector  which  might  be  acquired.  They 
als  .  .-an  identify  products  for  whi'h  porch. in 
volume  has  decreased — indicating  per1 a,  a 
shift  in  user  recu I rene- ' ° 


If  after  receiving  the  results  of  :  ‘•a’l- 

'lcation  services  individuals  within  pr.iure- 
moni  ngcneles  wish  to  contemplate  some 
procurement  change,  they  can  .  le  t  :  >  1 

a  feasibility  inn  I  vs  is. 


■  -  -S.,  — 
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PROCURE.-CENT  EXPERIMENT  FEASIBILITY 


The  feasibility  analysis  can  be  describe:!  In 
six  stages: 


Determining  how  a  particular  agency  and 
selecced  Industry  operates. 


Determining  information  needs  and  rigor  re¬ 
quirements  of  procurement  officials  malting 
the  test  (and  other  interested  parties). 


Determining  what  procurement  changes  are 
feasible. 


Determining  what  test  strategies  are  feasi¬ 
ble. 


•  Determining  what  data  can  be  collected  and 
what  likely  Impacts  will  cccur  in  the  agency 
and  the  industry. 


»  Based  on  the  above,  determine  what  informa¬ 
tion  needs  and  rigor  requirements  can 
pocencially  be  satisfied  by  the  experiment. 


A.  major  objective  of  a  procurement  experimenta¬ 
tion  system  is  to  support  the  information  needs 
of  individuals  making  procurement  changes. 
Hence,  it  is  important  to  carefully  determine 
what  these  needs  are.  Does  the  procuring 
official  wish  to  determine  industry  attitudes 
towards  his  operation?  Does  he  wish  to  deter¬ 
mine  the  cost  of  the  procurement  method  tested? 
Does  he  require  a  controlled  test,  or  would  a 
"quick  and  dirty"  study  suffice? 


Toe  next  step  in  this  snalysis  is  determining 
what  procurement  methods  can  feasibly  be 
tested.  Resource,  legal,  and  organizational 
constraints  must  be  considered — for  example, 
if  a  new  method  requires  special  testing 
facilities  which  are  not  available,  then  the 
method  Is  not  feasible. 


Once  ET1P  has  determined  what  is  needed  and 
what  is  feasible,  it  examines  to  determine  if 
an  intersecting  of  these  two  sets  exist.  Only 
that  data  analysis  and  findings  which  both  will 
satisfy  Interested  parties  and  can  feasibly  be 
provided  become  the  focus  of  the  procurement 
test.  They  become  the  focus  of  the  design 
stage  which  follows. 


DESIGN  PROCEDURES 


During  che  design  stage  the  cooperating  pro¬ 
curement  agency  and  ETIP  specify  in  detail: 


How  the  procurement  change  is  to  be  imple¬ 
mented  in  order  to  provide  for  the  required 
level  of  rigor. 


What  potential  interfering  factors  are  to  be 
controlled  for  or  accounted  for. 


What  data  is  to  be  collected. 


How  the  data  is  to  be  collected,  stored, 
analyzed  and  processed. 


The  precise  nature  of  che  anticipated  find¬ 
ings,  hew  they  are  no  be  used  and  by  whom. 


Who  is  to  collect  the  data  (Agency,  ETIP, 
or  Industry). 


Schedule  of  events — both  procurement  and 
data  collection  and  analysis. 


Budget . 


In  short,  the  design  process  describes  in 
great  detail  the  tasks  to  be  carried  out 
during  the  test  of  the  selected  procurement 
change. 


ASSESSING  THE  EFFECTS 


Three  kinds  of  effects  are  of  interest  ir.  a 
procurement  experiment: 


The  effect  of  the  change  on  the  agency. 


•  The  effect  of  the  change  on  industry. 


The  effect  of  the  feedback  provided  by  the 
procurement  experiment  on  agency  decision¬ 
making,  strategies  and  procedures. 


ETIP  or  a  contractor  observe  how  the  change  is 
implemented  in  an  agency,  how  the  agency  la 
perceived  by  industry  and  any  changes  that 
occur  in  either  place.  Ideally,  this  process 
of  observing  the  change  begins  prior  to  the 
change  itself.  This  enables  the  collection 
of  base-line  data.  Such  data,  In  addition, 
permit  mid-course  corrections  as  che  procure¬ 
ment  is  being  implemented. 


SYSTEM  DEVELOPMENT 


To  be  more  effective  In  the  conduct  of  Its 
procurement  experiments,  using  the  process 
described  above,  ETIP  has  concluded  that  a 
systematic  approach  is  required- (3) .  Such 
systems  are  not  typical  objectives  of 
federal  government  policy  research  programs 
(5).  In  most  cases,  a  policy  research  pro¬ 
gram  asks  a  contractor  to  conduct  a  particular 
study  or  evaluation.  In  ETIP's  case  it  is 
asking  a  contractor  co  conduct  specific 
studies  and  evaluations,  but  also  to  document 
how  these  tasks  are  cerried  out. 
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Hi  I u  documentation  will  enable  ETIP  to  curry 
out  Homo  of  these  tasks  ln-hou»s.  It  will 
.tl’iu  enable  KT1I’  to  operate  mors  effectively 
In  the  lollowlnij  vayu  ( 6 ]  i 

•  Fueler  roepone*  time  Tor  Initiating  n«w 
experiments. 

•  ii>or«n*ed  ability  to  draw  comparison  across 
iiotH  of  experiments  bacausc  of  comparabla 
metbidn  uaed. 

•  K.duced  coat  of  evaluation  becauaa  designs 
\i<>  not  bavo  to  bu  developed  anew  each  tlmo, 

•  Increased  certainty  in  predicting  time  coat 
•mi'  per:  annul  requirements  of  a  particular 

e.:pc  r  Intent# 

e  Easier  to  communicate  with  agencies  and  in¬ 
dustry  what  la  Involved  in  a  procurement 
experiment  and  what  they  can  get  out  of  It 
because  an  explicit  #*L  of  procedures 
ex  lot  a  na  well  air  an  aueoclolod  set  of 
sample  reports  and  products. 

a  Till-  ability  to  purchase  Information  in 
wi!  11 -defined  segments  before  committing  to 
full-oKHle  experimentation. 

To  carrv  out  Hystem  davalopmenti  ETIP  with  the 
nesltitance  of  private  cont rectors  works 
through  10  stepn. 

Etep  1.  Decide  who  the  clients  of  the  system 
*'  are  to  be.  For  ETIP  and  for  the  ETIP  procure¬ 

ment  area  these  clients  would  be  individuals 
making  changes  in  procurement  practices  or 
j,  procurement  policies  within  procurement 

|  ugenc lea ,  within  procurement  department*  or 

within  011)1  or  the  Congree*. 

Stop  2.  Decide  or  determine  whet  the  informa¬ 
tion  needs  or  variables  of  concern  of  these 
clients  c” c. 

;!  Step  1,  Identify  existing  data  banks  in  the 

I;  agencies  In  lha  private  sector  which  colluct 

|i  data  In  a  way  thut  would  satisfy  clients'  in¬ 

formation  needs.  Specify  the  procedures  for 
accessing,  collecting  together,  analysing,  and 
reporting  this  data. 

Step  4.  For  those  Information  needs  for  which 
appropriate  data  banks  do  not  exist,  Identify 
and  locate  existing  data  coilsetion  and 
1  unalysis  procedures,  research  designs  and  the 

associated  products  they  were  used  t o  develop 
that  could  be  Used  to  satisfy  the  residual  set 
nr  infotmsi Inn  nesde,  Theae  data  collect  Inn 
and  eiis  lye  Is  pi  uuedures  and  research  designs 
are  located  within  orgenltet lone  who  have 
conducted  reeearch  on  the  same  or  related 
t  Information  usade  and  have  produced  producte 

that  wsru  uned  to  setlefy  Inlormatlon  needa. 
These  i.  'mpla  reports  on  products  can  he  need 


to  confirm  the  extent  to  which  the  clients 
would  be  satisfied  if  they  received  a  produ  i 
nlmllar  to  It. 

IUep  i.  Develop  resear  h  design*  and  data 
collection  end  analysis  procedures  for  those 
Information  needs  or  vurlables  not  covered  by 
uxJstlng  data  hanks  nr  oxlstlng  designs  and 
prnc  nduroii. 

Step  6.  Adopt  and/or  develop  input,  output, 
processing  and  storage  procedures  as  needed 
to  natlsfv  the  basic  client*  and  Information 
need  it. 

Step  7,  'Jet  thu  agencies  or  other  relevant 
parties  to  augment  their  existing  data  bank* 
to  collect  the  data  that  la  needed  but  In 
not  being  collected  already. 

Step  8.  Assemble  the  system, 

:Jtvp  '),  Test  thu  system  ill  thu  context  o!  > 
some  specific  experiment. 

Stop  10.  Document  system. 

To  eerry  out  thcee  steps  ETIP,  Its  contrac¬ 
tors,  and  the  cooperating  agencies  must  firm 
identify,  based  on  their  background  data 
colltctlon,  who  the  clients  of  the  system  arc 
to  bo.  This  is  s  list  agreed  upon  with  ETIP 
and  it  serve*  as  '  ne  focus  for  the  remnlnlng 
tacks. 

Once  ths  clients  hsve  been  identified,  their 
specific  information  need*  have  to  hu  ditcr- 
mined.  What  do  they  need  to  know  in  order  to 
alter  either  s  procurement  policy  or  practice 
that  they  have  control  over!  ETIP  docs  not 
always  have  to  do  epcclfic  experiments  in 
order  to  determine  this.  Instead,  ETIP  can 
simply  present  them  with  fscslmlloe  of  actual 
products  produced  by  the  existing  data  hanks 
tu  determine  if  feedback  of  that  sort  would 
enable  them  to  make  decisions  about  changes 
In  procurement  pructirns  end  policies. 

Nuxt  ETIP,  other  agencies  and/or  contractor* 
identify  tlie  eet  of  dale  hank*  or  dstn 
collection  and  analysis  systems  already  in 
existence  within  government  agencies  and  tho 
private  sector  collecting  dare  either  clearly 
or  potentially  of  interest  to  this  set  ot 
clients.  The  nature  of  these  data  hanks, 
what  they  produce,  the  Instruments  they  use, 
how  tho  data  is  stored,  etc,,  should  be  com¬ 
piled.  This  is  further  background  Informa¬ 
tion.  In  addition,  the  sample  products  th.it 
(hone  lu format  Inn  xvitcsi  produce  should 
i  *  «n  file.  Till*  Inventory  of  data  l>ank.«  and 
wh.it  Is  produced  hy  them,  how  it's  pro, In.  ..I, 
is  the  first  plere  of  the  ■  -v.: 1  ii.it  Ion  ivstom. 

if  the  data  bank*  do  not  suffice,  limn  nt'ier 
kinds  of  research  designs  and  date  col  leer  Ion 


410 


Best  Available  Copy 


s^F=4V".- 


"#»*'"!P5^ 


and  analysis  procedures  have  to  be  identified. 
ET1P  ciien  looks  for  other  studies,  oxper Incuts 
that  have  been  done  by  other  organizations  and 
contractois  which  have  produced  reports  rele¬ 
vant  to  the  Information  needs  not  covered  by 
existing  data  banks.  Hie  sample  reports,  the 
data  collection  procedures,  dat-  analysis  pro¬ 
cedures  and  research  designs  used  to  produce 
those  reports  should  be  brought  together  and 
put  on  file  and  their  appropriateness  tested 
by  presentation  to  the  specific  clients.  In 
other  words,  if  a  procurement  ofiieial  needs 
a  certain  kind  of  variable  measured  and  an 
existing  data  bank  vlchin  FSS  or  within  DOC  or 
the  private  sector  does  not  provide  that 
information,  then  a  report  which  has  been  pro¬ 
vided  in  the  past  by  e.g.,  NSF  or  some  other 
group  has  co  be  presented  to  the  interested 
procurement  official.  If  he  likes  the  report, 
then  the  procedures  used  to  develop  that 
report  will  be  used  in  an  experiment  that  he 
is  conducting  at  sometime  in  the  future. 

Now,  if  neither  a  data  bank  nor  an  existing 
data  collection  analysis  procedure  exists, 
then  ETIP  or  its  contractors  will  have  to 
develop  the  procedure,  in  most  cases,  it  is 
likely  that  many  of  the  clients’  information 
needs  can  be  satisfied  by  some  existing  or 
some  modification  of  some  existing  study, 
report,  or  procedure  used  to  develop  those 
reports. 

In  sum,  once  the  clients  have  been  identified, 
their  information  needs  determined,  and  the 
combination  of  existing  data  banks  and  exist¬ 
ing  data  collection  and  analysis  procedures 
that  would  satisfy  those  information  needs 
have  been  brought  together,  and  once  all  re¬ 
designs  or  new  design  efforts  are  completed, 
we’ll  then  have  what  ETIP  calls  a  prototype 
system.  ETIP  then  has  to  test  the  system  on 
an  experiment  with  one  or  more  of  these 
clients.  Procedures  will  be  picked  out  of 
this  filing  cabinet  and  used  to  conduct  that 
experiment. 

The  next  phase  in  system  development  is  the 
test  phase.  The  set  of  procedures  developed 
must  first  be  tested  by  individuals  other  than 
the  original  developers.  ETIP  is  having  con¬ 
tractors  form  a  new  group  which  can  operate 
and  test  the  system  apart  from  the  original 
developers.  Eventually,  ETIP  would  like  to 
test  the  systen  in  a  government  agency. 

These  two  tesl3  ensure  that  contractors  will 
leave  with  ETIP  and  other  interested  agencies 
a  capability  for  systtmatically  carrying  out 
and  describing  the  effects  of  procurement 
changes  on  industry. 


SUMMARY 


ETIP  has  concluded  that  the  effective  conduct 
of  procurement  experiments  requires  a  syste¬ 
matic  approach.  A  brief  description  of  a 
procurement  experimentation  and  a  ten-step 
process  for  developing  one  has  been  presented. 
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HYPOTHESIS  ANO  CLUSTERS  IN  NAVY'S  ACQUISITION  RESEARCH 


(A  contribution  toward  the  problem  of  research  methodology) 


Dr.  F.  A.  P.  Frisch* 


The  present  paper  tries  t"  sddress  problems 
»nber®nt  in  the  development  of  a  coherent 
plan  i"  -r  research  acquisition.  The  problems 
are  ep*stecjr.L'gi«  al  and  similar  in  nature  to 
problems  ■>*  n  t .  :  .«e  sciences  which  are 

based  on  an  axiom.*. ii  or  philosophical  foun¬ 
dation  where  right  and  wrong  are  determined 
by  the  acceptance  of  some  initial  propor¬ 
tions  and  where  no  quant  1  tat ive  solution  Is 
possible  on  soiely  objective  basis.  This  of 
course  does  not  preclude  that  specific  re¬ 
search  topics  are  exclusive  quantitative 
orobleos.  However,  even  the  solution  of  all 
quantitative  p rob  terns  -  if  such  were 
possible  -  could  not  solve  the  puzzle  of 
acquisition.  Furthermore,  there  arc  too 
many  measurable  problems  to  ever  be  solved. 
Therefore,  one  hi:  ?.>  start  with  a  goal  and 
go  from  the  goal  backward  toward  those  prob¬ 
lems  which  selectively  support  Che  goal  and 
neglect  all  other  topics.  The  goals  do  not 
have  to  be  too  esoteric  and  some  are  sug¬ 
gest  ec  tn  the  form  of  a  -e search  hypothesis. 

Hie  paper  itself  docs  not  intend  to  present 
a  finalized  research  plan.  It  only  shows  how 
such  research  plans  can  be  developed  and  how 
relative  consistency  of  research  topics  can 
V  ach  lov'd 


I.  TOWARD  A  PHILOSOPHY  IN  ACQUISITION 
RESEARCH 

Wc  scientist**  have  brainwashed  our  less 
scientific  contemporaries  into  an  unshakable 
belief  in  the  power  of  our  wisdom  nnd  the 
power  of  research*  that  nothing  is  beyond 
solution  if  wc  have  just  ough  money  and 

manpower  to  research  i*  and  down.  We 

have  given  up  the  naive  notion  about  the 


apocalyptic  riders  as  God-sent  punishment 
whioh  we  have  to  endure  in  humility,  in 
short,  we  got  awfully  arrogant.  This  arro¬ 
gance  may  be  halfway  justified  as  long  as  we 
devote  ouis^’v^i  to  the  so-called  hard 
sciences  where  w«  can  measure  and  wcxgti  t*»e 
inputs  and  outputs  of  our  1.  Tin 

justification  for  arrogance,  how.-v,. ;  .  <  va pi¬ 
rates  as  soon  as  we  shift  our  cndcav* :  .  ' 
what  we  like  to  call  in  colloquial  t**ras  the 
soft  sciences;  acquisition  research  is  at 
least  in  part  such  a  point  in  case. 

Let's  think  about  it  this  way;  the  process 
of  acquisition  takes  place  in  a  legal 
(political)  environment,  deals  dominantly 
with  products  of  engineering  and  is  evalu¬ 
ated  in  terms  of  economy.  Hence,  acquisition 
research  must  be  an  interdisciplinary  acti¬ 
vity  which  1  like  to  describe  with  my  pet 
acronym  as  a  subject  of  LEGENOMY .  meaning 
the  ubiquitious  interaction  of  leg-a 1  and 
en-gineering  aspe-ts  with  elements  of 
econ-omy .  Two  of  chose  disciplines  -  law 
and  economy  -  belong  in  the  doraai*:  of  soft 
science,  where  everything  is  right  as  long 
as  it  is  consistent  with  the  underlying 
axioms  and  by  definition  wrong  if  i» 
contradicts  our  wel tanschauung. 

I  would  like  to  rephrase  the  last  sentence 
and  say  that  law  (also  encompassing  politics) 
and  economy  are  DECISION  SCIENCES  (and  not 
MF.ASUREMDiT  SCIENCES  like  engineering*.  A 
decision  science  shall  be  defined  as  any 
science  where  the  process  and/or  the  resul' 
of  research  has  no  unique  solution  without 
accepting  a  priori  a  subjective  decision 
process  based  upon  subjective  axioeatics  or 
philosophy  or  value  judgement.  Specifically, 
any  acquisition  process  takes  place  in  the 
penumbra  between  decision  and  measurement 
sciences  -  and  here  lies  the  problem  ard  the 
inherent  contradiction  for  planner  of 


\f  This  paper  represents  the  personal  opinion  of  the  author  and  not  r.r  .  1  *  t  Meet  *»nv 

official  opinion  of  the  Navy  or  any  other  department  or  government  agency  or  the  on  ^ 

the  author's  present  nnd  past  associates. 
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acquisition  research:  how  to  develop  a 
logical  research  plan  which  gives  objective 
answers  to  subjective  problems?  How  can  we 
learn  to  live  with  this  epistomological 
impossibility  and  still  produce  a  useful 
result,  where  useful  is  defined  in  plebean 
terms  as  any  knowledge  which  gives  us  a 
bigger  bang  for  our  buck? 

This  is  the  problem  of  acquisition  research 
in  a  nucsnell.  We  have  agreed  we  need  it, 
we  have  agreed  that  we  should  do  better  and 
more  in  our  acquisition  research.  But  this 
is  also  the  end  of  our  concensus.  Just  look 
at  the  different  contributions  to  acquisi¬ 
tion  research  made  over  the  last  few  years: 
everything  is  represented  from  contributions 
in  graph  theory  barely  understandable  to  a 
few  fel low-machematicians  up  to  incentive 
labor  studies  made  by  our  friends  in  the 
social  science  departments.  No  question, 
all  of  those  contributions  are  related  some¬ 
how  to  acquisition.  However,  they  arc  dis¬ 
joined.  We  cannot  recognize  how  they  hang 
together,  what  the  practical  value  of  each 
contribution  is  and  how  the  different  conti i- 
butions  can  be  utilized.  Such  uncertainties 
and  disjoined  research  activities  do  not 
exist  for  example,  in  the  research  plan  for 
the  moon  project-  Here  it  is  so  easy  to 
develop  the  research  plan  for  a  missile 
which  should  go  to  the  moon.  Accepted,  it 
is  a  very  difficult  and  immensely  complicated 
task,  but  there  is  nothing  complex  about  it 
because  only  one  single  objective  exists; 
namely,  to  shoot  a  missile  with  a  desired 
payload  from  point  A  to  point  B.  The  only 
philosophical  and  hence  true  decision  to  be 
made  is  "to  do  it"  -  everything  else  is  then 
a  fill-in  job.  But  to  go  to  the  moon  is  not 
only  a  single  (and  therfore,  not  complex) 
objective,  it  is  also  a  non-ambiguous 
objective.  The  pursuance  of  this  single 
objective  tells  us  then  what  the  holes  in 
our  knowledge  are  and  hence  gives  us  speci¬ 
fic  research  topics.  We  may  discover  we 
reed  a  more  powerful  booster  or  a  more 
responsive  guidance  system  and  so  forth, 
down  to  the  last  detail  until  Che  mosaic  is 
completed.  But,  maybe  even  more  important, 
we  also  know  what  is  NOT  our  problem.  In 
short,  this  research  is  bounded  by  clear  and 
well  defined  goals  and  we  can  lay  out  the 
research  tasks  and  subtaska  with  great 
precision.  Furthermore,  all  those  tasks  are 
within  the  measurement  sciences,  where  calcu¬ 
lation,  experimentation  and  testing  deliver 
non-ambiguoua  measureables  and  invariable 
repetitive  results;  the  pros  and  cons  of  all 
decisions  are  quantifiable  with  exact¬ 
itude,  and  opinions  can  be  substituted  by 
knowledge  -  in  essence,  we  have  to  make 
choices  between  alternative  solutions  but 
not  decisions  (against  uncertairties) . 

Let's  contrast  to  this  the  problem  of  acqui¬ 
sition  research.  In  acquisition  research, 
we  have  only  vague  goals  -  and  not  only  this, 


wo  have  many  and  often  divergent  goals.  This 
makes  the  subject  complex  although  the  indi¬ 
vidual  tasks  may  be  relatively  simple.  We 
do  not  even  know  what  our  problem  is  NOT. 
Should  we  concentrate  on  acquisition  strategy 
or  on  improved  management  control?  Do  we 
need  an  improved  management  control  if  we 
would  have  a  better  acquisition  strategy? 

What  do  we  mean  with  improved  management 
control  and  acquisition  strategy?  These  are 
all  very  good  sounding  statements  of  noble 
goals,  like  being  for  motherhood  and  against 
sin.  But  each  of  those  statements  highlights 
rliat  the  subject  of  acquisition  research  is 
unbounded  by  a  specific  goal;  at  best,  it  is 
flamed  with  good  intentions,  like  the  way  to 
hell  and  most  other  subjects  belonging  in 
the  group  of  decision  sciences.  In  turn, 
this  does  not  permit  us  to  lay  out  research 
tasks  or  subtasks  with  any  resemblence  to 
precision  and  defined  interaction. 


This  is  tbs  dilemma  we  face  in  planning  of 
acquisition  research.  How  to  get  out  of  it7 
How  can  we  remove  the  complexitv  (multiple 
goals)  of  acquisition  research  and  bring  it 
down  to  the  un-complexity  (single  goal)  of 
the  moon  missile?  How  can  we  organize  the 
structure  of  research  casks  with  the  same 
clarity  as  the  task  structure  of  the  measure¬ 
ment  sciences?  Can  it  be  done? 


It  is  possible;  but  it  is  only  possible  if 
we  can  define  substitute  goals  in  acqui¬ 
sition  research.  A  substitute  goal  ib  the 
postulation  of  a  nonambiguous  and  single- 
minded  result  -  like  shooting  a  missile  to 
the  moon  -  which  we  will  pursue  and  bring 
into  reality.  Then  we  will  go  behind  the 
goal  and  turn  all  stones  which  are  in  the 
way  to  reach  this  goal  -  but  no  others. 

Such  substitute  goals  will  let  us  handle 
subjects  of  decision  sciences  like  subjects 
of  measurement  sciences:  the  determination 
and  singlemindedness  must  be  postulated  in 
the  form  of  a  research  hypothesis.  The 
research  hypothesis  is  our  ersatz  missile 
for  the  moor,  shot  toward  better  acquisition 
and  the  search  for  how  to  build  the  ersatz 
missile  (substitute  missile)  will  lead  us 
with  the  highest  possible  precision  toward 
research  topics  (alias  holes  in  our  know¬ 
ledge  related  to  acquisition). 

To  make  myself  better  understood,  1  offer 
you  my  most  favored  substitute  goal  for  Navy 
related  acquisition  research:  "We  will  do 
everything  in  order  to  form  an  economically 
viable  U.S.  shipbuilding  industry  second  to 
none  and  solely  based  upon  private  coianercial 
demand;  in  turn,  all  our  Navy  needs  will  be 
satisfied  by  a  strong  industrial  base  whose 
health  is  not  the  Navy's  concern."  Now  we 
can  look  for  the  booster  of  our  ersatz 
missile  and  for  che  guidance  system  we  need 
to  shoot  to  our  thip-building-oriented  moon. 
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Foi  chose  of  you  who  desire  Co  call  me  a  fool 
and  for  those  of  you  who  desire  to  agree  with 
Barbara  Ward  and  Peter  Drucker,  stating  that 
shipbuilding  and  some  other  old  and  over- 
matured  Uades  are  an  anachronism  in  an 
economy  of  mass  production  and  a  consumer 
society,  and  hence  must  and  will  be  shifted 
into  developing  countries  -  for  all  those  I 
<ife-  vou  a  dtifeient  substitute  goal  to 
tackle  acquisition  research:  "The  U.S. 
slnpyaid  industry  has  no  justifiable  eco¬ 
nomic  basis  in  the  commercial  world  and 
In  lire,  if  needed  for  poi . c  icr  1/mi  1  i tary 
reasons,  will  be  the  sole  responsibility  of 
the  U  S  Navy,  and  therefore,  the  Navy  must 
do  eveivthing  to  maintain  the  industrial 
ter  shipbuilding  "  Ferguson  anil  his 
edit'!  alii’ci'  Jant seller  may  enjoy  this 
ei  r :■  mis'  i 

The  tvio  above  substitute  goals,  first  the 
institution  of  a  healthy  and  Navy-indepen¬ 
dent  l'  S.  shipbuilding  industry  and  second, 
the  institution  of  a  solely  Navy-dependent 
U  S.  shipbuilding  industry  are  unquestion¬ 
ably  extremes.  It  is  a  painting  in  white 
mil  nlack  win rli  may  only  exist  in  dreams. 
Reatitv  wi’l  be  somewhere  in  between  and  may 
otter  itself  in  unlimited  shades  of  gray, 
elusive  to  exact  definition.  In  reality,  we 
have  to  work  in  gray  and  plan  in  gray  - 
1-owevei  ,  we  cannot,  think  in  gray  because 
gray  is  no  definable  concept:  only  black  and 
wti  i  te  is.  Also,  even  though  white  and  black 
may  be  at  the  end  ot  the  probability  spectrum 
-  ot  even  outside  of  the  spectrum,  their 
existence,  or  better,  possibility  of 
existence  cannot  be  denied.  Black  and  white 
can  also  be  called  the  thesis  and  the 
antithesis  and  the  gray  area  in  between  the 
synthesis.  Hence,  I  suggest  that  acquisition 
re,earch  start  with  a  sec  of  substitute 
goals  in  the  form  of  noil-ambiguous  research 
hypotheses  described  in  the  form  of  thesis 
(pro!  ami  antithesis  (con)  and  searches  for 
tile  synthesis.  Otherwise  we  will  nevec 
arrive  at  a  coherent  and  interacting 
resoaich  plan  of  acquisition  topics.  We 
must  be  willing  to  accept  a  set  of  research 
goals  and  associated  research  methodologies 
which  permit  u«  to  treat  the  problems  of 
acquisition  research  (which  in  itself  is  a 
decision  science)  simile  y  to  problems  of 
the  measurement  science  We  have  to 
substitute  the  fairy  tale  of  scientific 
neutrality  with  a  set  of  essentially 
subjective  political/military/economic  goals 
which  we  can  dress  up  in  the  form  of  a 
boundary  hypothesis  subject  to  prove  or 
disprove.  Only  in  this  way  -  or  with  this 
methodology  -  are  we  able  Co  handle  the 
amorphous  and  unbounded  area  of  acquisition. 
Initially,  the  extreme  hypotheses  or  boundary 
hypotheses  are  postulated  perceptions  embrac¬ 
ing  tlie  rone  of  reality.  We  imisl  have  the 
coumg'  to  express  o  possible,  although  often 
highly  improbable  vision  of  how  we  would  like 
■o  see  our  goals  lie  tore  we  are  able  to  fill 


in  research  tasks  with  scientific  neutralil 
in  order  to  complete  the  picture  and  close 
the  loop  from  the  border  hypotheses  toward 
the  synthesis  or  reality. 

2.  A  SET  OK  BOUNDARY  HYPOTHESES 

l  am  using  the  term  hypotheses  quite 
liberally  in  order  to  describe  a  goal,  a 
concept,  a  possibility  or  an  opinion  on  a 
particular  subject.  Accordingly,  I  define  a 
boundary  hypothesis  as  an  extreme  of  such 
goal,  concept,  possibility  or  opinion,  being 
we 1 1  aware  of  the  black  and  white  painting. 

I  consider  the  boundary  hypotheses  as  a 
i .'search  tool  which  forces  us  to  recognize 
needed  knowledge  and  hence  research  topics 
as  necessary  to  defend  the  hypothesis.  This 
in  turn  will  lead  to  a  coheren*  bo.v  of  know¬ 
ledge  to  deal  with  the  wide  spectrT  of 
acquisition. 

At  this  moment  l  offer  six  hypotheses  for 
discussion.  I  will  start  with  very  general 
subjects  and  proceed  toward  specific  Navy 
related  subjects.  A  justification  will  be 
given  only  for  the  last  hypothesis.  In  mv 
opinion,  the  six  hypotheses  are  sufficient 
to  cover  the  entire  acquisition  spectrum 

HYPOTHESIS  fl  ON  THE  UNIFORMITY  OF  PROBLEMS 

•  PRO:  All  procurement  problems  are 

the  same  and  independent  of 
the  procured  goods.  There  foie, 
all  procurement  processes  can 
be  handled  identically. 

•  CON:  Every  procurement  problem  is 

an  individual  problem, 
depending  upon  the  specific 
product,  the  opecific  producer 
and  the  specific  economic 
condition  of  the  procurement 
time. 

HYPOTHESIS  #2  ON  THE  RELA1  (OliSHI  P  BETWEEN 
INDUSTRIES 

•  PRO:  A  strong  commercial  industry 

is  the  necessary  backbone  for 
a  strong  military  industry. 

•  CON:  The  capability  of  the 

commercial  industry  and  the 
capability  of  the  military 
industry  are  not  related  to 
each  other. 

HYPOTHESIS  03  ON  THE  UNIFORMITY  OF 
MANUFACTURING 

•  PRO-  Manufacturing  mol  hoi  ■  i 

commercial  goods  and 
manufacturing  methods  tor 
military  goods  are  idooricol 
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•  CON:  Manufactui ing  methods  for 

commercial  goods  are  not 
compatible  with  those  for 
mi  litary  goods. 

HYPOTHESIS  #4  ON  THE  RELATIONSHIP  BETWEEN 

PRODUCTION  VERSUS  CONSTRUCTION 

•  PRO:  All  manufactured  goods  are  the 

result  of  a  production  process 
whereby  a  production  process 
is  defined  as  an  operation 
which  manufactures  an  unlim¬ 
ited  number  of  identical 
pieces. 

•  CON:  All  manufactured  goods  are  the 

result  of  a  construction 
process  whereby  a  construction 
process  is  defined  as  an 
operation  which  manufactures 
one  of  one  individual  piece 
with  unique  and  not  repetitive 
characteristics. 

HYPOTHESIS  *5  ON  THE  NATURE  OF  SHIPBUILDING 

•  PRO:  A  shipyard  is  a  place  where  a 

ship  can  be  launched  and 
assembled  from  pert3  and 
building  blocV.s  which  are 
manufactured  outside  of  the 
Shipyard.  (Assembly  yard) 

•  CON:  A  shipyard  is  a  place  where  a 

ship  can  be  launched  and 
assembled  from  parts  and 
building  blocks  which  are  all 
manufactured  in  the  shipyard. 
(Fully  integrated  yard) 

HYPOTHESIS  »6  ON  THE  VIABILITY  OF  THE 
SHIPBUILDING  BASE 

•  PRO:  The  commercial  hypothesis  on 

shipbuilding  postulates: A 
commercially  viable 
shipbuilding  industry  is 
possible  in  the  U.S.A.  because 
of  (a)  the  industries' 
competitiveness  on  the  world 
market  and  (b)  a  strong  and 
conmercially  viable  U.S.  ocean 
transportation  industry. 
Therefore,  the  Navy  does  not 
have  to  be  concerned  with  the 
health  of  the  industtial  base 
for  shipbuilding. 

•  CON:  The  military  hypothesis  on 

shipbuilding  postulates:  The 
industrial  base  for  ship¬ 
building  in  the  U.S.A.  can 
only  be  secured  through  Navy 
contracts  and  therefore,  the 
Navy  oust  be  concerned  with 
the  health  of  this  industrial 
segment. 


2 . !  Justification  for  the  Hypothesis  of  the 
Viability  of  the  Shipbuilding  base 
(Hypothesis  4(t) 

I  have  stated  before  that  a  research 
hypothesis  may  well  be  an  extreme  state¬ 
ment,  but  nevertheless,  the  hypothesis  must 
have  some  root  of  credibility.  Since  I  con¬ 
sider  the  Hypothesis  #6  as  the  most  import¬ 
ant  one  for  the  Navy  -  but  also  ns  the  most 
disputed  -  I  have  selected  this  hypothesis 
to  develop  an  i 1 lus t rat ive  defense.  This, 
however,  shall  not  imply  that  within  the 
total  scope  of  DOD  acquisition,  the  other 
five  hypotheses  are  of  lesser  importance. 

In  trying  to  justify  the  commercial  and  the 
military  hypotheses,  I  would  first  of  all 
like  to  reverse  the  order  and  start  with  the 
military  hypothesis. 

The  military  hypothesis  is  close  to  present 
public  opinion  and  has  its  intellectual 
foundation  in  the  1961  study  of  Northwestern 
University  with  the  title,  "The  Economic 
Value  of  the  American  Merchant  Marine"  by 
Ferguson  et  at.  (An  editorialized  version 
was  published  in  1975  by  Jontscher  of  the 
Brookings  Institute  under  the  title,  "Bread 
Upon  the  Waters.")  While  Ferguson's  study 
had  some  justification  by  the  tremendous 
economic  superiority  of  the  U.S.  in  1961, 
Jantscher's  rehash  is  utterly  out  of  place. 
Ferguson's  and  Jantscher's  doctrine  is  most 
simple:  "We  (the  U.S.A.)  do  not  need  a 
merchant  fleet  because  we  can  buy  the 
service  cheaper  from  others." 

The  mental  acceptance  of  the  Ferguson 
doctrine  induced  sufficient  powers  to  stay 
away  from  any  serious  consideration  of  a 
U.S.  Merchant  Marine  and  led  in  turn  to  its 
systematic  decline.  I  do  not  want  to  go 
into  an  analysis  of  Ferguson  or  Jantscher 
despite  the  fact  that  I  consider  both 
essentially  substantively  wrong.  The 
military  hypothesis,  a  direct  outgrowth  of 
Ferguson's  doctrine,  is  depicted  in  Figure  1 

The  shipyard  industry  essentially  depends 
upon  the  Navy,  and  whatever  the  N«vy  has  to 
do  depends  upon  national  decisions  with 
regard  to  defense  goals.  The  consequences 
of  the  military  hypothesis  with  regard  to 
cost  of  Navy  ships  should  be  quite  clear: 
extreme  expenses  and  the  entire  burden  of 
maintaining  an  effective  industrial  ship¬ 
building  base  resting  with  the  Navy. 

I  personally  do  not  subscribe  to  the 
military  hypothesis;  however,  I  also  cannot 
deny  the  possibility  of  its  realization. 

As  defense  for  Ferguson  (but  not  for  hie 
later  copyist  Jantscher)  it  can  be  said:  in 
1960  when  the  study  was  made,  the  U.S.A.  (1) 
dominated  the  world  economy  and  the  dollar 


415 


FIGURE  1 :  MILITARY  HYPOTHESIS 
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was  THE  currency;  (2)  military  superiority 
was  tak’n  for  granted  and  (3)  military 
expenses  were  aeoepced  as  a  national 
necessity.  Under  such  favorable  conditions, 
Ferguson  might  have  been  not  completely 
wrong  by  saying  "noh  so  wliat?"  about  a  U.S. 
Mei chant  Marine. 

The  commercial  hypothesis  which  I  have 
postulated  takes  care  of  the  realities  of 
1978  and  presumably  the  next  decades:  (1) 
tile  dot  Ini  has  weakened  and  the  balance  of 
payment  deteriorated;  < 2 )  American  wages 
have  reached  parity  with  many  other  ship¬ 
building  nations;  (3)  military  expenses  are 
subject  to  utmost  scrutiny  and  (A)  unemploy¬ 
ment  develops  coward  a  national  problem. 
These  are  four  conditions  which  are  quite 
opposite  to  those  in  1960,  and  therefore  it 
may  well  be  that  the  justification  exists  to 
promote  -  and  also  the  probability  of  creat¬ 
ing  a  healthy  U.S.  Merchant  Marine,  and  in 
turn,  .in  effective  shipbuilding  industry. 

The  picture  which  1  think  is  realistic  is 
shown  in  Figure  2. 

FIGURE  2:  COMMERCIAL  HYPOTHESIS 


In  my  judgment,  in  1985  by  the  latest,  the 
U.S. A.  could  have  a  most  healthy  U.S.  flag 
Merchant  Marine  and  a  shipbuilding  industry 
fully  competitive  on  the  world  market.  In 
turn  the  Navy  could  be  completely  free  fiom 
any  burden  of  maintaining  Che  industrial 
base  for  shipbuilding,  and  healthy  shipyards 
could  compete  in  the  best  traditional  wav  of 
free  enterprise  for  Navy  orders. 

Since  wage  parity  with  most  of  our  compet¬ 
itors  is  already  established  and  the  American 
technical  know-how  to  build  ships  is  hard'v 
inferior  to  the  others,  the  question  comes 
down  to  a  legal -economical  point  winch  is 
e„-‘><'tial)y  embedded  in  political  thinking: 
are  '.11  willing  or  not  to  provide  to  the  U.S 
Merchant  Marine  complex  (shipping  companies 
and  shipyards)  opernfonal  pat  My  to  our 
foreign  competitors?  (1  am  talking  .uiout 
operational  parity  and  not  operation 
subsidy.)  The  operational  parity  would  have 
to  consist  of  (1)  tax  parity,  (2)  design 
parity  and  (3)  route  parity.  The  tax  parity 
would  establish  for  any  American  built  ship 
and  any  ship  flying  the  American  flag  parity 
in  taxation  with  flags  of  convenience.  The 
design  parity  would  accept  the  international 
safety  rules  for  American  built  and  U.S. 
flag  operated  ships  in  the  same  way  as 
applicable  to  ships  with  flags  of  conven¬ 
ience.  The  design  parity  would  also  include 
manning  requirements.  The  route  parity 
would  give  American  built  ships  with  the 
American  flag  in  the  liner  trade  the  same 
operational  freedom  as  enjoyed  by  other 
flagships.  Also,  parity  to  participate  in 
internationally  accepted  rate  practices 
should  be  included  os  well  as  fifth  freedom 
opera t ions. 

A  recent  study  of  the  first  National  Bank  of 
Chicago  points  toward  the  importance  of  tax 
parity  and  the  so-called  CcUer  Hearing, 
Antitrust  Simcommittue  No.  5  of  1°61  inform) 
us  about  problems  related  to  design  and  route 
parity.  An  economic  impact  analysis  o!  the 
Merchant  Marine  Act  of  |d38  and  its  amend¬ 
ments  and  successors,  as  well  as  ot  the 
background  to  the  Merchant  Marine  Sales  Act 
of  1965  would  be  enlightening. 

If  operational  parity  could  be  established, 
maybe  100  or  200  major  ship  orders  per  year 
-  or  about  2  or  6  billion  dollars  -  could  go 
into  the  American  economy  mslc<.d  of  foreign 
shipyards.  Not  asking  for  taxes  on  futute 
business  which  wc  do  not  have  now  is  no  loss; 
altogether,  the  U.S.  would  gaio.  The  economy 
of  the  commercial  hypothesis  is  not  difficult 
to  prove  -  of  course,  more  study  is  needed 
However,  the  problem  is  political’  a:  we 
willing  to  make  s."»erale  lava  fo-  the  Ocean 
Industry  ns  orhei  countries  do'  1.  Sc  a 
prospectus  of  a  "future  balance  s!<  would 
be  convincing  Quite  3one  homework  has  to 
he  done  in  mder  to  arrive  at  thi3  "future 
balance  sheet"  We  call  it  research  Wliat 
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do  to  really  know  of  drafting  the  balance 
sheet?  Wliat  do  we  have  to  know?  The 
necessary  work  to  be  done  is  indicated  in 
the  form  of  research  clusters. 

3.  Research  clusters 

A  research  cluster  is  defined  as  a  group  of 
related  research  topics  which  must  be 
addressed  as  a  package  in  order  to  prove  or 
disprove  a  specific  research  hypothesis. 
Combining  figure  1  and  figure  2  into  figure 
3,  a  total  of  three  research  clusters  can  be 
identified  with  regard  to  the  research 
hypothesis  #6. 


a  Principles  of  Planning  as  FuncLion  of 
Shipyard  Facilities  and  Ship  Type 

•  Planning  Model,  Incorporating 
Facilities,  Resources  and  Budget 

•  Optimal  Sire  of  Shipyards 

•  Variable  Workload,  Work  Density  and 
Output 

•  Labor  Taxonomy  and  Availability 
Topics  for  Research  Cluster  #2 


FIGURE  3:  RESEARCH  CLUSTERS 


RESEARCH 

CLUSTER 

#2 


RESEARCH 

CLUSTER 

#3 


•  Legal  Environment  of  Shipbuilding. 
Determine  the  national  and  international 
laws  influencing  and  controlling  ocean 
transportation 

•  Economy  of  Shipbuilding.  Determine  the 
elements  which  influence  the  economy  of 
the  entire  ocean  transportation  and 
shipbuilding  industry. 

•  Substitute  for  the  Market.  Determine 
the  degree  to  which  contractual 
arrangements  can  substitute  for  the 
market. 

•  True  and  False  Competition.  Determine 
the  condition*  necessary  for  a  healthy 
industrial  competition  and  the  degree  to 
which  competitive  aspects  ran  be 
fostered  by  regulatory  involvement. 


Topics  for  Research  Cluster  #3 


Suggested  topics  for  the  three  research 
clusters  are  listed  below  together  with  a 
syllabus  for  each  topic.  For  the  purpose  of 
this  presentation,  only  a  few  of  the  most 
important  topics  are  listed;  it  is  only  an 
illustration  of  how  research  clusters  can  be 
developed. 

Topics  for  Research  Cluster  #1 

•  Foreign  Management  Systems  on  Shipyards 
in  Order  to  Learn  If,  How  and  Why 
Foreign  Shipyards  are  Supposedly  so 
Superior  to  U.S.  Shipyards 

•  Decentralization  of  Shipyards  by  Major 
Trades  and  Investigation  if  Some  of 
Those  Trades  Could  Operate  as  an 
Independent  Business 

•  Technology  Utilization  in  Order  to 
Determine  Practical  Limits  of 
Facilitation 

•  Optimum  Range  of  Subcontractors  in  Order 
to  Develop  a  Full  Set  of  Criteria  for  a 
Make  and  Buy  Decision 


•  Implementation  Mechanics.  Determine  the 
necessary  legal  framework  which  permits 
the  moat  efficient  management  of  the 
industry. 

•  Data  and  Retrieval  Management.  Determine 
the  data  and  the  boundary  for  microman¬ 
agement  for  government  guidance  to  the 
industry. 

•  Lifetime  of  Navy  Ships;  Time/Quality 
Cost.  Tradeoff  between  lifetime  of 
ships  and  initial  quality. 

Mixed  Topics,  Belonging  to  More  than  One 

Research  Cluster 

•  Research  Need.  List  perceived  research 
need  and  separate  perception  into 
symptoms  and  real  causes. 

s  Problem  Logic.  Develop  guidelines  which 
permit  the  determination  of  the  solva¬ 
bility  of  s  given  problem. 

•  Commonality  between  Civilian  and  Defense 
Industry 
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•  Management  Form  and  Product  Form. 
Investigate  the  relationship  between  the 
manufacturing  process  of  a  product  and 
the  most  appropriate  management  form. 

•  Capital  Investments,  Utilization, 
Oepreciat ion.  Cash  Flow 

•  Risk  and  Profit  in  Construction. 
Determine  the  spectrum  of  risk  and  risk 
sharing  between  customer  and  contractor 
in  shipbuilding. 


•  Forecasting;  Retrospect ive/Econooic/ 
Market.  Determine  the  historical 
validity  of  forecasts  and  ievelop  a 
method  able  to  indicate  forecast  quality. 

»  Coonoi,  i’l  vi>>  -ms  Military  Product 
Us ah i  lily 

•  Piece/Time  Wages 


NO  CLAIM  IS  MADE  THAT  ABOVE  GROUPING  FIRST, 
IS  COMPLETE,  AND  SECOND,  PRESENTS  THE  ONLY 
POSSIBLE  GROUPING. 

3 ■ 1  Organization  of  Research  Topics 

The  research  topics,  identified  within  the 
three  scsearr.il  clusters,  will  be  the  domain 
of  different  disciplines  most  competent  to 
deal  with  the  problems  and  hence  will  be  a 
part  of  a  apecific  research  group.  For 
illustrative  purpoaes,  I  have  identified 
eight  such  research  groups  as  follows: 

(1 )  General 

Topics  ir.  this  group  are  of  general  interest 
and  independent  from  the  hypothesis  where 
appl ’ ed . 

(2)  Management 

Topics  in  these  groups  are  considered 
essentially  problems  of  management;  also 
they  may  quite  frequently  infringe  on 
engineering,  law,  economy  or  other  groups. 

(3)  legal 

Topics  in  this  group  ere  considered 
eosentially  as  legal  problems,  despite  the 
fact  that  these  topics  may  have  strong 
economical  trail*  and  may  al«o  influence  to 
a  Io»«er  extent  other  group*. 


(A)  Engineering 


Topics  in  this  group  are  considered 
essentially  engineering  problems  and  have 
mostly  >nly  a  secondary  connection  to  other 
groups. 


Topics  in  this  group  are  considered 
essentially  economic  problems  which  can 
often  be  addressed  without  considering  the 
iircnediaCe  impact  to  otner  groups.  However, 
in  the  long  run,  the  economic  topics  may 
drive  the  other  groups. 


FIGURE  4:  PRELIMINARY  ORDERING  OF  TOPICS 


(6)  Pi odne t ion  Science 


This  group  has  been  firmed  ir  order  to 
accommodate  all  those  multidiscip’  i"-’ 
problems  wt.:ch  are  evenly  and  definitely 
embedded  m  more  than  one  group  such  ns  in 
economy  and  management  or  mnnogemeni  and 
Technology,  or  :n  more  than  two  grout-  ■ 
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( 7)  Manpower 

This  group  encompasses  all  problems  direct  ly 
related  to  manpower  -  also  the  influence*  of 
the  manpower  problems  may  be  noted  in 
economy,  management  and  other  groups. 

(8)  Theory 

Few  words  are  more  misused  than  "theory";  it 
is  even  more  misused  than  "system".  Very 
often  the  teim  is  used  for  everything  the 
reader  does  not  understand  or  the  word  is 
used  for  "hypothesis"  or  "assumption".  De 
facto,  however,  theory  indicaf.  the  abstrac¬ 
tion  (or  synthesis)  of  the  sum  of  concrete 
cases  (the  examples)  of  practice.  This  hint 
is  important  to  avoid  misunderstanding.  A 
preliminary  ordering  of  topics  is  shown  in 
Figure  4.  The  figure  also  established  the 
relationship  between  the  individual  topic 
and  the  topic  group- 

4.  GENERALIZATION 

The  concept  of  starting  with  a  research 
hypothesis,  proceeding  toward  the  formation 
of  research  clusters  and  finally  ending  up 
with  a  synthesis  is  easily  portrayed  on  the 
research  hypothesis  #6  as  shown  in  Figure 

5.  Having  presented  this  research  method¬ 
ology  (as  abbreviated  in  this  paperl  to  the 
ONR/NAVMAT  Acquisition  RAD  Council,  he 
question  has  been  raised  if  the  same 
methodology  could  be  generalise:1  so  118  to  be 
useful  for  problems  acquisition  rese.  rch  on 
a  DOD-  wide  basis. 

FIGURE  5:  SYNTHESIS  TO  HYPOTl'SIS 


Fmm  *  purely  nwthodnloRi ca  1  point  of  view, 

1  tend  toward  an  afftittallvn  nnawm  . 

However,  from  a  rsault-oriuntud  point  of 
view,  I  am  rather  reluctant  to  answer  the 
question  one  way  or  the  other.  Nevertheless, 
the  approtch  to  find  the  answer  shall  be 
sketched  in  the  form  of  three  assumptions  as 
fo l 1 ows : 

Assumption  #1:  Let’s  assume  three  parties 
are  interested  in  developing  a  unitied 
research  methodology  In  acquisition  research 
and  the  three  parties  are  searching  for  n 
commonality  in  handling  (or  implementing) 
the  research  result.  The  three  parties 
shall  be  A  (Navy),  B  (Army)  and  C  (Air 
Force) . 

Assumption  #2:  Let’s  assume  all  parties  A, 

B  and  C  hrve  agreed  that  the  entire  spectrum 
of  acquisition  research  is  covered  by  the 
Research  Hypothesis  H-l ,  H-2...H-n  in  similar 
form  as  outlined  previously  in  section  2  of 
this  paper. 

Assumption  #3:  Let’s  assume  each  party,  A, 

B  and  C,  is  Ta)  able  to  subdivide  each 
hypothesis  in  its  legal  domain,  its  engi¬ 
neering  domain  and  in  its  economic  domain 
and  (b)  »o  locate  in  each  domain  the  accept¬ 
able  synthesis  with  some  clarity  between  the 
PRO  and  CON  extremes  of  the  research 
hypothesis.  Whenever  all  those  assumptions 
can  find  realization,  the  result  can  be 
portrayed  as  shown  in  Figure  6. 

FIGURE  6:  SPECTRUM  OF  COMMONALITY 
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Jn  Figure  6,  the  relative  location  of  the 
synthesis  for  each  hypothesis  is  indicated 
with  A,  B  and  C  and  wherever  by  a  given 
criterion  the  locations  appear  close  enough, 
commonality  for  A,  B  and  C  with  regard  to  a 
specific  hypothesis  can  be  assumed. 
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About  the  Author: 


No’  the  methodological  problem  zioo..  *. 
apparent:  how  can  we  locate  a  '  -h  -  * 
position  between  the  ext i-tattt?  "" 

determine  the  relative  peri*  (  i  ■ 
color  group  within  the  spectrum 
bounded  by  black  and  white?  It  as:.  vly  be 
done  by  forcing  the  solution  into  ■  saurable 
terms  with  distinct  physical  dimeni  ms. 

Here  we  may  be  back  at  the  epiatou-.  •  ical 
problem  which  we  tried  to  escape  * 
beginning. 


EPILOGUE 


The  paper  starts  with  a  philosophic!"!  sketch 
about  measurement  sciences  and  ends  by 
underscoring  an  epiatomo logical  (and 
methodological)  nroblem.  The  beginning 
leads  to  a  sersu  .’■forward  procedure  of  how 
to  handle  probler-  related  to  acquisition 
research  in  shipbuilding.  The  attempt  to 
genera  lire  the  procedure  -  as  shown  in  the 
lar.t  section,  may  point  toward  the  impro- 
bability  -  if  not  impossibility  -  of  handling 
"all"  acquistion  problems  in  a  uniform  way. 

Of  course,  this  is  at  the  moment  a  deduction 
only.  It  may  alao  be  a  warning  against 
overoptimism  toward  DOD-wide  conformity. 


Dr.  Frans  A.  P.  Frisch  graduated  from  the 
Technical  Univeierty  of  Vienna,  Austria.  He 
has  30  years’  experience  m  shipbuilding  and 
relateu  suojecte.  He  ha3  worked  as  a  Naval 
Architect,  Guarantee  Engineer,  chief 
Estimator,  Production  Manager,  and  Director 
for  Shipyard  Planning  and  Maintenance  in 
i.ustria,  Denwsrk,  Sweden  and  Germany.  In 
1936  he  wa8  firat  invited  to  the  U.S.A.  to 
testify  on  foreign  cost  and  production  in 
subsidy  cases  before  the  Mariti;,: 

Admin iatration.  Prom  1957  through  1962  he 
was  associated  with  several  U.S.  Naval 
Architect  firms;  was  owner's  representative 
in  Europe  and  Japan;  conduct  rd  studies  on 
."ransport  economy  for  Venezuela,  ICC,  and 
shipowners;  wa3  consultant  for  shipyard 
planning  in  Brazil  and  Europe.  In  1963  he 
joined  the  staff  of  CNA  (Center  for  Naval 
Analysis)  and  became  head  of  the  logistic 
section  and  study  director;  there  he  origi¬ 
nated  tht  PDL  ship  and  ship  concept,  and  was 
assigned  us  advisor  to  the  project  manager. 
From  1963  through  1974  Dr.  Frisch  was  faculty 
member  and  visiting  lecturer  at  the  M.I.T. 
(Massachusetts  Institute  of  Technology);  he 
lec lured  on  shipyard  management,  ocean 
tranaporation,  systems  theory  in  transpor¬ 
tation,  and  in  interdiaciplinaiy  seminars. 

In  1972  and  1973  he  was  consultant  to  Dubai 
Drydock,  Ltd.  for  layout  of  a  new  shipyard 
in  the  Arabian  Gulf.  Since  1973  Dr.  Frisch 
has  been  with  1IAVSEA,  mostly  involved  in 
special  projects.  He  io  also  Adj.  Professor 
for  V.P.I.  (Virginia  Polytechnic  Institute 
and  State  Univeroity)  teaching  graduate 
course*  ir.  Advanced  Engineering  Economy  and 
Management  Concepts. 
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INTRODUCTION 


Extensive  research  has  bi  ■»  accomplished  in  the 
name  of  procurement  research  over  the  past  few 
\ears  but  no  lel'Utive,  delimited  concept  has 
evolved  as  to  ’hat  constitutes  procurement 
research  (15).  A  review  of  the  early  Depart¬ 
ment  of  Defense  (DOD)  Procurement  Symposia 
"Proceedings"  indicated  that  professionals  in 
the  field  of  pro  wsement  called  for  a  defini¬ 
tion  of  the  te-m  'Procurement  Research"  as  well 
as  the  classification  of  its  characteristics 
into  a  model  to  provide  more  efficient  use  of 
resources.  The  ne, -i  existed  to  clearly  define 
procurement  research  and  to  classify  its  char¬ 
acteristics  into  a  useabje  cone- ptual  model. 
Consequently,  a  study  was  Initiated  at  the  Air 
Force  Institute  of  Technology  tc  accomplish 
■hesc  goals  (4). 

Research  has  been  viewed  by  many  In  the  field 
as  a  key  to  alleviating  both  existing  and 
future  procurement  problems  (2:1).  Senator 
Stennis,  Chairman  of  the  Senate  Committee  on 
Armed  Services,  and  Congressman  Price,  Chairman 
of  the  House  Comm’ttie  on  Armed  Services, 
reiterated  this  ely  held  belief  in  a  joint 
letter  to  former  Defense  Secretary  Schlesingor: 

"We  recognize  the  value  and  Importance  of  pro¬ 
curement  research  as  a  ireano  of  Improving  the 
procurement  process  —  one  of  the  most  crucial 
casks  in  Government  [10]." 

Even  though  there  is  a  general  consensus  as  to 
the  importance  and  possible  impact  of  research 
on  the  procurement  process,  procurement  research 
as  a  discipline  has  not  been  clearly  defined  in 
existing  literature  and  practice.  Also,  there 
is  little  agreement  among  the  agencies  perform¬ 
ing  this  research  as  to  what  constitutes  pro¬ 
curement  research  (1:2).  There  have  been 
several  indications  as  r.i  a  possible  scope  for 
procurement  ri  march;  "or  example,  J.  M.  Malloy, 
then  Deputy  Assistant  decretary  of  Defense  for 
Procurement,  described  procurement  research  a3 
essentially  "a  systematic  approach"  that  follows 
the  scientific  method  (8:215).  However,  there 
has  not  been  a  concerted  effort  to  adequately 
describe  what  should  be  Included.  The  result 
has  been  that  research  efforts  are  categorized 
as  both  tentative  and  diffuse  (11:4).  Robert 
Judson,  then  Deputy  Director  of  Commission 
Studier,  Commission  on  Government  Procurement 
(COCP),  stated  that  procurement  research's 

"...first  order  of  priority  ...  is  to  construct 
...  a  model  so  that  ue  can  share  a  consensus  on 


procurement  pr'jlems,  ...  a  comprehensive 
studious  critical  conceptual  model  ‘‘or  the 
acquisition  p.ocess  that  will  g'vo  us  insights 
we  do  not  now  possess  that  will  help  us  identify 
what  we  don't  knc.;  [6:93]." 

The  Lmportaice  of  procurement  icsearch  and  the 
ne^ .  sity  of  defining  it»  role  1:.  j/. » eminent 
act  .sltion  was  reaffirmed  In  an  interview  with 
Rc."rt  F.  Trimble,  then  Assistant  Administra¬ 
te!,  Office  ot  Federal  Proourc!!’v..t  Policy  (OFl'Pj 
for  Contract  Administration.  He  discussed  pro¬ 
curement  research  as  follows: 

"I've  long  had  an  Interest  In  procurement 
research.  I  think  that  it  [an  attempt  to  define 
and  classify  procurement  research]  is  one  that 
is  particularly  important  because  1  have  seen  a 
considerable  amount  of  confusion  regarding  what 
constitutes  procurement  research.  I  believe 
that  this  matter  needs  to  be  clarified  no  that 
we  can  more  efficiently  utilize  Hie  manpower 
resources  that  we  have  in  this  particular  area 
[15]." 


BACKGR0D1'.) 


In  che  pn.v  .  specific  areas  in  procurement 
research  have  id  been  clearly  delimited;  thus, 
a  historical  b,v  ->und  mu3t  concentrate  on  the 
procurement  orgamzat ">os  which  have  developed 
during  the  past  twentv-five  years.  The  evolu¬ 
tion  of  procurement  research  has  been  "barnc- 
terlzed  by  changes  in  organizar.l"  a  d  proce¬ 
dures.  Research,  per  se,  ha3  no.  ■'mpba- 

slzed;  rather,  the  emphasis  has  >  «..  '  • 

changes  in  DOD  and  Air  Force  proem  i-ni  organ¬ 
ization  which  resulted  from  the  neuJ  .or  better 
procurement  method.i.  The  lack  of  a  clear 
definition  of  just  what  procurement  research 
includes  made  this  approach  necessary. 

In  the  1950's,  various  attempts  were  made  to 
save  money  through  reorganising  and  centralizing 
purchases  of  common  Items.  The  Inertia  of  old 
techniques  was  slew  to  yield  to  change,  moreover 
each  military  service  was  "isolated"  from  the 
others  as  far  as  procurement  methods.  In  the 
1960's,  some  efforts  wore  made  to  exchange  pro- 
c  irement  information  an.’  to  evaluate  decision- 
making  during  the  acquisition  process.  New 
approaches  were  being  utilized  to  improve  the 
management  information  flow.  In  the  1970's, 
many  changes  occurred  in  the  formal  acquisition 
process.  After  many  long  years  of  inefficiency 
anc.  redundancy,  the  national  procurement  policy, 
education,  and  research  are  becoming  centralized 
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and  coordinated  under  the  Federal  Acquisition 
Institute  (FAI). 

Mr.  Kobert  Judson,  then  Deputy  Director,  Commis¬ 
sion  Studies,  Commission  on  Government  Procure¬ 
ment  (COOP) ,  in  an  address  t«.  the  second  DOD 
Procurement  Symposium  in  1973  .  de  a  challenge 
to  the  piocurement  profession,  i, 1  said: 

"You,  gentlemen,  iiave  a  golden  opportunity  to 
redirect  procurement  research  to  achieve  new 
goals  »t  excellence.  First  let's  do  our  research 
oil  the  jirobjoms  of  research  before  we  lose  the 
chance  to  make  procurement  what  we  want  it  to 
be  [6:99]." 

fhi»  challenge  was  re-emphasized  by  Dr.  John  J. 
Bennett,  then  Acting  Assistant  Secretary  of 
Defense  tie  fa’ lotions  aid  Logistics;  in  the 
Defense  Man.igcmcn,  Jour  al_,  July  1975: 

"Procurement  osearch  is  not  ••  *  a  household 
phrase  in  (he  Department  of  Defense  ....  It 
needs  a  great  deal  of  attention  from  management 
and  those  people  actually  engaged  in  procurement 
projects  '2:1!.” 

1'  summary,  the  Important  events  in  the  evolu¬ 
tion  of  procurement  research  start  with  the 
Second  Hoover  Commission  in  1953  and  continue  up 
'  the  present  time.  Key  events  in  procurement 
root  t  an  lz.it  ion  in  the  1960's  include  tie  reorgan¬ 
ization  t  t  All  Koice  Svstems  Command  and  Air 
iorrr  Logistics  Command,  the  Hershey  Procurement 
Pi  long  Conference,  the  cstahi ishment  of  the 
Ar.r.y  Procurement  Research  Office,  and  the  Com¬ 
mission  on  Go”ernmenl  Procurement.  The  signif¬ 
icant  events  (thus  far)  during  the  1970's  Include 
Che  six  DOD  Procurement  Symposia,  the  establish¬ 
ment  of  the  Air  Force  Business  Research  Manage¬ 
ment  Center,  the  addition  of  a  Graduate  Procure¬ 
ment  curriculum  to  the  Air  Force  Institute  oi 
Technology,  School  of  Systems  and  Logistics,  and 
a  Systems  acquisition  Management  curriculum  to 
tiie  Naval  Postgraduate  School,  the  establ  Xshneet 
of  the  Office  of  Federal  Procurement  Policy,  and 
lh<  founding  of  the  Federal  Acquisition  Institute 


BASIC  STUDY  OBJECTIVES 


The  following  research  obj  tlvcs  of  the  study 
are  germane: 

1.  To  define  procurement  research  so  tnai  . 
common  foundation  can  be  used  when  discussing 
this  subject. 

v.  To  classify  procurement  research  efforts 
and  functions  into  various  areas  and  to  Identify 
those  areas  that  are  most  frequently  Investigated. 

3.  From  these  classifications,  to  suggest  a 
detailed  algorithm1  which  can  be  used  for  deciding 

'a  sequo-ti.it  decision-making  process  or  mods.. 


If  an  effort  is  procurement  research. 


METHODOLOGY 


A  literature  review  was  Initiated.  It  disc lost 
an  increasing  interest  in  the  area  of  procur— 
nent  research  and  in  defining  procurement 
re  seal  ell,  but  no  suggestions  were  made  as  co 
how  this  specific  area  of  research  should  be 
defined  or  how  it  should  be  classified  from  a 
t  “onomical  standpoint.  A  search  disclosed 
that  content  analysis  provided  a  rigorously 
subjective  technique  for  grouping  various  pro- 
cuieiT.cn i  efforts:  by  division  of  scientiiic 
study,  by  brta.lt!.  of  application,  by  degree  of 
control,  by  level  of  outcome,  by  level  of 
effort,  and  by  placement  in  the  acquisition  and 
procurement  processes.2  Through  a  sv.Vtm  ot 
summarizing  and  categorizing,  these  various 
groups  were  used  to  suggest  a  definition  for 
procurement  research. 

The  basi.  research  design  was  divided  into  five 
areas: 

1.  Classifying  procurement  research  etfori 
and  functions  Into  categories  and  sub-calegcrie 

2.  Identifying  the  areas  of  procurement 
research  that  were  most  frequently  investigated 

3.  Defining  proem ement  research  In  terms 
of  characteristics  which  were  evidenced  in  the 
studv. 

A.  Suggesting  a  taxonomy  of  procurement 
•lisearch. 

5.  Designing  a  procurement  research  algo¬ 
rithm  for  evaluating  research. 

The  first  three  areas  of  the  research  design 
were  planned  to  answer  the  first  and  second 
research  objectives.  The  fourth  and  fife!1 
design  areas  were  planned  to  answer  the  second 
and  third  objectives. 

The  first  design  area  was  planned  to  identify 
specific  scientific  and  research  characteristic 
of  procurement  research  as  evidenced  in  the 
"Proceedings".  Through  content  analysis,  the 
articles  of  the  symposia  "Proceedings”  have 
been  classified  Into  various  categories  an!  sub 
categories  of  characteristics.  I'hese  sc  tent  1  f  i 
and  research  characteristics  have  been  corre¬ 
lated  with  areas  of  the  procurement  and  acqulsi 
; ion  processes. 

To  satisfy  the  first  and  second  objectives,  tin 
methodological  approach  of  semantic  content 
analysis  was  adopted.  From  ■t|e  ,n!ver:.e  of 

2Thcse  rategorics  were  adopted  from  tne  St  raver 
Lockwood  taxonomy.  See  references  3  ana  l-i  ftr 
further  discussion. 
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research,  the  population  called  procurement  and  to  suggest  a  detailed  procurement  taxonomy, 

research  was  chosen.  This  population  was  fur-  Information  for  this  area  was  gachered  from 

ther  narrowed  to  the  sub-population  of  procure-  existing  literature  and  personal  interviews 

rnenc  research  as  reported  in  the  "Proceedings"  (7,  9,  12  and  11). 

of  the  five  1)01)  Procurement  Research  Symposia.3 

The  analysis  consisted  of  a  census  of  the  total  In  the  firth  research  design  area,  the  design- 

sub-population  of  articles  in  these  "Proceed-  ing  of  a  detailed  algorithm  was  tnvisioned  to 

ings".  meet  the  third  objective.  This  algorithm  could 

be  employed  in  determining  wliethei  an  eitorl 

Te  validate  the  coding,  a  pilot  study  was  accom-  within  DOD  is  related  to  procurement  and  whether 

plished.  To  enhance  the  reliability  of  the  it  is  research.  The  algorithm  was  derived  from 

research  effort,  a  "targeL"  reliability  percent-  information  gained  from  the  content  analysis, 

ago  of  90 7.  was  achieved  during  the  pilot  study.  literature  reviews  and  personal  interviews  as 

Additionally,  during  the  analysis,  random  samples  noted  in  the  aforementioned  paragraph, 
of  articles  coded  by  one  researcher  were  recoded 
by  a  second  researcher  to  insure  consistent  and 

standard  results.  FINDINGS 


After  coding  the  data  for  each  "Proceedings",  a 
relative  frequency  count  of  occurrences  under 
each  digit  code  was  tabulated.  Each  digit  in 
ihe  seven-digit  code  represented  a  category  of 
science,  research,  the  acquisition  process,  or 
the  procurement  process.  The  first  digit  was 
coded  to  show  the  division  of  science  used  in 
the  research.  The  second  digit  was  coded  to 
show  the  breadth  of  application  of  the  research 
techniques  used.  The  third  digit  was  coded  to 
identify  the  amount  of  control  used  by  the 
researcher  and  where  the  research  was  conducted. 

The  fourth  digit  was  coded  to  determine  the 
love!  of  outcome  of  the  researcli  effort:  what 
could  be  said  about  tile  area  studied,  did  it 
describe  a  situation,  or  could  a  model  be  devel¬ 
oped  to  predict  future  events?  The  fifth  digit 
was  coded  to  indicate  the  level  of  effort  used 
in  the  researcli;  i.c.,  the  amount  of  time  and 
depth  of  effort  necessary  to  accomplish  the 
research.  The  sixth  and  seventh  digits  were 
coded  to  indicate  the  phases  of  the  acquisition 
and  procurement  processes  with  which  the  research 
was  concerned. 

In  the  second  design  area,  the  results  of  the 
content  analysis  were  combined  into  relative 
frequency  distributions.  Each  sub-category  was 
analyzed  to  determine  those  areas  of  procurement 
research  which  were  most  frequently  investigated 
and  which  characteristics  were  most  prevalent  in 
the  population. 

The  third  research  design  area,  defining  procure¬ 
ment  research  in  terms  of  characteristics 
evidenced  in  the  study,  was  addressed  using  the 
tabulated  data.  The  characteristics  of  research 
and  science  derived  from  content  analysis  were 
combined  with  information  obtained  from  litera¬ 
ture  reviews  and  personal  interviews  to  develop 
a  tentative  conceptual  definition  of  procurement 
research. 

The  fourth  area  of  research  design  was  planned 
to  classify  procurement  research  efforts  into 
various  areas,  as  stated  in  the  31  cond  objective, 

3The  research  for  this  study  was  conducted  prior 
to  the  publication  of  Che  Sixth  DOD  Procurement 
Research  Symposium. 
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Data  from  rhe  content  analysis  of  the  "Proceed¬ 
ings"  have  been  tabulated,  and  a  taxonomy  and 
algorithm  have  been  developed.  The  results  of 
the  concent  analysis,  which  are  listed  in  Table 
1,  showed  the  following  primary  areas  of  empha¬ 
sis  as  related  to  the  selected  criteria. 

TABLE  1  -  SUILtART  OF  FINOSNCS 

1.  DIVISION  OF  SCILI.CC-  SOCIAL  (*6l 

AD'TBACT/S.XUL  CAKSKTD  !*7I> 

}  SRflDTtl  OF  APPLICATION-  APPLIES  (MI) 

3.  OECP.EE  or  .  0NTR0L.  LIPNAlif  (Jl>) 

L .  LrvEL  or  OUTCOME  0ESCMIT1VL  (O'/ll 

f .  LEVEL  0?  EPPOBT:  PS0PiSrl0*l.-.L  PAffp/RFSiARCH  -CMOOPAPH  (E9I) 

6.  PIIASF  OF  TIE  ACQ.-ISITIOS  PROCESS: 

XORE  Tl1  AN  cut  PHASE  (SCI) 

HOT  CONCERNED  VITH  THE  ACWSW.  TPOCESS  (A7I) 

7.  PHASE  VP  THE  IROCUREXELT  PROCESS 

PRE-AVARS  (<7I) 

XORE  THAH  Okt  PHASE  <>jl> 

As  corollary  information  to  the  content  .-ip.3lvs'.<- , 
the  researchers  noted  the  source  of  each  article 
Of  Che  one  hundred  fourteen  (114)  articles,  the 
source  distribution  is  recorded  in  Table  2. 


TABLE  7  -  ARTICLE.  SOURCE  DISTRIBUTION 


ACSRCT 

KUHBER 

f£8CF'«7A0E 

DOD 

9 

ARRT 

19 

171 

WAVY 

1* 

m 

AIR  FORCE 

J9 

3fct 

K0H-D00 

Federal  A|»nel«i 

1; 

10* 

Frlvat*  Bu»fne«s/ 
Universities 

?? 

191 

The  initial  caxonomy  was  divided  into  five 
levels  of  procurement  research.  Each  level 
subdivided  the  previous  level  Jnto  more 


specif  it  areas  where  procurement  research  can 
he  identified. 


CONCLUSIONS 


The  results  of  the  research  suggested  the  fol¬ 
lowing  definition  of  procurement  research: 

Procurement  research  (and  acquisition  research) 
is  an  applied  science  using  the  characteristics 
of  the  soi ial  sciences  in  combination  with  mathe¬ 
matical  sciences  to  solve  procurement  problems. 

It  tends  to  roly  heavily  on  the  use  of  previ¬ 
ously  gathered  data  to  seek  solutions  to  prob¬ 
lems,  equally  dividing  its  efforts  between  the 
acquisition  piocess  and  the  procurement  process. 
In  the  jcquisit.'n  process,  emphasis  is  placed 
on  the  total  process;  while  in  che  procurement 
process,  emphasis  is  on  tlte  pre-award  phase  in 
an  eftort  to  identify  cost-related  problems. 

The  results  of  the  content  analysis  are  limited 
to  the  actual  sub-populatlo-.  Itself,  but  the 
sub-papulation  of  the  "Proceedings"  represents 
an  important  cross-section  of  recent  DOL  pro¬ 
curement  research  experience.  Information 
del  ived  I rom  the  analysis  of  this  sub-population 
can  suggest  important  charaef iristlcs  and  rela¬ 
tionships  of  other  pro. ureraenc  research  efforts. 

The  areas  of  emphasis  in  the  procurement  research 
of  the  "Proceedings"  were  identified  in  Che  con¬ 
tent  analysis.  Procurement  research  was  charac¬ 
terized  as  a  social  science  with  abstract  science 
combined  more  often  than  not.  Its  structure  is 
delimited  in  Figure  1.  F.f forts  were  primarily 
applied  to  solving  problems.  The  research  was 
primarily  avcoripl  ished  through  a  selected  aggre¬ 
gation  of  inform., t ion  (library)  and  the  level  of 
outcome  was  descriptive.  In  the  sub-population, 
the  level  of  effort  was  primarily  a  professional 
paper/research  monograph.  The  relationship  ot 
procurement  escarch  wich  the  acquisition  process 
showed  that  efforts  generally  involved  more  than 
one  phase  „<  *  he  acquisition  process  or  were  not 
concern  ;d  with  the  acquisition  process  at  all. 
Emphasis  in  Che  procurement  process  was  primarily 
in  the  pre-award  phase  with  many  articles  dealing 
wich  more  than  one  phase. 


necessary  to  build  a  model  of  this  process. 

Since  procurement  research  Is  concerned  with 
the  .irocureme:  t  process  and  the  procurement 
process  as  an  1  itegral  part  of  the  acquisition 
process,  a  taxonomy  of  the  procurement  proco'S 
can  serve  as  a  foundation  for  a  taxonomy  of 
procurement  research.  The  areas  and  issues 
pertaining  to  these  processes,  therefore,  also 
pci  tain  to  procurement  research.  These  areas 
and  issues,  as  related  to  the  procurement  pro¬ 
cess  were  the  local  point  of  this  research  and 
the  descriptors  of  the  research  taxonomy.  Con¬ 
ti  nt  analysis  provided  the  general  character¬ 
istics  of  procurement  research  and  a  partial 
structure  of  the  procurement  processes.  How- 
evei ,  to  complete  the  taxonomy  of  the  process, 
it  was  necessary  to  conduct  interviews  and  mak.- 
further  literature  reviews. 

The  taxonomy  was  constructed  to  displr-  ivi- 
levels  of  the  procurement  process.  The  tirst 
level  Is  che  procurement  process.  The  second 
level  is  the  three  phases  (Pre-Award,  Award, 
and  Post-Award).  The  third  level  is  comprised 
of  the  c vrles  that  make  up  each  of  the  phases. 

The  fourth  level  is  a  continuum  of  events 
(Procurement  Continuum)  that  descrihe  the 
necessary  actions  pertinent  to  the  life  ot  a 
"procurement".  The  fifth  level,  che  1 owe  it 
level  presented.  Is  composed  of  a  number  of 
issurs  related  to  each  of  the  events.  (See 
Figure  3.) 

The  research  effort  was  adjusted  as  che 
researchers  discovered  new  information  that 
impacted  the  definition  and  the  taxonomy.  The 
taxonomy  developed  by  the  researchers  is  out¬ 
lined  in  Figure  4.  Lastly,  an  algotithm  was 
developed  (see  Figure  S)  which  followed  the 
format  of  a  decision  flow  chart  with  eight 
decision  points,  all  of  which  (oxtcpl  one)  ru-st 
be  jnsvered  with  an  affirmative  response  he tare 
an  effort  can  be  considered  prut  virement  research. 
These  eight  decision  points  are  as  follows: 

1  -  Is  the  effort  concerned  with  satisfying 
a  perceived  POP  need?  Ts  the  effort  attempting 
to  solve  a  problem,  provide  insight  into  an 
Issue,  or  describe  a  problcn  within  the  DO!)? 
if  it  Is  not,  it  should  not  be  considered  for 
further  research. 


The  definition  of  procure  nt  research  and  the  2.  Is  the  research  effort  concerned  with 

classification  of  the  ch  acterlstics  of  procure-  the  acquisition  process?  If  the  answer  to  tin- 
raent  research  were  combined  with  the  information  is  negative,  a  sound  question  is  asked,  "Is 

from  che  interviews  and  the  literature  review  to  the  research  concerned  with  the  pi  o<  uresenl 

develop  the  taxonomy.  The  emphasis  for  che  process?"  (Nee  Figure  4  and  Table  3.)  if  t'i< 

taxonomy  has  been  to  cover  all  possible  areas  of  answer  to  this  Is  positive,  the  eftort  is 

procurement  research  as  suggested  by  various  retained  for  further  analysis. 

Information  sources. 

3 .  is  the  research  concerned  with  the  pro- 

Tho  procurement  process  is  the  foundation  upon  curemcnt  process?  Here,  che  efforts  judged* 

which  procurement  research  is  based  (see  Figure  aff Irmartvelv.  u- my  q-asti  •  2.  are  analysed 

2).  Procurement  research  can  Involve  both  the  a  cording  to  the  procurement  i  -  que-- 

procurement  and  acquisition  processes  and  their  t ions  as  set  forth  In  Table  3. 

Interrelationship.  Therefore,  to  construct  a 

taxonomy  of  procurement  research  focusing  pri-  4.  Does  the  effort  suggest  a  method  for 

marilv  -i  the  procurement  process,  it  was  Improving  the  knowledge  associates)  v. :  1 1> _ t *n- 
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PIC.URE  2.  THE  PROCUREMENT  PROCESS  ( PHASES )(9> 
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FIGURE  3.  LEVELS  OF  THE  PROCUREMENT  PROCESS 
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FIGURE  A  PROCUREMENT  TAXONOMY 
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PIOURE  5.  PROCUREMENT  RESEARCH  ALGORITHM 


TABLE  3 

CRITERIA  FOR  DETER  IMZNG  WHETHER  A  RESEARCH 
EPi  0°7  IS  I  rOCURf'ENT  RELtTtD 

1.  .'IT  CO’.CFRVED  WITH  ISSUES  PERVASIVE  TO  THE  PROCUREMENT 

t<r  (PROCUREMENT  ETFICS,  CONTRA"!  "AHAOEKEHT,  TRA1H- 

II.  3,  ORGANIZATION)* 

2.  IS  IT  RELATED  TO  REQUIRE  CUTS  DETERMINATION? 

).  IS  IT  CONCERNED  WITH  REQUIREMENTS  SPECIFICATION? 

A.  IS  IT  CONCERNED  WITH  ? F  ISSUANCE? 

5.  IS  IT  CO'.CBRHED  WITH  OTHER  ASPECTS  OF  THE  REQUIREMENTS 

cycle: 

6.  IE  IT  RELATED  TO  THE  RECEIPT  OP  A  PR? 

7.  IS  IT  CONCERNED  WITH  PRE-SOLICITATION  REVIEW? 

6.  IS  IT  CONCERNED  WITH  POr.UL  SOLICITATION  ISSUANCE? 

9.  IS  IT  CO.’CERNEJ  WITH  OThER  ASPECTS  OP  THE  PR/.NIPR  CYCLE? 

10.  ::  IT  CONCERNED  WITH  THE  RECEIPT  OP  RESPONSES  TO  SOLICI¬ 
TATION? 

11.  IS  IT  RELATED  TO  TME  TECHNICAL  EVALUATION  OP  RESPONSES? 

12.  IS  IT  CONCERNED  WITH  PROPOSAL  AUDITS? 

13.  IS  IT  CONCERNED  WITH  COST  ANALYSIS/PRICt  ANALYSIS? 
lb.  IS  IT  CONCERNED  WITH  PRE-NEGOTIATION  ISSUES? 

15.  IS  IT  CONCERNED  WITH  CONTRACT  NEGOTIATION? 

15.  IS  IT  CONCERNED  WITH  CONTRACTOR  SELECTION? 

17.  IS  IT  CO’.CERNED  WITH  OTHER  ASPECTS  OF  THE  SOLICITATION/ 
EVALUATION  CYCIE? 

18.  IS  IT  CONCERNED  WITH  S0V£  ASPECT  Of  THE  PRE-AWARD  PHASE? 

19.  IS  IT  CONCERNED  WITH  CONTRACT  FUNDING? 

20.  IS  IT  CONCERNED  WITH  CONTRACT  WRITING? 


2)  IS  IT  COHCFRNED  WITH  THE  RiVlfW  OF  A  CONTRACT  P"  ON  TO 
ANNOUNCEMENT  AND  PINAL  SIGNATURE? 

22.  :s  IT  CONCERNS  D  WITH  AWARD  ANNOUNCEMENT  PROCEDURES? 

23  1?  IT  CONCKRNFD  WITH  CONTRACT  DISTRIBUTION  PROCEDURES? 

2b.  IS  1“  CONCERNED  WITH  OTHER  ISSUES  OF  THE  AWARD  CYCLE  OR 
AWAPD  PHASE? 

25.  IS  I?  CONCERNED  WITH  THE  ASSIGNMENT  Or  THE  CONTRACT  FOR 
ADMIMSTRATXOJJ? 

26.  IS  IT  CONCERNED  WITH  CONTRACT  SYSTEM  COMPLIANCE? 

27.  IS  IT  CONCERNED  WITH  PERFORMANCE  HP ASUREMEM?  if  TFF  CON¬ 
TRACTOR? 

28.  IS  IT  CONCERNED  WITH  QUALITY  ASSUHANCE/PA0DUC7  ACCEPTANCE? 

29.  IS  IT  CONCERNED  WITH  COVTRACT  MODIFICATIONS'* 

30.  IS  IT  CONCERNED  WITH  PRODUCT  DELIVERY? 

31  IS  IT  CONCERNED  WITH  CONTRACTOR  PAYMtNT? 

32.  IS  IT  CONCERNED  WITH  CONTRACT  WARRANTIES* 

33.  IS  IT  CONCERNED  WITH  CONTRACT  DISPUTES? 

3b.  IS  IT  CONCERNED  WITH  HEI'.SDIbS  RESULTING  FROM  "ONTRACT 
DISPUTES? 

35.  IS  IT  CONCERNED  WITH  CONTRACT  COMF1 ETIOH  AND  CLOSE-OUT* 

36.  IS  IT  CONCERNED  Wir-  ANY  OTHER  ISSUES  OF  THE  CONTRACT 
ADMINISTRATION  CYCLE  OR  THE  rOST-AWARO  PHASE? 

37  IS  IT  CONCERNED  WITH  POST  CONTRACT  TSS JEF  SUCH  AS  Rl NEGO¬ 
TIATION? 

IF  THE  ANSWER  TO  ANY  OP  THE  ABOVE  QUESTIONS  IS  "YES*  THEN  THE 

EFFORT  IS  RELATED  TO  PROCUREMENT. 


procurement  process?  Three  general  questions 
can  be  asked  of  the  research  effort: 

a.  Does  it  increase  the  uncertainty  of  the 
procurement  process? 

b.  Will  the  suggested  results  of  the 
research  effort  provide  more  knowledge  of  the 
procurement  process,  knowledge  of  an  area  that 
has  not  been  investigated  before? 

c.  Does  the  effort  clarify  events,  areas, 
or  issues  in  the  process? 

5 .  Does  the  effort  address  an  identified 
requirement?  Before  passing  Judgment  on  the 
effort,  a  review  by  relevant  procurement  per¬ 
sonnel  should  be  obtained  to  establish  tht 
validity  of  the  undertaking.  If  Judged  nega¬ 
tively,  the  effort  should  be  discarded  or  held 
for  later  evaluation.  If  Judged  affirmatively, 
the  effort  passes  on  to  the  next  algorithm 
question. 

6.  Does  the  effort  sugp.es*  a  solution  or 
make  observations  that  can  alternately  improve 
the  procurement  process?  An  effort  that  is 
classified  as  procurement  research  should  be 
directed  toward  the  improvement  of  the  procure¬ 
ment  process. 

The  key  to  this  decision  point  In  the 
algorithm  is  that  the  researen  effort  contri¬ 
butes  to  the  improvement  of  the  procurement 
process  either  through  a  solution  to  an  existing 
problem  or  through  observations  that  may  lead  to 
the  understands,  ar.d  solutions  to  future  prob¬ 
lems. 
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7.  Pops  the  effort  suggest  a  practical  plan 
for  Implementation  or  utilization  of  the  per¬ 
ceived  results?  An  effort  may  be  directed  at 
the  ultimate  Improvement  of  the  procurement 
process.  It  may  suggest  a  solution  to  an  exist¬ 
ing  problem  or  it  may  be  used  as  a  "stepping 
stone"  to  solutions  of  future  problems.  How¬ 
ever,  if  tire  effort  suggests  using  implementa- 

t ion/util ization  procedures  and/or  techniques 
Chat  would  be  impractical,  the  effort  is  suspect. 

Application  of  this  decision  point 
requires  a  word  of  caution.  Implementation/ 
utilization  plans  suggested  by  some  research 
el  forts  may  be  deemed  Impractical  now,  only  to 
bo  proven  practical  at  some  future  point  in 
time.  This  fact  may  require  that  the  final 
deteri.i’nat 'on  oi  whether  some  research  efforts 
are  procurement  -osearch  needs  to  be  deferred 
to  a  later  date. 

8 .  Does  the  effort  have  characteristics  of 
the  scientitic  method7  Determination  of  whether 
the  effort  follows  the  scientific  method  is  made 
by  either  the  research  analyst  and/or  the  pro- 

i urement  manager  subjecting  the  effort  to  the 
series  of  questions  listed  in  Table  A.  (If  the 
effort  Is  proposed,  questions  (1-10)  would  be 
applicable,  but  if  the  effort  was  completed 
research,  all  questions  would  be  applicable.) 

If  negative  answers  were  obtained,  the  effort 
should  he  discarded,  or  returned  to  the 
researcher  for  reefarif ieation  and  rework  and 
then  returned  for  further  analysis  by  the 
research  approving  agency. '* 


.ABLE  » 

SCIENTIFIC  P.ETHOD  QUESTION  LIST 

1.  DOES  IT  DEFINE  THE  RUBBLE!*' 

2.  DOES  THE  EFFORT  SURVEY  EXISTING  FtRTINSDT  LITE-'ATUHE? 

;  HAS  THE  RESEARCHER  EVALUATED  I/ST  STUDIES  FOR  A[ F..ICABILITV 
TO  H’S  EFFOiT? 

J.  •  OES  THE  E"G.T  3UII.D  ON  "REVIOUSLY  DEVELOPED  ENOWLEOCS? 

5.  THE  SCOPE  Dt-INtJ  SI.;  SPECIFIED.  AND  ARE  THE  SPECIFIED 
OsWECTIVES  TO  l)L  HP.f  LISTED? 

0.  DoF.1  Tilt  EFFORT  SUGGEST  TEN  Tf  STING  OP  A  HYPOTHESIS  OH 
THE  hNSUERING  C  »  RER'-RCH  QUESTION? 

7.  IS  THERE  A  SPEC  Fir D  PLAN' 

9.  DOES  THE  EFFORT  LIST  AS5UK.TI0NS/LIHITATIDNS? 

V  ■  IR‘  v NT!1, G Y  LOGICAL  AND  APPROPRIATE  FOR  THE  OBJEC¬ 
TIVES  Slf o.t.ro' 

10  DOES  THE  EFFORT  GATHER  DATA  AND/OR  FACTS' 

11.  Alt!  THE  DATA  VALID  ANO  RELIABLE? 

12.  DOES  THE  E'ROT  REPORT,  DESCRIBE,  I  RELICT  OR  ExPI  UN’ 

13.  DO  CONCLUSIONS  -OGICAI  Lf  FLOW  PIIOM  THi,  DATA? 

1«  CAN  THE  EFFORT  HE  REPLICATED  TO  ACHIEVE  CONSISTENT  RESULTS? 

has  been  during  t lie  past  few  years.  From 
exposure  to  the  information  that  was  reviewed 
in  this  effort,  the  lesearoh  team  gained  an 
insight  into  procurement  research  and  herein 
suggest  what  procurement  research  should  tie: 

1 .  It  should  concern  the  acquisition  or 
procurement  processes.  Research  accomplished 
by  procurement  researchers  that  docs  not  involve 
the  procurement  or  acquisition  processes  mokes 
.in  Inefficient  use  of  limited  resources. 


Ibis  algorithm  suggests  that  a  certain  level  of 
effort  be  undertaken  by  the  researchers  who  pro¬ 
poses  the  study  prior  to  its  submission  to  the 
approving  agency  for  acceptance.  Resources 
available  to  the  procurement  research  community 
are  necessarily  limited  and  need  to  be  applied 
only  to  pertinent  research  proposals.  Time  and 
funds  cannot  be  ill-spent  on  poorly  defined 
researcli  proposals  that  return  marginal  results 
or  have  no  applicability  to  the  procurement 
process. 


WHAT  PROCUREMF.NT  RESEARCH  SHOULD  BE  .  . . 


The  previously  dlscusse  ’  .osearch  efforts  con¬ 
centrated  on  what  proem  -ment  research  is  and 


‘‘Managerial  questions  as  to  "who"  is  going  to 
accomplish  the  research  or  "where"  it  should  he 
done,  were  not  addressed  by  tills  algorithm. 

Thev  niton  Id  he  annweio.l  (asked!  bv  (lie  lesiMlih 
inauepul  mi  I  \  i(|ei  the  elloil  ban  h.’uu  tvleul  I 
r  ied  as  "piocui uuteitl  l  i-seaii-h".  riiese  quest  lorn, 
naturally  follow  tins  algorithm  and  not  only 
address  the  issue  u(  "who"  and  "where",  but  also 
"when"  it  will  be  studied  (if  not  ongoing)  and 
"what  funds  are  available". 


2 .  Procurement  research  should  seek  solu¬ 
tions  to  procurement  problems.  Procurement 
research  should  be  applied  research;  it  should 
he  concerned  with  seeking  solutions  to  problems 
laced  by  procurement  managers  and  personnel. 

3 .  Procurement  research  should  be  cost 
effective.  Procurement  researchers  should  con¬ 
cern  themselves  with  a  cost  analysis  of  their 
own  work.  If  the  research  can  be  performed  at 
a  lower  cost  external  to  the  oilginaling 
research  agency,  then  the  effort  should  be 
accomplished  externally. 

U .  Procurement  research  should  follow  the 
scientific  method.  The  "Proceedings"  indicated 
chat  procurement  research  did  follow  the  scien¬ 
tific  method  in  its  approach  to  problem  solving. 
Future  research  should  use  the  same  proccduies/ 
techniques. 

5 .  Procurement  research  should  he  unbiased 
Procure men:  research  should  report  true  finding- 
n. 'I  "channel"  iesi.lt<  to  suit  the  researchers. 
Uic  leseanhei  should  apply  l  Igor.si  .  subieii  le¬ 
fty  to  hi  lesearoh  .nil  lemaln  unbiased  in  his 
analysis. 

6 .  Procurement  research  should  mane  use  o f 
the  best  analytical  methods.  Poor  research 
techniques  waste  resources  and  provide  weak 


n 
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solutions  to  problems  chat  may  require  strong  implies  that  better  methods  are  perceived  for 

remedies.  A  careful,  thorough  evaluation  of  a  getting  the  task  done;  the  next  section  offers 

procurement  research  problem  can  suggest  the  recommondatlons  for  improving  procurement 

best  analytical  method  to  use  In  the  effort.  research. 


7 .  Procurement  research  should  be  original 
and  not  redundant.  Prior  to  doing  research, 
procurement  people  should  review  previous 
studies  and  ascertain  whether  a  new  research 
effort  Is  justified  or  whether  the  findings  of 
a  previous  study  are  sufficient. 

8.  Procurement  research  should  be  shared. 
Central  procurement  information  storage  facili¬ 
ties  should  he  accessible  to  all  procurement 
research  organizations,  internal  and  external 

to  the  Government.  Results  should  be  publicized, 
such  as  those  found  In  the  "Proceedings".  Only 
through  the  sharing  of  information  can  the  re¬ 
dundancy  be  reduced  and  resources  saved. 

9.  Procurement  research  should  be  simple, 
■yet  accomplish  the  task.  Procurement  research 
should  accomplish  its  specific  task  in  the  most 
direct  method  possible.  It  should  not  confuse 
the  problem-solving  methodology  with  techniques 
designed  to  impress  the  requester  while  hiding 
the  path  the  researcher  used  to  seek  his  solu¬ 
tion.  The  approach  used  by  the  researcher 
should  be  "fair  and  reasonable"  to  all  parties. 


COROLLARY  OBSERVATIONS  ON  PROCUREMENT  RESEARCH 


Experience  gained  during  the  course  of  this 
research  may  prove  enlightening  to  subsequent 
researchers.  These  observations  are  sumrnarized 
as  follows: 


RECOMMENDATIONS 


Further  studies  must  be  made  and  current  methods 
must  be  changed  in  order  fur  procurement  research 
to  be  Improved.  The  results  and  conclusions  from 
this  study  suggest  starting  points  for  further 
studies  and  alternative  courses  of  action  for 
current  methods  In  procurement  research.  Eight 
recommendations  for  further  study  and  procure¬ 
ment  research  improvement  follow: 


1 .  Add  research  studies  with  a  longei  range 
perspective  to  present  problem/response  type- 
studies.  The  addition  of  some  longer  range 
research  In  procurement  may  Identify  Influential 


factors  that  are  not  evident  in  the  short-range, 


reactive  approach. 


2.  Areas  of  procurement  research  el  fort, 
significant  research  progress,  and  research 
results  should  be  shared  with  the  procurement 
community.  The  area  of  sharing  infoimatfon  on 
procurement  research  is  essential  to  the  DOD 
procurement  community.  Further  research  should 
be  done:  (1)  to  research  the  extent  of  the 
problem  of  how  many  completed  procurement 
research  studies  do  noc  get  into  the  DOD  infor¬ 
mation  retrieval  systems  and  to  coirect  this 
deficiency  in  information  flow,  and  (2)  to  find 
a  means  to  identify  current  DOD  procurement 
efforts  in  progress  and  to  publicize  this  in¬ 
formation  on  a  regular  basis. 


1.  An  increasing  level  of  Interest  In  pro¬ 
curement  was  noted  as  a  definite  trend  during 
the  past  few  years. 

2.  The  annual  DOD  Procurement  Research 
Symposium  offers  an  excellent  means  for  sharing 
procurement  research  information;  however, 
often  other  research  efforts  and  results  are 
not  shared. 

.1.  Procurement  researchers  generally  do 
not  share  their  current  progress  or  projects. 

4.  Often  the  method  or  technique  that 
resulted  from  the  research  effort  could  be 
applied  to  other  problem  situations,  but  the 
researcli  itself  was  done  strictly  In  response  to 
one  problem.  General  research  to  improve  the 
overall  acquisition  and  procurement  processes 
was  lacking. 

5.  The  present  information  retrieval  sys¬ 
tems  do  not  provide  a  totally  accessible  system 
to  the  researcher. 


3.  The  DOD  should  adopt  the  taxonomy  devel¬ 
oped  in  this  research  effort  os  a  common  taxonomy 
of  procurement  research  for  use  by  Its  agencies. 

A  standardized  taxonomy  of  procurement  research 
would  allow  researchers  from  all  DOD  agencies 
to  establish  a  common  framework  for  communica¬ 
tion.  Not  only  would  researchers  be  on  a  common 
base,  but  procurement  people  coulJ  understand 
research  results  from  other  agencies  and  possi¬ 
bly  apply  new  and  bettor  techniques  to  their 
own  work.  The  procurement  research  taxonomy 
presented  In  this  study  could  he  a  logical 
starting  place  from  which  a  common  DOD  taxonomy 
could  be  expanded.  Finally,  a  common  taxonomy 
could  be  used  ns  a  data  base  lor  assigning 
descriptors  to  procurement  research  in  a  com¬ 
puterized  information  system. 


4 .  The  procurement  roseaicli  taxonomy  that 
is  suggested  In  this  study  should  be  <■ rlilcal ly 
analyzed  and  expanded.  The  taxonomy  is  an 
attempt  at  categorizing  the  procurement  process 
and  the  field  of  procurement  research.  Through 
further  study,  this  taxonomy  ■  ould  he  validated 


and  expanded  to  include  requirement  def Initlon 

These  corollary  observations  would  be  Incomplete  and  use  as  they  Impact  upon  procurement, 
without  some  suggestions  or  recommendations  for 
Improvement.  Indication  of  a  deficient  area 
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5 .  Further  algorithms  for  conducting  pro¬ 
curement  research  and  for  deciding  whether  to 
research  procurement  problems  should  be  con¬ 
structed  and  used.  During  the  construction  of 
the  algorithm,  the  resear*. here  had  much  diffi¬ 
culty  tn  establishing  a  perspective  from  which 

lu  iiuistruct  the  algorithm.  Procurement  research 
can  be  viewed  in  terms  of  a  given  output  or 
ongoing  process,  a  method  for  conducting  the 
research,  or  a  method  for  deciding  whether  a 
pr>  .urement  problem  should  be  researched  by  an 
01 gan i/at  Ion/ Individual .  Kutuie  efforts  should 
research  these  two  areas  to  provide  guidelines 
for  conducting  rhe  procurement  research  process 
and  for  making  the  important  decision  of  whether 
or  not  to  undertake  a  research  effort. 

6.  A  node!  fo-  DLSIE  (Defense  Logistics 
Systems  lftpi mat *on  Exchange)  abstracts  should 
be  dove  lotted  so  chat  key  words  would  provide 
ready  relevant  Information.  Research  should  he 
done  to  develop  a  model  for  writing  DLSIE 

, a, streets  so  that  <i  content  analysis  of  an 
nhstrii.'i  would  determine  key  words,  words  siml- 
1  <r  to  che  'buses,  cycles,  events,  and  Issues 
of  the  taxonomy  presented  fn  Figure  4.  Procure¬ 
ment  researchers  could  then  identify  those 
studies  relevant  to  their  areas  of  specific 
research  from  this  content  analysis  of  Clio 
abstract  s. 

7 .  A  sequential  analysis  of  procurement 
research  efforts  should  be  performed.  Hood  and 
Strayer "(5) "suggested  that  procurement  research, 
as  a  developing  discipline,  can  he  porttayed  as 
trn  islt  lotting  six  development  phases  In  a 
sequential  evolutionary  process  from  a  new 
discipline  to  lull  maturation.  The  significance 
of  this  evolutionary  process  or.d  Its  develop¬ 
mental  phases  is  that  each  phase  «111  '-■»**»  in 
terms  of  t..--  kinds  of  questions  or  issues 
addressed  am!  types  of  research  activity  con¬ 
ducted  within  each  phase. 

8.  Research  should  he  done  to  prioritize 
those  "issues"  of  the  m ocurement  research  tox- 
on  -iv  that  offer  the  gre  ■  test  opportunity  for 
cost  savings  and  Improvement ■  An  analynis  at 
the  "issue"  level  ot  the  procurement  research 
taxonomy  could  identify  those  areas  that  are 
costly  to  Implement,  difficult  to  administer, 
and  subject  to  frequent  d’l.iy,  as  well  as  those 
areas  that  offer  the  gr-  .est  benefits  to  the 
DOD,  che  public,  and  industry.  A  prloi ity  system 
of  procurement  research  issues  would  identify 
chose  areas  that  should  receive  the  most  rtsea-ch 
emphasis.  Limited  resources  could  be  applied  to 
"Issues"  from  the  top  down  so  that  the  most 
Important  areas  are  reiiesrched  first. 


SUMMARY 


The  result  of  this  ffort  is  only  the  first  step 
toward  Icflnlng  and  structuring  procurement 
rescan  h.  It  will  be  up  to  che  procurement  com¬ 
mon!, y  as  to  whether  this  Initial  effort  is 


accepted  and  used.  This  definition  and  taxonomy 
offer  a  basis  which  researchers  can  use  to  mote 
closely  define  procurement  research  and  its 
relationship  to  the  procurement  process,  while 
the  algorithm  provides  the  rescarchei  or  pro¬ 
curement  manager  with  a  logical  process  to 
evaluate  the  research  el  fort  as  to  Its  appl  lia¬ 
bility  to  procurement. 

Lastly,  observations  on  "What  Procurement 
Research  Should  Be  ...”  and  recommendations  for 
furthe,r  research  were  offered  to  the  procuiement 
community  as  a  means  of  accelerating  the  evolu¬ 
tionary  process  of  procurement  research. 
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LEADTIME  MANAGEMENT,  A  KEY  TO  MATERIALS  MANAGEMENT 


Captain  Robert  W.  Menestrlna,  USAF,  l!S,  CPL,  CPCM,  CPM 
FOREWORD  GENERAL  MANAGEMENT  CONCEPTS 


This  paper  is  a  condensed  version  of  a  paper 
presented  to  the  12th  Annual  International 
Symposium  of  che  Society  of  Logistics  Engineers, 
August,  1977.  (6)  Additional  information  on 

this  subject  is  available  from  the  author  upon 
request. 

Opinions  expressed  herein  ere  solely  those  of 
the  author  and  are  not  those  of  the  United 
States  Air  Force. 


INTRODUCTION 


The  reason  for  exploring  this  subject  was  the 
generally  perceived  failure  of  the  Air  Force 
Local  Purchase  System  to  meet  the  Department 
of  Defense  (DOD)leadtime  standards  for  order 
and  ship  time.1-  This  perceived  failure  was 
also  recognized  by  requisitioners  who  wer"  ag¬ 
gravating  the  situation  by  increasing  the 
priority  of  their  lccal  purchase  requisitions. 

After  careful  study  and  data  collection  (5) 
several  findings  emerged  concerning  local  pur¬ 
chase  leadtime  management:  1.  The  DOD  order 
and  ship  time  standards  arc  based  upon  a  norma¬ 
tive  concensus  of  expert  logisticians'  opinions 
of  what  leadtimes  ought  to  be,  rather  than  some 
positive  measure  of  actual  leadtimes.  2.  Cur¬ 
rent  DOD  order  and  ship  time  standards  are 
averages  and  not  upper  control  limits.  3.  Ac¬ 
tual  overages  are  being  compared  with  the  DOD 
standards,  but  a  truncation  rule  used  to  cal¬ 
culate  the  actual  averages  causes  a  large  down¬ 
ward  bias  in  the  calculated  averages. 

The  conclusion  of  this  preliminary  study  was 
that  current  order  and  ship  time  standards  and 
the  current  heavily  biased  truncated  average 
do  not  provide  adequate  tools  to  identify  and 
manage  local  purchase  leadtime. 

This  paper  is  an  attempt  to  develop  the  tools 
and  methodology  necessary  to  a  Department  of 
Defense  installation  level  or  a  Commercial 
plant  level  leadtime  management  system.  Ve 
will  discuss  some  general  management  concepts, 
the  use  of  statistics  to  reduce  uncertainty, 
current  leadtime  research,  special  considera¬ 
tions  in  the  plant  level  environment,  and  a 
case  study.  We  will  then  draw  conclusions  from 
this  discussion. 


1.  Order  and  ship  time  is  measured  from  the 
dace  the  customer  submit*  a  requisition  until 
the  dace  the  material*  *re  received  by  the 
supply  activity. 


The  manager  combines  resources  (men,  money,  and 
materials)  uses  the  classic  management  func¬ 
tions  (plan,  organize,  staff,  direct  end  con¬ 
trol)  and  trades  off  production  factors  (cost, 
quality  and  time)  to  take  his  enterprise  pro¬ 
ductive.  He  must  also  manage  his  function 
within  an  environment  of  constraints  and  uncer¬ 
tainty.  This  relationship  can  be  visualized  in 
.  Exhibit  1,  below. 


EXHIBIT  1 
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The  manager  has  developed  cost  and  quality 
management  systems  to  control  only  two  of  these 
production  factors.  This  paper  addresses  a 
management  system  for  the  third  production 
factor  —  Time. 

In  addition,  the  uncertainty  of  leadtime  plan¬ 
ning  is  a  key  reason  micro-analysis  of  lead time 
is  critical  for  effective  base  and/or  plant 
level  materials  management. 

By  assuming  leadtime  is  constant,  the  materials 
manager  is  acting  counterproductively  because 
his  assumption  of  s  fixed  leadtime  increases 
uncertainty  and  increases  costs. 

A  good  example  of  the  problem  caused  by  assum¬ 
ing  constant  leadtimes  can  be  found  if  we  look 
at  the  Economic  Order  Quantity  model  (EOQ) . 

The  ECQ  reorder  point  is  a  function  of  both  the 
rate  of  demand  and  a  reorder  leadtirae  that  Is 
usually  assumed  to  be  fixed.  If  the  actual 
lcadtime  varies  and  is  greater  than  the  assumed 
fixed  leadtime,  we  have  induced  unforeseen 
backorders  and  have  increased  costs. 
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LEADTIME  AND  UNCERTAINTY 


The  manager  can  reduce  uncertainty  with  the 
help  of  statistics,  probability  theory,  and 
control  limits.  If  the  manager  can  form  sub¬ 
groups  with  similar  traits  that  approximate  a 
normal  distribution,  he  can  assume  a  normally 
distributed  leadtitr.e.  By  using  a  normally  dis¬ 
tributed  mean  and  standard  deviation,  he  can 
then  Identify  and  possibly  reduce  uncertainty 
regarding  expected  leadtime. 

For  example,  if  after  data  collection,  a  nor¬ 
mally  distributed  group  is  found  to  have  a  mean 
of  40  days  and  a  standard  deviation  of  10  days, 
we  can  develop  a  table  showing  the  probability 
of  o: e  item  being  delivered  on  or  before  a 
specific  number  of  days  after  the  order  was 
placed.  (Exhibit  2) 


EXHIBIT  2 


SINCLE  ITEM  LEADTIME  PROBABILITY 
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.d  Dev  (SD) 

(Days) 
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This  Information  can  also  be  used  to  improve 
projections  of  delivery  cf  multi-item  bills  of 
material.  The  probability  of  success  for  on 
time  delivery  of  a  multi-item  bill  of  material 
is  extremely  sens  •  ive  to  Che  company's  lead- 
time  planning  r.n’losophy.  This  can  be  demon¬ 
strated  by  uuinn  the  previous  example  and  cal¬ 
culating  the  pr..5abllity  of  on  time  delivery 
success  for  mulci-ltem  bills  of  material. 
(Exhibit  3) 


base  level  customers  are  only  told  the  average 
order  and  ship  time  from  a  source  of  supply. 

As  shown  above,  the  probability  of  delivery  by 
the  average  leadtime  is  only  50%  for  one  item 
and  this  probability  rapidly  diminishes  if  the 
customer  has  a  multi-item  bill  of  material. 

By  developing  a  planning  leadtime  policy  that 
considers  probability,  we  can  have  a  powerful 
tool  to  cut  costs  and  reduce  uncertainty. 

Developing  a  control  limit  provides  the  final 
tool  needed  to  design  a  viable  leadtime  manage¬ 
ment  control  system.  If  in  our  example,  the 
company  chose  to  audit  every  demand  those  lead- 
time  exceeded  the  mean  and  three  standard 
deviations  (after  70  days)  then  the  company 
would  only  ne>d  to  audit  one  percent  of  the  in¬ 
dividual  demands.  Such  a  control  limit  would 
pinpoint  the  worst  cases,  require  minimum  audit 
support,  and  identify  major  problems.  By  solv¬ 
ing  problems  relating  to  these  extreme  cases, 
not  only  will  the  average  leadtime  be  reduced, 
but  the  solution  probably  will  have  general  ap¬ 
plication  to  many  of  the  other  99%  of  demands. 


CURRENT  LEADTIME  RESEARCH 


Current  leadtime  research  is  very  limited. 

(See  Bibliography)  Ic  is  related  to  production 
quantities,  central  purchase  activities,  or 
nation  wide  >tudles  of  commodities  or  Indus¬ 
tries.  But  these  studies  may  not  directly 
apply  to  a  base  or  plant  level  materials  man¬ 
ager  bee  use  of  their  Macro  viewpoint,  one-time 
data  collection,  large  staffs  to  apply  complex 
research  techniques,  emphasis  on  production 
quantities,  end  the  different  organizational 
environment  of  a  centralized  purchase  activity. 
Because  of  these  differences,  we  must  identify 
special  conciderations  in  the  environment  of 
the  base  or  plant  level  materials  manager  be¬ 
fore  we  can  design  a  leadtime  management 
s;  tem. 


EXHIBIT  .3 


MULTI-ITEM  LEADTIME  PROBABILITY 
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In  this  example,  the  company  would  have  only  a 
3%  chance  of  obtaining  five  items  within  40 
days,  but  they  could  Improve  the  probability  of 
on  time  receipt  If  they  planned  for  a  lcadtlme 
greater  than  tl.c  mean  leadtime.  Currently,  DOD 


SPECIAL  CONSIDERATIONS 


The  local  environment  of  the  base  and  plant 
level  materials  manager  is  different  from  that 
of  corporate  level  management.  Because  of  this 
local  environment,  It  is  important  to  address 
the  following  special  local  considerations  when 
designing  a  base  or  plant  level  leadtlroe  man¬ 
agement  system. 

1.  Simplicity:  As  in  any  system  requiring 
data  collection,  the  simpler  and  m.,re  under¬ 
standable  the  entire  system,  the  more  likely 
the  people  who  must  provide  the  data  will  co¬ 
operate  and  provide  accurate  data. 

2.  Cost  Effectiveness:  Cost  canrn  ex- ecd 
benefits. 
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3.  Computerization:  A  computer  is  helpful, 
but  not  essential.  The  author  used  a  hand 
calculator  (11P-80)  to  calculate  the  statistics 
in  the  case  study. 

4.  Variability:  The  first  line  materials  man¬ 
ager  is  concerned  with  an  extremely  wide  and 
variable  range  of  demands. 

5.  Statistical  Process  Control  Techniques: 

The  materials  manager  can  use  a  leadtiae  man¬ 
agement  system  to  identify  groups  with  unusual¬ 
ly  high  leadtimes. 

6.  Sensitivity:  The  plant  level  leadtimes  are 
extremely  sensitive  to  both  external  changes 
(03HA  or  oil  crisis)  and  internal  changes  (ab¬ 
sence  of  key  employees). 

7.  Criticality  of  Small  Orders:  The  plant 
level  material  manager  is  as  concerned  with 
critical  small  orders  as  he  is  with  production 
qu-ntity  orders. 

8.  Large  Humber  of  New  First-Time  Demands. 

9.  Standard  Leadtime  Definition:  A  standard 
leadtime  definition  must  be  agreed  to  by  all 
customers  and  functional  managers. 

10.  Continuous  Data  Collection:  Because  of 
the  criticality  of  small  orders  and  the  sensi¬ 
tivity  to  change,  leadtime  data  collection  must 
be  continuous. 

U.  Process  Management:  The  leadtiae  manage¬ 
ment  system  is  a  process  management  rather  than 
a  project  management  technique.  The  manager  is 
able  to  control  a  multitude  of  demands  by  use 
of  a  limited  number  of  control  points. 

12 •  The  Materials  Acquisition  Assembly  Line: 
All  materials  management  personnel  are  part  of 
a  paper  assembly  line  called  "materials  acqui¬ 
sition  process".  This  i3  a  key  concept. 

13-  Coordination:  The  plant  level  materials 
manager  has  the  advantage  of  more  opportunities 
for  close  coordination  with  his  functional 
counterparts. 

14.  Suboptomlzlng  Leadtimes:  The  overall 
leadtime  should  be  minimized  rather  than  mini¬ 
mizing  only  the  leadtime  of  some  segment  of  the 
materials  acquisition  process. 

15.  Wide  Range  of  Improvements:  The  various 
functional  managers  have  many  tools  to  improve 
leadtimes,  but  changes  should  be  coordinated 
and  controlled  to  prevent  suboptomlzatlon 
and/or  the  formation  of  new  problems. 

16.  System  Study  Improves  Leadtimes:  Even  it 
a  full  leadtime  management  system  is  not  prac¬ 
ticable  for  a  specific  bate  or  plant,  the  act 
of  system  study  will  cause  improved  leadtimes. 


CASE  STUDY 


The  concepts  listed  above  were  used  in  a  case 
study  of  7500  actual  local  purchase  demands 
during  a  nine  month  period  on  an  Air  Force 
Base.  (5)  The  results  of  this  case  was  that 
item  leadtimes  were  dramatics! ly  improved, 
material  acquisition  system  discipline  improv¬ 
ed,  as  did  functional  cooperation.  All  the 
participants  in  the  study  had  a  better  under¬ 
standing  of  the  material  acquisition  process, 
and  they  better  understood  the  need  for  realis¬ 
tic  planning  leadtimes.  These  findings  were  so 
positive,  the  author  strongly  urges  expanded 
development  and  use  of  leadtime  management 
systems. 


HOW  TO  DESIGN  A  LEADTIME  MANAGEMENT  SYSTEM 


After  all  the  above  considerations  are  includ¬ 
ed,  a  leadtime  management  system  can  be  design¬ 
ed  by  the  materials  manager.  Listed  below  are 
14  important  points  to  use  when  designing  a 
leadtlme  management  system: 

1.  KISS  (Keep  It  Simple,  Stupid) 

2.  Group  like  itema. 

3.  Track  new  first-time  demands  separately, 

4.  Track  repetative  demands  separately. 

5.  Track  leadtlme  overtime. 

6.  Calculate  average  and  standard  deviation 
of  each  group. 

7.  Plot  group  frequency  distributions. 

8.  Set  upper  control  limit  (UCL). 

9.  Audit  leadtimes  greater  than  UCL. 

10.  Pinpoint  worst  cases. 

11.  Develop  statistical  smoothing  techniques. 

12.  Establish  n  viable  leadtlme  planning 
policy. 

13.  Communicate  actual  leadtimes  to  request¬ 
ors. 

14.  Celebrate  success  with  employees  on  the 
Materials  Acquisition  Assembly  Line. 
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CONCLUSION 


Tht  challenge  offered  the  materials  manager  is 
to  develop  h.'.s  own  leadtime  management  system. 
The  effort  is  worthwhile  because  of  many  bene¬ 
fits.  First,  costs  will  be  controlled  and  un¬ 
certainty  reduced.  Second,  as  with  any  type  of 
system  analysis,  the  materials  manager's  study 
of  his  own  material  acquisition  process  will 
give  him  greater  and  more  detailed  understand¬ 
ing  of  the  existing  system.  Third,  a  leadtime 
management  system  offers  a  method  for  more 
intense  coordination  among  base  or  plant  level 
functional  managers.  Finally,  a  leadtime 
management  system  can  assist  in  improving  the 
morale  of  those  personnel  processing  documents 
and  property  along  the  materials  acquisition 
process  assembly  line. 

By  developing  and  using  a  leadtime  management 
system,  the  base  and  plant  level  materials  man¬ 
ager  can  improve  both  the  certainty  of  leadtime 
estimates  and  the  actual  leadtime  performance. 
When  leadtimc  management  Joins  the  cost  and 
quality  control  systems  as  a  standard  manage¬ 
ment  system,  only  then  can  lendtime  management 
become  a  key  to  materials  management. 
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HOW  TO  GET  WHAT  YOU  WANT,  WHEN  YOU  WANT  IT 


0.  M.  Sawyer,  Jr. 


ABSTRACT 


For  a  short  while  now,  I  have  been  dealing  with 
.  "stones  weiqht,"  "fortniqhts,"  and  the  varying 

"pound  sterling."  To  say  the  least,  in  an 
atmosphere  where  your  rate  of  exchange  varies 
from  SI. 55/pound  to  $1.98  per  pound  in  a  short 
period  of  time  requires  a  certain  amount  of 
advanced  planning.  Overseas  contracting  does 
have  some  rather  unique  peculiarities;  however, 
after  having  been  involved  in  the  procurement 
process  on  both  sides  of  the  Atlantic,  I  think 
many  of  the  techniques  involved  are  basically 
the  same. 

Perhaps  the  major  difference  in  overseas  con¬ 
tracting  efforts  is  that  it  is  more  of  a  team 
concept.  In  addition,  due  to  a  somewhat  slower 
life  style,  the  planning  and  initial  contract 
stage  must  be  started  much  earlier.  Here 
aqain,  I  think  this  should  apply  to  Stateside 
contracting.  One  of  our  major  contracting 
problems  is  that  not  enough  thinking  and  plan¬ 
ning  is  done  at  the  start  to  fully  describe 
and  explain  what  we  really  want  to  buy.  Many 
tines  we  get  exactly  what  we  asked  for  only  to 
'w  find  it  is  not  what  we  really  want.  In  con¬ 

tracting,  the  drawing  board  and  pen  are  vastly 
superior  to  the  written  word.  In  like  manner, 
the  spoken  word  is  worth  nothing  at  all. 

This  paper  deals  with  conmonly  occurring  con¬ 
tracting  problems  that  all  of  us  face,  in  knowing 
what  we  want,  but  not  being  able  to  describe 
it;  it  costs  too  much;  I  need  It  now;  and  "who 
ordered  this  thing?" 

The  central  part  of  the  paper  concerns  procure¬ 
ment  techniques  that  have  been  found  useful  and 
methods  to  avoid  some  pitfalls.  The  paper  con¬ 
cludes  with  a  recommended  cookbook  recipe  for 
good  contracts.  This  recipe  is  by  no  means  all 
inclusive  but  serves  only  as  a  good  guideline 
for  a  wide  range  of  contract  types. 

The  guiding  theme  of  the  paper  is  the  absolute 
necessity  to  plan  your  entire  contract  effort 
well  in  advance  and  to  involve  all  procurement 
resources  available  to  you  in  a  combined  team 
effort. 


ENHANCED  PROCUREMENT  PROCEDURES  FOR  PROCUREMENT  OF 
ELECTRONIC  WARFARE  (EW)  EQUIPMENT 

Harlon  Judd 

Air  Coitmand  and  Staff  College 


ABSTRACT 


This  study  will  review  the  current  Armed  Ser¬ 
vices  Procurement  Regulations  (ASPR)  and  Air 
Force  Systems  Coirmand  (AFSC)  procurement  guide¬ 
lines  that  relate  to  rapid  procurement  of  EW 
equipment.  Various  regulatory  and  policy 
guidelines  will  be  reviewed  as  well  as  recent 
periodicals  and  other  unpublished  research  proj¬ 
ects  that  provide  current  government  thinking 
on  rapid  procurement  techniques. 

Current  procurement  lead  times  will  be  con¬ 
trasted  to  the  expedited  procedures  set  forth 
in  Quick  Reaction  Capabilities  (QRC)  regulations. 
Four  ieadir.g  defense  contractors  of  EW  equipment 
have  been  offered  an  opportunity  to  provide  an 
industry  input  to  this  study. 

The  current  trend  at  HQ  USAF  does  not  permit 
easy  approval  of  QRC  procedures.  Therefore, 
alternative  procurement  methods  will  be  sug¬ 
gested.  Of  course,  the  alternative  methods 
are  less  desJrable  than  the  QRC  process  and 
will  require  official  sanction  before  they  can 
be  implemented.  The  study  will  conclude  with 
recommendations  concerning  future  procurement 
procedures. 
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HOW  TO  IMPROVE  CONTRACTING  PRODUCTIVITY  DY  MODELING  THE  CONTRACTING  PROCESS 


Peter  Gardiner 

University  of  Southern  California 


ABSTRACT 


Managing  the  contracting  process  involves  three 
*  major  concerns:  (1)  allocating  human  resources, 

(2)  meeting  time  deadlines,  and  (3)  maintaining 
contract  quality  control.  As  demands  increase 
to  produce  more  contracts  in  less  time  with 
fewer  human  resources,  contract  quality  will 
suffer  unless  the  productivity  of  the  contract¬ 
ing  process  is  improved.  This  paper  proposes 
one  way  of  systematically  studyinq  contractinq 
productivity,  where  contractinq  is  the  process 
which  produces  a  document  called  a  contract. 

The  central  idea  is  that  the  contracting  pro¬ 
cess  can  be  modeled,  much  as  many  production 
processes  have  been  modeled,  and  that  througn 
modeling,  areas  for  improving  productivity  can 
be  identified  and  the  tradeoffs  among  resource 
allocations,  time  deadlines,  and  quality  control 
made  explicit.  While  the  idea  of  modeling  the 
contractinq  process  is  a  general  one,  and  there 
are  many  modeling  techniQues  available,  this 
paper  presents  one  simplified  example  usina 
Mor.te  Carlo  simulation  to  illustrate  the 
approach.  The  paper  concludes  by  discussing 
how  such  a  productivity  improvement  research 
■w  program  could  be  established  in  practict.  Iden¬ 

tifying  some  of  the  techniques  available,  and 
suggesting  what  some  of  the  eventual  benefits 
of  such  a  program  might  be. 
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STATISTICAL  RISK  ASSESSMENT  IN  STRUCTURING 
AND  MANAGING  THE  LOGISTIC  SUPPORT  COST  COMMITMENT 


Dwight  E.  Collins 
Logistics  Management  Institute 


I.  INTRODUCTION 


Dui  nig  the  past  few  years,  the  management  con¬ 
cept  ol  "Design  to  Cost"  (DTC)  has  been  Imple¬ 
mented  with  considerable  success  by  the  DoD.  A 
variety  of  system  and  equipment  acquisition  pro¬ 
grams  have  incorporated  an  average  unit  flyaway 
(rollaway,  or  sailaway)  cost  target  in  t he 
Jevelopment/production  contract  early  In  the 
development  phase,  in  order  to  control  piogram 
costs  throughout  the  development  jnd  production 
processes.  As  experience  In  Implementation  ol 
the  DTC  concept  has  accumulated,  however,  there 
has  developed  a  widespread  awareness  of  the  need 
for  broadening  It  to  encompass  not  only  develop¬ 
ment  and  production  costs  but  also  operating  and 
support  (OAS)  costs.  Indeed,  DoD  Directive 
5000.28  (5:3]  states  that  "as  the  ability  to 
translate  OAS  costs  elements  into  'design  to* 
requirements  Improves,  Design  to  Cost  goals  may 
be  extended  Into  this  area."  It  also  states 
that,  at  a  minimum,  "the  major  operating  and 
support  cost  factors  shall  have  goals  estab¬ 
lished  In  the  form  of  measurable  numbers  (e.g., 
numbers  of  OAS  personnel,  reliability  and  main¬ 
tainability  factors,  etc.)  which  can  be  moni¬ 
tored  during  test  and  evaluation  as  well  as  In 
opeiation.”  The  doint  Logistics  Commanders' 
Design  to  Cost  Guide  [4:2 1-24 1  also  stresses  the 
need  for  contractual  OAS  cost  goals  which  arc 
"design  dependent,  predictable,  and  verifiable." 
In  addition,  it  emphasizes  the  need  for  formu¬ 
lating  OAS  cost  goals  In  terms  of  dollars, 
stating  that  "In  order  to  balance  all  the  ele¬ 
ments  of  production  and  operating  and  support 
costs  with  performance  and  schedule,  ...  it  is 
necessary  to  convert  the  measures  of  reliability 
and  maintainability,  such  as  MTBF  and  MTTR,  into 
expressions  of  cost." 

The  DoD  has  begun  to  experiment  with  several 
techniques  designed  to  transmit  DoD  OAS  cost 
goals  to  the  Contractor.  One  such  mechanism 
used  by  the  Air  Force  In  several  recent  procure¬ 
ments  Is  the  logistic  Support  Cos”  Commitment 
(l.SCC) ,  sometimes  referred  to  as  a  Support  Cost 
Guarantee.  The  LSCC  has  three  key  elements: 

1.  A  target  logistic  support  cost  (TLSC), 
defined  In  terms  of  a  logistic  support 
cost  (LSC)  model  framework 

2.  A  field  verification  test  procedure. 
Including  computation  of  a  "measured" 
logistic  support  cost  (MLSC) 

3.  A  contract  remedy  or  price  adjustment, 
which  is  a  function  of  verification  test 
results  (particularly  the  MLSC). 


Two  procuremeuis  in  wliiiTi  ill-  LSCC  has  boon 
Incorporated  are  the  AN/ARN-101  tactical  I.ORaN, 
managed  bv  the  Ai:  Force  Electronics  Systems 
Division  (ESD)  at  Hanscom  AFB ,  Mass.,  and  the 
F-16  aircraft,  inanag"d  by  the  Air  Force  Aero¬ 
nautical  Systems  Division  (ASD)  at  Wrlght- 
Patterson  AFB,  Ohio.  In  the  ruse  of  the  F-16, 
the  LSCC  Is  In  effect  at  two  levels.  First, 
there  exists  a  "system-level"  TLSC,  a  target 
LSC  with  respect  to  the  aggregate  of  280  of  the 
aircraft's  line  replaceable  units  (LRl'Sl.  The 
LSCC  includes  a  mult i  —ini  1 1  ion  dollar  award  tv< 
provision  with  respect  to  this  large!  but  no 
negative  Incentive.  Second,  there  exists 
TLSC  specifically  utLh  respect  to  lliree  o!  tt.o 
aircraft's  high  cost  LRUs:  the  fire  contiol 
radar,  the  electro-optical  (E-0)  display,  and 
the  E-0  display  electronics.  The  LSCC  includes 
provisions  for  both  positive  and  negative  con¬ 
tract  adjustments  with  respect  to  this  latter 
TLSC. 

This  paper  summarizes  results  of  recent  re¬ 
search  into  the  statistical  risks  associated 
with  structuring  and  managing  the  LSCC.  Par¬ 
ticular  attention  Is  paid  to  the  Impact  ol 
statistical  risk  on  the  interpretation  of  test 
results  relative  to  the  contractual  target. 

The  paper  presents  several  critical  insights 
Into  the  statistical  risk  properties  of  the 
LSCC  and  discusses  how  these  Insights  can  be 
utilized  in  structuring  future  LSCCs.  It  dem¬ 
onstrates  the  Importance  of  a  clear  and  ade¬ 
quate  asaessment  of  these  risks  as  a  precondi¬ 
tion  to  the  effective  use  o2  contractual  OAS 
cost  targets  by  the  DoD  in  its  efforts  to 
reduce  system  and  equipment  life  cycle  costs. 


II.  THE  ROLE  OF  THE  COST 
MODEL  FRAMEWORK 


The  LSCC  uses  a  simplified  cost  model  framework 
to  represent  Government  LSCs  as  a  function  of 
Contractor-controllable  equipment  logistics 
parameters  in  the  manner  recommended  by  the 
Joint  Logistics  Commanders'  Design  to  Cost 
Guide  [4:23-24].  Figure  1  reflects  in  LSC 
framework  typical  of  those  used  in  recent  LSCt. 
applications.  (A  list  of  model  parameter  defi¬ 
nitions  ■  pears  in  Appendix  A.)  Such  a  cost 
mode!  framework  (CMF)  Is  usually  developed  bv 
program  office  or  acquisition  management  staft 
personnel  and  provided  to  competing  contractors 
as  part  of  the  LSCC  provisions,  ultimately 
becoming  part  of  the  negotiated  contract.  The 
CMF  establishes  a  basis  for  formal  communica¬ 
tions  between  Contractor  and  Government 
regarding  LSCs. 
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FIGURE  1.  A  TYPICAI.  l.SC  HOPEI  FRAMEWORK* 


C(  -  ni.it  of  Initial  spare  Items 

-  (Cost  of  base  repair  pipeline  spares)  +  (Cost  of  depot  repair  pipeline  spares) 

-  (M)  (RTK)  (UC)  +  [(PFFH)(UF)«)PA)(1  -  RIP)  (NRTS) /(hTBP)  1  (DRC3)(UC) 

whore  STK  Is  the  minimum  value  of  1  such  that 

XBO(i,  At)  -  X  (x  -  1)  P(x|At)<  EBO,  l’(x | X t)  Is  Poisson,  and 
xM 

/  (PFFH) (UF) (QPA) ( 1  -  RIP.)  \  / 

Xt  - (M)'(MTBF) - )  (  (RTSHBRCT)  +  (NRTS) [(OSTCON) (1  -  OS)  +  (OSTOS)(OS)) 

C,,  »  cost  of  ou-cqulpment  maintenance 

-  (total  mean  number  of  fallurea)  x  (average  on-equlpment  repair  cost  per  failure) 

-  'I(TFHI)  (UF)  (QPA) /MTBF]  x  [PAMH  +  (RIPl(IMH)  +  (3  -  RIP)  ( RMH) ]  x  BLR 
C.j  •*  cost  of  off-equlpment  maintenance 

»  (total  mean  number  of  off-equlpment  repairs)  x  (average  coat  per  off-equlpment  repair) 
“  ( (TFFH)  ( UF)  (QPA)  (1  -  RIP)  /MTBF ]  x  [ (KTS) (BMH) (BLR  +  BMR)  +  (NRTS)  (DMH)  (DI.R  +  DMR)  ] 


Uhere  possible,  definitions  (see  Appendix  A)  and  symbology  appearing  In  thlB  typical  LSC  model 
framework  are  Identical  to  those  used  In  the  Air  Force  Logistic  Command's  LSC  Model.  This 
model  is  described  In  [3].  A  further  assessment  of  the  model  as  ■  tool  for  comparison  of 
competing  systems,  trade-off  analysis,  program  cost  and  performance  tracking,  and  trend 
evaluation  can  be  found  in  [1]. 


The  underlined  parameters  In  Figure  1  (e.g., 

MTBF  and  NRTS)  reflect  hardware  logistics  chnr- 
'ncterlstlcs  over  which  the  Contractor  haa  a 
degree  of  control  through  his  design  engineering 
process.  These  are  typically  targeted  by  the 
Contractor  In  the  equipment  proposal.  Subse¬ 
quently,  they  are  estimated  or  "measured"  during 
a  field  verification  teat,  which  covers  u  period 
of  from  3,000  to  6,000  hours  of  operation  of  the 
equipment  in  Its  field  environment.  Virtually 
all  remaining  model  parameters  (e.g.,  M  «  number 
of  bases  to  which  the  equipment  will  be  deployed) 
describe  the  environment  in  which  the  equipment 
will  operate  and  be  molnt  ned,  and  are  supplied 
by  the  Government  with  t  model  framework. 

The  negotiated  contract  includes  a  target  LSC 
(TLSC)  which  reflects  the  LSC  impact  of  the 
various  Contractor-targeted  equipment  logistics 
parameters.  This  target  exists  In  addition  to 
ether  cent raminl  goalr  and  targets  such  as  a 
".‘U-  '•‘M  -vvi-Agy  VMt  HV-sVety.  ••■•‘w 

plot  loti  ol  the  Held  verification  fust,  "sums 
urod"  values  uf  these  parameters  are  Inserted 
Into  the  CMF  In  place  of  their  corresponding 
Cnncrsclor-targetad  valueu  and  the  resulting 
coat  value  Is  called  the  measured  LSC  (ULSC) . 

A  posit t-e  or  negative  contract  sdjuatmnnt  la 
made  an  n  function  of  whether  the  Contractor 


meets  or  underruns  hla  LSC  target  (MLSC  £  TLSC) 
or  overruns  It  (MLSC  >  TLSC) . 


III.  CHARACTERIZING  THE  RISKS 
AND  CONTROL  PARAMETERS 


The  statistical  risks  underlying  the  LSCC  can 
he  completely  described  in  terms  of  the  fol¬ 
lowing  four  quantities: 

1.  Statistical  risk  to  th«  Contractor 

2.  Statistical  risk  to  the  Government 

3.  Length  of  the  verification  teat  period  In 

total  weapon  system  operating  hours  (»T)  » 

A.  An  MLSC  threshold  above  which  a  contract 
i omedv  Is  required. 

trie  IhlWfeftoUJ  is  tosM*  gives  it 

I  irgei  than  the  TLSC.  Lei  this  quant  It v  bv 
■'tilled  the  tymody  thicdiold,  denoted  hv  XT. 

It  Is  convenient  to  be  able  to  oxpi o  i he 
remedy  threshold  In  term*  of  tome  lector  <s1> 
times  the  TLSC.  Let  the  expression  TF, 
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Best  Available  Cop 


rctlcct  this  jthreshold  factor.  By  this 
convent (on , 

RT  -  TF  x  'fl.SC. 


1 1 1 . 1 


The  development  of  the  TLSC  by  the  Contractor 
In  his  equipment  proposal  can  be  Interpreted  as 
Ills  assertion  that  the  underlying  true  popula¬ 
tion  ISC  value,  MMLSC,  to  be  estimated  by  the 
MLSC  will  be  less  than  or  equal  to  the  TLSC, 
i.e.  , 


MMLSC  <  TLSC 


111.2 


The  LSCC  also  addresses  the  possibility  that 
the  Contractor's  assertion  may  be  false,  l.e., 
that 


MMLSC  >  TLSC. 


III. 3 


The  basic  decision  rule  incorporated  In  this 
LSCC  Is  (1)  to  seek  no  contract  remedies  if  the 
MLSC  does  not  exceed  the  remedy  threshold,  i.e., 
if 


MLSC  <  TF  x  TLSC, 


III. 4 


and  (2)  to  seek  the  remedy  or  negative  adjust¬ 
ment  if  the  threshold  is  exceeded,  l.e.,  If 


MLSC  >  TF  x  TLSC, 


111.5 


The  interval  from  the  TLSC  to  RT  -  TF  x  TLSC 
represents  a  margin  of  safety  In  the  Contrac¬ 
tor's  favor. 

The  statistical  risk  to  the  Contractor  under 
the  LSCC  Is  simply  the  probability  that  the 
Oovernment  will  reject  his  equipment  when, 
Indeed,  he  has  met  or  underrun  his  target.  Let 
us  call  this  probability  a.  In  terms  of  the 
conceptual  framework  presented  above,  a  is 
simply  the  probability  of  getting  an  MLSC  value 
that  suggests  rejection  of  the  Contractor's 
equipment  when  in  reality,  the  underlying  LSC 
value,  MMLSC,  which  the  MLSC  Is  estimating,  is 
less  than  or  equal  to  his  target,  i.e., 

a  ■>  Ft (MLSC  >  TF  X  TLSC | MMLSC  <  TLSC). 

III. 6 

In  order  to  develop  an  analogous  expression  for 
Government  risk,  we  first  define  TLSC'  to  be 
the  Government's  "rejection  target,"  that  Is,  a 
specified  value  of  MMLSC,  greater  than  the 
remedy  threshold  RT  -  TF  x  TLSC,  at  .hich  the 
Government  wants  to  ensure  a  high  probability 
of  rejection.  The  statistical  risk  to  the 
Government  under  the  LSCC  Is  defined  to  be-  the 
probability,  henceforth  called  B,  of  getting  an 
MLSC  value  that  suggests  acceptance  of  the  Con¬ 
tractor's  equipment  when  indeed,  he  hss  actually 
overrun  his  target  to  the  extent  that  MMLSC  - 
TLSC',  l.e., 


8 


PrfMLSC  <  TF  x  TLSC|MMLSC  »  TLSC’). 

III. 7 


We  henceforth  refet  to  a,  (1,  T  and  TF  a*  the 
"control  parameters"  of  the  LSCC. 


IV.  THE  RISK  ASSESSMENT  MODEL 


As  part  of  the  study  described  In  this  paper, 
a  risk  assessment  model  was  developed  which 
explicitly  Incorporates  the  mathematical  rela¬ 
tionships  among  the  four  control  parameters 
defined  above.  The  relationships  Indicate 
that  a  change  in  the  value  of  one  parameter 
cannot  be  achieved  without  a  change  in  the 
value  of  at  least  one  of  the  other  three.  For 
example,  a  change  In  test  length  (T) ,  holding 
the  threshold  factor  (TF)  co  Hant,  results  in 
changes  in  both  Contractor  risk  (.t)  and  Govern¬ 
ment  risk  (B).  Alternar ivelv.  a  decrease  In 
Contractor  risk,  holding  the  threshold  fa< tor 
constant,  can  he  achieved  only  at  the  expense 
of  an  Increase  in  test  length.  Or  if  test 
length  must  be  held  constant  but  the  threshold 
factor  is  allowed  to  vary,  a  decrease  in  con¬ 
tractor  risk  can  be  achieved  by  Increasing  the 
threshold  factor.  However,  this  also  results 
In  an  Increase  In  Government  risk. 

Because  of  the  complexity  of  the  CMF  used  in 
the  LSCC,  the  relationships  among  the  control 
parameters  arc  difficult  to  formulate  pre¬ 
cisely.  This  complexity  can  be  overcome 
through  efficient  computer  programming  of  the 
model,  however.  Such  a  s"t  of  programs  ran  he 
used  as  a  vehicle  for  explicit  consideration 
of  trade-offs  among  the  four  parameters.  The 
example  below  illustrates  the  kinds  of  insights 
and  information  that  it  can  provide. 


EXAMPLE 


Suppose  that  an  1.SCC  is  to  be  incorp 'rated  in 
the  procurement  of  an  item  of  avionics  having 
an  average  unit  production  cost  of  $40,000- 
$63,000  and  an  MTBF  ranging  from  400  to  600 
hours.  Suppose  that  the  Figure  1  CMF  is  used 
for  the  development  of  each  bidder’s  TLSC  and 
subsequent  measurement  of  the  MLSC  in  the  case 
of  the  winning  Contractor,  henceforth  called 
Contractor  A.  In  particular,  suppose  that  the 
Government-furnished  program  parameters  and 
verification  rent  parameters  are  as  shown  In 
Figure  2  and  the  equipment  logistics  parameter 
targets  for  Contractor  A,  along  with  Covet n- 
raent  rejection  targets  are  os  shown  In  Figure  3. 

The  flying  hour  values  In  Figure  2  r»presont 
official  program  office  flying  schedule  pro¬ 
jections,  while  the  repair  cycle  times  and 
labor /material  rates  have  their  origins  In 
Air  Force  base  and  depot  maintenance  and  sup¬ 
ply  accounting  systems.  The  test  length  of 
3,000  hours  represents  a  figure  negotiated 
between  the  program  office  and  the  Item  u-ing 
command.  The  threshold  factor  of  1.25  was 
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developed  through  negotiation  between  Con¬ 
tractor  A  and  the  Government. 


FIGURE  2.  VALUES  OF CMF  PARAMETERS  UNRELATED 
TO  EQUIPMENT  CHARACTERISTICS 


PROGRAM 

PARAMETERS 

PFFH 

“  i5,000  hrs. /mo. 

BLR  - 

$11. 70/hr 

TFFIi 

-  1,500,000  hrs. 

BMR  - 

$  2.28/hr 

BRCT 

»  .13  mo. 

DLR  > 

$12. 44/hr 

DECT 

“  1.84  mo. 

DMR  » 

$  6.72/hr 

TEST  PARAMETERS 

T  “  3,000  hrs . 

TF  -  1.25 

Note:  Refer  ro  Appendix  A  for  parameter 
definitions. 


FIGURE  3.  VALUES  OF  CMF  EQUIPMENT-RELATED 
PARAMETERS 


CONTRACTOR  A  TARGETS  (TLSC  “  $1,250,000) 

UC  »  550,000 
MTBF  -  500  hrs. 

UF  *  ..0,  QPA  =1.0 

Repair  Level  and  Man-Hour  Parameters 

RIP  RTS  NETS  PAMH  IMH  RMH  BMH  DMH 

U.  Bound  0.0  .99  .20  .50  0.0  2.0  9.0  10.0 

Target  0.0  .90  .10  .25  0.0  1.0  5.0  10.0 

L.  Bound  0.0  .80  .01  .10  0.0  .10  1.0  10.0 

GOVERNMENT  REJECTION  TARGETS 

(TLSC'  ”  $1,900,000) 

Same  as  Contractor  A  except  for  MTBF  -  325  hrs. 


Contractor  A's  equipment  item  has  an  average  unit 
production  cost  target  (UC)  of  $50,000,  a  target 
MTBF  of  500  hours,  and  a  TLSC  of  $1,250,000  (sue 
Figure  3).  The  remaining  parameter  targets  cor¬ 
responding  to  this  TLSC  e  fraction  of  In-place 
repairs  •  0.0,  fraction  f  base  repairs  -  .90, 
etc.  in  addition  to  hlo  parameter  targets. 
Contractor  A  has  provided  his  estimate  of  the 
range  of  values  that  his  equipment  parameters 
may  ultimately  assume  In  the  form  of  upper  and 
l.mei  bounds.  These  ranges  are  required  to 
Uuw.jilj*  a  sseeui'MIfnl  AoSooufkant  (Volt  act  .*• 
ami  liiivtliiuuuftl  statistical  risks. 

The  cost  ovoirun  value  at  which  the  Government 
wants  to  guarantee  o  high  probability  of  equip¬ 
ment  rejection  In  this  example  is  TLSC'  - 
$1,900,000.  This  "rejection  target"  la  abo  it 
50Z  greitei  than  Contrnctoi  A's  target.  It  cor- 
leap.mds  to  repair  level  and  manpowri  pararwii-r 


targets  identical  to  the  Contractor's,  but 
decremented  MTBF  target  of  325  hours.  In 
other  words,  the  Government  would  like  to 
guarantee  rejection  in  the  case  where  Conti nc- 
tor  A  achieves  an  MTBF  of  only  32“-  hours  while 
meeting  all  his  remaining  parameter  targets. 

Note  that  both  the  target  and  bounds  for  tin 
depot  man-hour  figure  (DMH)  are  10  hours  In 
Figure  3.  This  Is  due  to  the  exclusion  of  t  le 
parameter,  depot  man-hours,  from  me  Sit  of 
parameters  to  be  verified  because  the  rela¬ 
tively  low  equipment  NRTS  rate  would  result  In 
an  extremely  small  number  of  depot  repairs 
during  the  verification  test  period  and  hence, 
a  statistically  inadequate  sample  upon  which 
to  base  an  estimate  ol  actual  DMH. 


VI.  RISK  ASSESSMENT  RESULT" 


For  these  CMF  parameter  values  and  in  pniticu- 
lar  a  test  period  of  3,000  flying  hours  and  a 
threshold  factor  of  1.25,  the  Contractor  and 
Government  statistical  risks  are  reflected  in 
Figure  4.  The  Connactor's  probability  of 
having  his  equipment  rejected  when  he  has 
actually  met  his  TLSC  ranges  approximately  from 
.23  to  .32  with  a  most  likely  value  of  .28. 

The  Government’s  probability  of  equipment  ac¬ 
ceptance  when  its  rejection  taiget  has  been  met 
ranges  from  .26  to  .35  with  a  most  likely  value 
of  .32.  The  existence  of  a  range  ol  risks  fot 
each  party,  as  opposed  to  a  single  point  risk, 
is  a  distinctive  property  of  the  l.SCC.  Its 
cause  is  the  relative  complexity  of  the  CMF 
used  for  development  of  the  TLSC  anil  MI.SC.  The 
size,  of  each  risk  range  is  partially  a  function 
of  the  estimated  ranges  for  the  impair  level 
and  man-hou.  parameters  appearing  In  Figure  3. 
However,  sensitivity  analyses  with  the  risk 
assessment  model  have  shown  that  the  sizes  of 
the  risk  ranges  are  relatively  insensitive  to 
minor  revisions  in  estimates  of  the  paiameter 
ranges  that  might  occur  during  negotiation  of 
the  l.SCC  terms  and  conditions. 


FIGURE  4.  RISK  ASSESSMENT  RESULTS 
(Representative  Case) 


Contractor  Risk  *  Pr(Covt.  Rejects 
Equipment  When  Contractor 
Target  is  Met)  -  o 

a  -  .28,  .73  <  a  <  .32 

i.evenma.'.t  Risk  -  PrtGovt  t(  i 

Kqui,*aeut  Rlion  llovt .  K,  • <  '  : 
Target  Is  Mel)  -  b 

P  -  .  12 .  .  26  -  U 


Hence,  the  existence  of  risk  ranges,  though  It 
nay  make  the  1  SCC  risk  piopertlr*  ivhtl'  mote 
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difficult  to  understand  and  interpret,  does 
not  constitute  a  serious  weakness  of  the  LSCC 
structure. 

The  size  of  the  risks  appearing  in  Figure  4  is 
another  matter.  These  risks  are  high  when 
viewed  either  in  terms  of  their  most  likely 
values  or  their  ranges,  and  uouid  very  likely 
be  interpreted  as  unacceptable  in  a  real-world 
setting.  The  reason  for  this  is  that  eight 
parameters  (MTBF,  RIP,  RTS,  NRTS ,  PAMH,  IMH, 

RMH,  and  BMH)  are  being  verified  simultaneously 
and  the  variabilities  of  the  individual  parame¬ 
ter  estimates  are  combining  through  the  CMF  to 
produce  a  high  variability  in  the  MI.SC.  Since 
the  concept  of  simultaneous  verification  of 
several  logistics  parameters  is  central  to  the 
application  of  I.SCCs,  the  likelihood  of  high 
risks  is  an  intrinsic  property  of  the  LSCC  when 
it  is  defined  with  respect  to  a  single  equip¬ 
ment  item. 

Experience  with  the  risk  assessment  model  sug¬ 
gests  that  in  many  cases,  steps  can  be  taken  to 
reduce  these  risks  with  a  minimal  dilution  of 
verification  objectives.  Two  approaches  are 
described  in  Figure  5.  The  first  is  to  reduce 
the  number  of  parameters  to  be  verified.  Ver¬ 
ifying  only  MTBF  instead  of  all  eight  logistics 
parameters  in  our  example  reduces  Contractor 
risk  (most  likely  value)  from  .28  to  .22  and 
Government  risk  from  .32  to  .24.  A  variety  of 
related  strategies  exists.  One,  for  example, 
consists  of  verifying  all  eight  parameters  but 
defining  two  separate  MI.SCs:  one  (say  MLSC^) 
with  MTBF  being  held  constant  at  its  target  and 
the  remaining  seven  being  estimated,  and  the 
other  (MLSC2I  with  just  the  opposite  configura¬ 
tion,  and  then  defining  MLSC  as  the  average  of 
ILSCj  and  MI.SC2-  This  strategy  reflects  a  small 
reduction  in  verification  potential  to  achieve 
much  more  favorable  risk  characteristics. 


Figure  5.  risk  assessment  results 

(Alternative  Approaches) 


REDUCING  THE  SET  OF  PARAMETERS  TO  BE  VERIFIED 

-  Same  as  Representative  Case  except  only 
MTBF  is  subject  to  verification  and  all 
remaining  parameters  are  assumed  to 
achieve  Contractor  targets 

-  Contractor  Risk  «  a  =  .22(.28) 

-  Government  Risk  “8s  .24 (.32) 

INCREASING  TEST  LENGTH 

-  Same  as  Representative  Ccse  except 
T  -  10,000  hrs.  (3,000  hrs.) 

-  Contractor  Risk  »  a  z  .19(.2A) 

-  Government  Risk  -  8  =  .20(.32) 


Figure  5  also  reflects  the  Impact  oi  Increased 
test  length  In  the  case  In  which  all  eight 
parameters  are  verified.  It  show  that  by  in¬ 
creasing  T  from  3,000  hours  to  10,000  hours, 
Contractor  risk  can  be  reduced  from  .28  to  .19 
and  Government  risk  from  .32  to  .20.  This 
result  illustrates  the  general  fact  that  because 
of  certain  statistical  properties  of  the  CMr, 
dramatic  increases  in  test  length  lend  not  to 
bring  about  commensurate  reduction  in  riskb. 

If  a  further  risk  reduction  is  desired,  other 
changes  can  be  explored,  e.g.,  a  change  in  the 
threshold  factor  (TF),  a  redefinition  of  the 
Government's  rejection  target  (TLSC'),  or  even 
minor  changes  in  the  CMF. 


VII.  AGGREGATION  OVER  SEVERAL  ITEMS 


A  particularly  notable  property  ot  th  LSCC 
clarified  by  risk  assessment  mode]  analyses  is 
that  statistical  i  i  sks  can  hi-  reduced  by  apply 
ing  the  LSCC  to  a  group  of  items,  in  which  com' 
a  single  TLSC  is  developed  for  the  aggregate  of 
items  instead  of  separate  TLSCs  for  each  indi¬ 
vidual  item.  Figure  6  illustrates  this  proports . 
Suppose  an  LSCC  is  implemented  with  respect  to 
the  procurement  of  three  items,  all  to  be  pro¬ 
duced  by  the  same  contractor,  and  that  the 
average  unit  costs  and  target  MTBTs  for  the 
winning  bidder  again  called  Contractor  A,  are 
ns  shown  (where  it  is  assumed  for  purposes  of 
illustration  that  the  remaining  eight  parameter 
targets  for  all  three  items  are  identical  to 
those  used  in  the  original  single  item  example 
in  Figure  3). 

If  a  TLSC  were  defined  for  the  first  item  inly, 
the  Contractor  risk  would  be  .28  (must  likely 
value  of  range)  and  the  Government  risk,  assum¬ 
ing  a  rejection  target  of  TLSC'  •  1.5  X  TLSC 
(resulting,  again,  only  from  a  decremented 
MTBF)  would  be  .32. 


FIGURE  6.  AGGREGATION  UNDER  THE 
LSC  COMMITMENT 


AGGREGATION  REDUCES  STATISTICAL  RISKS 

-  Item  1:-  UC  -  $  50,000,  MTBF  »  500  hrs.: 

a  -  .28,  8  (1.5  x  TLSC)  -  .32 

-  Item  2:  UC  -  $  75,000,  MTBF  -  250  hrs.: 

a  -  .22,  8  (1.5  x  TLSC)  «  .26 

-  Item  3:  UC  «  $100,000,  MTBF  -  150  hrs.: 

a  -  .17,  8  (1.5  x  TLSC)  -  .21 

-  Items  1,  2,  and  3  in  Aggregate: 

a  -  .10,  8  (1.5  x  T1.SC)  «  .10 


Figure  6  shows  similar  results  for  Items  2  and 
3,  assuming  individual  targets  and  the  same 
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threshold  factor,  TF  =  1.25,  in  each  case.  The 
progressively  lower  risks  result  from  an  in¬ 
creasing  ratio  of  test  period  length  (again, 
3,000  hours)  to  MTBF,  which  reflects  the  like¬ 
lihood  of  more  failures  being  verified  and  con¬ 
sequently,  increasing  statistical  confidence. 

Figure  6  indicates  that  by  summing  the  targeted 
LSCs  for  the  three  items  and  defining  the  formal 
commitment  TLSC  in  terms  of  this  sum,  a  rather 
dramatic  reduction  of  both  Contractor  and 
Government  risks  to  .1  is  achieved.  The  cause 
of  this  reduction  is  the  existence  of  statisti¬ 
cal  independence  of  verification  test  data 
among  items.  This  independence  has  a  smoothing 
effect  on  the  MLSC. 

The  property  of  reduced  risk  under  aggregation 
is  noteworthy  and  suggests  that  use  of  the  LSCC 
should  be  given  serious  consideration  as  an  I.SC 
reducing  mechanism  in  procurements  where  the 
possibility  of  cost  aggregation  exists.  How¬ 
ever,  iwo  caveats  should  be  noted.  The  first 
deeis  with  the  passing  down  of  LSCC  provisions 
from  the  Prime  Contractor  to  his  subcontractors. 
Suppose  ar  LSCC  is  Implemented  with  respect  to 
an  aggregate  of  items  under  a  prime  contract 
and  risk  analyses  indicate  that  the  negotiated 
threshold  factor  and  test  length  reflect  accept¬ 
ably  low  risks  to  both  the  Government  and  the 
Prime  Contractor.  Considerable  caution  should 
be  used  by  the  Prime  if  he  passes  down  essen¬ 
tially  the  same  form  of  LSCC  provision  on  an 
item-by-item  basis  to  his  subs.  If  subcontract 
remedies  o.  price  adjustments  are  based  on  the 
tame  threshold  factor  and  test  length,  subcon¬ 
tract  statistical  risks  may  be  prohibitively 
high.  The  likelihood  of  this  occurrence  may 
call  for  the  substantial  modification  of  LSCC 
structure  at  the  subcontract  level,  e.g. ,  a 
provision  for  additional  verification  testing 
of  certain  items  at  the  expense  of  the  Prime 
Contractor . 

The  second  caveat  deals  with  the  masking  of  bad 
reliability  and  maintainability  performance  of 
individual  items.  When  an  LSCC  is  implemented 
in  the  aggregate,  it  is  possible  that  one  or 
two  items  will  have  exceptionally  high  measured 
LSCs  during  the  verification  test,  but  the 
aggregate  target  will  still  be  met  due  to  the 
offsetting  effect  of  lo"  measured  LSCs  for  the 
remaining  items.  From  he  point  of  view  of 
cost,  such  an  occurrence  does  not  reflect  a 
problem,  since  the  Government's  primary  concern 
is  with  aggregate  I.SC  and  the  LSCC  has  presuma¬ 
bly  shown  whether  the  aggregate  cost  target  has 
or  lias  not  been  met. 

out  tlib  |..ud(lt|ttt  toay  yoflosM  a  b'«t 
problem  from  ton  point  of  view  of  total  weapon 
system  readiness,  since  the  one  or  two  poor 
performing  items,  while  not  causing  prohibi- 
ttvulv  high  aggtegntc  LSC,  may  ultimately  he 
prime  t'muiuu  of  weapon  system  down  time  In  the 
field.  There  ate  no  simple  solutions  to  this 
problem.  One  possible  alternative  is  the  use 
of  a  contractual  target  on  readiness  at  the 


weapon  system  level  in  conjunction  with  an 
aggregate,  LSCC.  Such  a  set  of  dual  macro  tar 
gets.  If  they  could  be  unambiguously  defined, 
woultl  have  the  effect  of  controlling  aggregate 
costs  of  support  resources  utilized  while  pre¬ 
venting  tne  logistics  performance  of  any  one 
item  from  getting  too  far  out  of  line.  The 
formulation  of  system  level  targets  on  readiness 
that  functionally  incorporate  subsystem  per¬ 
formance  is  not  an  easy  task,  however,  and 
requires  further  research. 


VIII.  THE  FUTURE  ROLE  OF  RISK  ASSESSMENT 


The  risk  assessment  procedures  discussed  in  this 
paper  provide  the  Government  with  a  powerful 
new  tool  to  reduce  the  life  cycjc-  tests  of 
military  hardware.  They  add  considerable  sub¬ 
stance  to  the  concept  of  the  LSCC  and  their 
development  has  numerous  implications  for  the 
structuring  and  management  of  the  I.SCC. 

"he  risk  assessment  procedures  can  be  used  to 
cevelop  LSCC  structures  that  maximize  Contiactor 
incentive  to  reduce  real  Government  Incurred 
LSCs  while  maintaining  statistical  risks  to 
Contractor  and  Government  at  acceptable  lev.  Is. 
For  example,  the  impact  of  alternative  CMFs  oi. 
the  relationships  among  the  control  parameters 
(a,  6,  T  and  TF)  can  be  assessed  in  a  rigorous 
manner.  This  capability  can  pave  the  way  for 
development  of  CMFs  which  adequately  represent 
the  costs  of  actual  equipment  demands  for  logis¬ 
tic  support  resources  while  reflecting  (1)  mini¬ 
mal  risks  to  Contractor  and  Government,  (2)  a 
threshold  factor  (TF)  value  which  is  a< ■  eptable 
In  the  contract  negotiating  environment,  and 
(3)  a  test  length  (T)  value  that  i*.  realistic 
vis-a-vis  using  command  objectives  and  operating 
constraints.  The  procedures  con  also  be  used 
ia  this  experimental  mode  lo  isolate  ihose 
classes  of  equipment  which,  due  to  the  nature 
of  their  demands  on  supply  and  maintenaiuc  re¬ 
sources,  would  be  particularly  well  suited  for 
use  of  the  LSCC.  For  example,  experimentation 
to  date  suggests  that  cquipmentn  exhibiting 
relatively  lower  unit  costs  or  requiring  fixed- 
length  overhaul  intervals  tend  to  result  In 
lower  statistical  risks. 

Having  developed  an  explicit  relationship  among 
the  four  control  parameters  of  the  LSCC,  we  can 
now  make  some  significant  observations  regarding 
how  these  parameters  should  be  set  in  a  real- 
world  contracting  environment.  It  would  be 
desirable  to  be  able  to  determine  values  for 
all  four  parameters  during  development  of  the 
f.-i  pr  •;•<•.«. 1  i  ,  K>'pl  fe~  -  bpc  !■«.'{  in¬ 
clusion  in  At.  ’ii  i  <  wvuiJ  petei  - :  <*c*«  ^tv-* 
studies  of  tiade-otts  among  tin-  four  i  .!.«!>  , 

by  Government  pet  1 .  lliiri,'.'rnoro1  it  would 

provide  both  Government  and  (  ...i  ,  with 
time  to  study  the  LSCC  statistic,  ill,  <  harac- 
teristicn  prior  to  negotiation  of  detailed 
terms  and  conditions  of  the  LSCC. 
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Such  a  prim  determination  of  control  parameter 
values  cannot  be  made,  however,  because  precise 
assessments  cannot  be  generated  until  the 
Contractor's  targets  for  nil  parameters  to  he 
vert l ion  are  known,  in  othoi  words,  various 
risk  properties  ot  tlie  ISI'O  naturally  *111  lor 
from  one  bidder  to  the  next.  Consequently, 
only  preliminary  estimates  of  risk  characteris¬ 
tics  based  on  Government  assessment  of  industry 
capabilities  and  experimental  runs  of  the  risk 
assessment  model  can  be  undertaken  prior  to 
receipt  of  bidders'  proposals,  in  view  of  this 
constraint,  a  possible  scenario  for  determina¬ 
tion  of  parameters  is  described  as  follows: 

Step  1:  An  upper  bound  on  a  *  Contractor  risk 
Is  Incorporated  by  the  Government  In  the  RFP 
as  a  guaranteed  condition  of  the  LSCC. 

Step  2:  Each  bidder  submits  a  TLSC  with  tar¬ 
gets  for  parameters  to  be  verified  as  part 
of  his  proposal  and  the  Government  selects 
a  source  for  equipment  development  and 
production. 

Step  3:  Subsequent  to  contract  award,  the 
Government  Inserts  the  winning  bidder's 
parameter  targets  and  Government  rejection 
targets  Into  the  risk  assessment  model  and 
trades  off  test  length  (T) ,  threshold 
factor  (TF) ,  and  B  «  Government  risk  sub¬ 
ject  to  the  upper  bound  on  u,  until  a  set 
of  control  parameter  values  that  minimizes 
expected  tSCC  costs  to  the  Government  is 
found. 

Tli is  scenario  provides  an  explicit  limit  on  sta¬ 
tistical  risk  to  the  Contractor  well  in  advance 
of  negotiation  of  detailed  terms  and  conditions 
of  the  LSCC,  while,  at  the  same  tlue,  attempting 
to  provide  maximum  flexibility  to  the  Government 
in  Its  search  for  a  minimum  expected  cost 
position. 


IX.  CONCLUSIONS 


The  research  summarized  in  this  paper  has  led 
to  several  broad  observations: 

-  The  use  of  a  simplified  cost  model  framework 
as  a  basis  for  logistics  targets  and  measure¬ 
ments  provides  a  mechanism  for  focusing  Con¬ 
tractor  design  efforts  on  equipment  characteris¬ 
tics  affecting  failure  rates  and  repair  require¬ 
ments  commensurate  with  the  relative  Impacts  of 
these  characteristics  on  LSCs.  However,  the 
framework  must  be  developed  with  care  to  ensure 
that  it  sumoarlzes  these  cost  Impacts  accurately 
while  simultaneously  being  simple  enough  to  be 
interpreted  without  confusion  in  a  contracting 
environment. 

-  Analytical  techniques  described  In  this  paper 
can  be  used  to  assess  trade-offs  among  alterna¬ 
tive  LSC  Commitment  model  frameworks,  risks, 


thresholds,  and  test  lengths.  Through  this 
analysis,  those  LSC  Commitment  configurations 
that  most  effectively  convey  Government  LSC 
reduction  goals  to  the  Contractor  can  be  found. 

The  s  Ituu  I  i  aiipoUB  vet  1  f  i  eat  f  ,*n  „f  Kpveial 
logistics  pararaeteis  In  he  operational  envi- 
icntrent  called  for  by  the  LSC  Commitment  tends 
t-  tesult  In  either  high  statistical  risks  to 
Coniractor  and  Government  or  unacceptably  long 
field  ver;tication  test  periods.  The  tech¬ 
nique  of  applying  the  LSC  Commitment  with 
respect  to  an  aggregation  o."  equipment  items 
results  in  reduced  risks,  and  hence  may  provide 
a  workable  solution  to  this  problem.  But  the 
technique  has  the  potential  drawback  of  masking 
poor  logistics  performance  of  a  small  number  of 
equipment  Items  In  the  aggregation.  While  this 
attribute  is  not  a  matter  of  primary  concern 
from  the  standpoint  of  aggregate  LSC  expendi¬ 
tures,  it  may  contribute  to  reduced  visibility 
of  logistics  performance  impacts  on  weapon 
system  readiness. 

-  The  LSC  Commitment  is  an  innovative  con¬ 
tracting  technique.  It  embodies  the  appealing 
concept  of  a  macro  target  to  summarize  aggre¬ 
gate  costs  and  transmit  multiple  Incentives  to 
the  Contractor.  However,  because  it  has  been 
used  in  only  a  small  number  of  contracts  to 
date,  the  LSC  Commitment's  effectiveness  as  a 
contracting  and  management  tool  requires  con¬ 
tinued  evaluation.  Future  applications  should 
be  on  a  selective  and  controlled  basis. 
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APPENDIX  A 

ISC  MODEL  PARAMETER  DEFINITIONS 


BLR  -  the  bast  labor  race  ($/raan-hour)  (G)* 

BMII  -  the  average  number  of  man-hours  to  per¬ 
form  intermediate  level  (base  shop) 
maintenance  on  a  removed  item  including 
fault  isolation,  repair,  and  verifica¬ 
tion  (C)  4 

BMR  -  the  base  consumable  material  consumption 
rate  (Including  minor  items  of  supply 
such  us  nuts,  washers,  rags,  etc.,  which 
are  consumed  during  repair  of  the  item) 

(C) 

BRCT  -  the  average  base  repair  cycle  time  in 
months,  i.e.,  the  elapsed  time  for  a 
RTS  item  from  removal  of  the  failed 
item  until  it  is  returned  to  base 
serviceable  stock  (G) 

DI.R  -  the  depot  labor  rate  ($/man-hour)  (G) 

DMH  -  the  average  number  of  man-hours  to  per¬ 
form  depot-level  maintenance  on  a 
removed  item  including  fault  Isolation, 
repair,  and  verification  (C) 

DMR  -  the  depot  consumable  material  consump¬ 
tion  rate  (analogous  to  PMR)  (G) 

DRCT  -  che  average  depot  repair  cycle  time  in 
months,  i.e.,  the  elapsed  time  for  a 
NRTS  item  from  removal  of  che  failed 
item  until  it  is  made  available  to  depot 
serviceable  stock  (G) 

EBO  -  the  maximum  allowable  expected  number  of 
unfulfilled  demands  for  a  given  LRU  at 
the  bese  at  any  point  in  time  (C) 

IMH  -  the  average  number  of  man-hours  to  per¬ 
form  corrective  maintenance  of  the  item 
in  place  or  on  line  including  fault 
Isolation,  repair,  and  verification  (C) 

M  -  the  number  of  operating  locations  (G) 

MTBF  -  che  mean  time  between  failures  in  operat¬ 
ing  hours  of  the  cem  in  the  operational 
environment  (C) 


* 

Note:  G  -  supplied  by  the  Government 
C  -  supplied  by  the  Contractor 
M  -  rtunputed  by  tha  model 


NRTS  -  the  fraction  of  removed  items  expected 
to  be  returned  to  depot  for  repair 
(-  1  -  RTS)  (C) 

OS  -  the  fraction  of  the  total  force 
deployed  to  overseas  location  (G) 

OSTCON  -  the  average  order  and  shipping  time 
within  che  CONUS  (G) 

OSrOS  -  the  average  order  and  shipping  time 
•to  overseas  locations  (C) 

l 

PAMH  -  the  average  number  of  man-hours  ex¬ 
pended  in  place  on  the  complete 
system  fpr  preparation  and  access  of 
the  item!;  for  example,  jacking, 
unbuttoning,  removal  of  other  units, 
and  hookup  of  support  equipment  (C) 

PFFU  -  the  peak  force  flying  hours,  i.e., 
the  expected  total  fleet  flying 
hours  for  one  month  during  the  peak 
usage  period  (G) 

QPA  -  the  quantity  of  like  items  within  the 
parent  system,  i.e.,  "quantity  per 
application"  (C) 

RIP  -  the  fraction  of  item  failures  which 
can  be  repaired  in  place  or  on  line 
(C) 

RMH  -  the  average  number  of  man-hours  to 
Isolate  a  fault,  remove  and  replace 
the  item,  and  verify  restoration  of 
the  system  to  operational  status  (C) 

RTS  -  the  fraction  of  removed  items  ex¬ 
pected  to  be  repaired  ac  che  base 
(-  1  -  NRTS)  (C) 

STK  -  the  stock  level  of  the  Item  at  each 
base  (M) 

TFFH  -  the  expected  total  force  flying 
hours  over  the  program  Inventory 
usage  period  (the  projected  l^fc  of 
the  Item)  (G) 

UC  -  the  negotiated  unit  cost  of  a  spare 
item  as  of  the  end  of  the  verifica¬ 
tion  test  (C) 

UF  -  the  ratio  of  operating  hours  to  fly¬ 
ing  hours  for  the  item  fC) 

X50  -  expected  number  of  backorders  of  the 

item  at  a  given  base  as  a  function 
of  the  stock  level,  1,  and  the  neon 
rate  of  demands,  At,  for  the  Item  (Ml 
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TRAINING  DEVELOPMENTS:  A  MEANS  OF  INFLUENCING  LIFE  CYCLE  COSTS* 
Major  Troy  V.  Caver,  United  States  Army 


ABSTRACT 


STUDY  PROJECT  GOALS 


To  determine  If  training  development  can  be 
considered  along  with  hardware  developments, 
in  the  system  approach,  for  trade-off  consider¬ 
ations  for  achieving  lower  life  cycle  costs  and 
if  so,  how? 


STUDY  REPORT  ABSTRACT 


This  report  examines  new  training  concepts  de¬ 
veloped  throughout  DoD  over  the  past  decade. 

The  concepts  that  show  promise  for  reducing 
life  cycle  costs  are  considered  for  trado-offs 
with  hardware  developments.  The  process  of 
trade-off  considerations  is  treated  with  a  mar¬ 
ginal  cost-marginal  benefit  analysis  (put  the 
investment  where  it  provides  the  biggest  re¬ 
turn).  The  writer  then  conducts  a  sensitivity 
analysis  on  parameters  arrected  by  training  us¬ 
ing  a  computer  model  to  determine  a  trend  in 
life  cycle  costs/savings.  The  writer  concludes 
that  many  benefits  can  he  derived  by  investing 
more  in  the  training  subsystem,  in  some  cases, 
even  at  the  cost  of  the  hardware  subsystem. 
These  investments  appear  to  be  best  placed  in 
training  and  technical  documentation  or  in  Job 
performance  aids.  He  concludes  that  not  only 
should  this  type  investment  reduce  the  life 
cycle  cost  but  also  provide  Job  enrichment, 
higher  operational  availability,  fewer  mainte¬ 
nance  personnel  requirements,  fewer  training 
course  requirements  and  other  savings. 

The  implication  of  the  study  13  that  Project 
Management  personnel  concentrate  on  the  hard¬ 
ware  aspects  of  a  developing  system  while 
training  developments  provide  a  greater  return 
on  the  later  investment  and  provides  expecta¬ 
tions  cf  greater  user  satisfaction. 


SUBJECT  DESCRIPTORS 


Training  Developments 
Technical  Documentation 
Job  Performance  Aids 
Life  Cycle  Costs 
Life  Cycle  Savings 
Life  Cycle  Cost  Models 
Trade-Off  Analysis 
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TRAINING  DEVELOPMENTS:  A  MEANS  OF  INFLUENCING  LIFE  CYCLE  COSTS* 


Major  Troy  V.  Caver,  Unite*!  States  Army 


EXECUTIVE  SUMMARY 


fnts  study  examines  the  benefits  of  recent 
Training  Developments  which  are  the  results  of 
Integrating  technical  documentation  and  train¬ 
ing  techniques  Into  a  composite  package.  It 
also  examines  the  results  of  Training  Develop¬ 
ment  studies  conducted  In  all  three  US  Ser¬ 
vices.  It  includes  Insights  Into  the  problems 
of  aci. loving  expected  operational  availability, 
maintainability .  and  lower  Life  Cycle  Costs  for 
new  systems.  The  maintenance  documentation 
concepts  are  examined  Illustrating  the  Inter¬ 
relationships  of  technical  .and  training  docu¬ 
mentation  with  systems  maintainability.  The 
Implications  of  using  documentation  concepts 
tailored  for  specific  equipment  type  were  In¬ 
vestigated  with  the  expected  results  recorded 
heroin.  Representative  findings  from  the  stud¬ 
ies,  tests,  and  experiments  examined  were  used 
as  computer  data  changes  to  a  life  cycle  cost 
model  with  the  computed  results  Included  In 
this  reoort.  These  results  were  examined  In 
light  jf  recent  OoD  guidance  to  reduce  Life 
Cycle  Costs.  It  Is  concluded  that  the  proper 
selection  of  promising  training  development 
concepts  such  as  technical  and  training  docu¬ 
mentation  will  reduce  life  cycle  costs  and  In¬ 
crease  operational  availability.  Other  more 
specific  expeccatlons  are  reduced  personnel  re¬ 
quirements,  reductions  In  training  time,  de¬ 
creased  mean  time  to  repair,  fewer  Job  special¬ 
ties,  reduction  in  spare  parts  usage,  greater 
user  satisfaction,  and  a  more  usable  support 
package  for  foreign  military  sales. 

It  is  further  concluded  that  an  overall  systems 
effectiveness  approach  Is  required  to  give  suf¬ 
ficient  emphasis  to  training  and  support  and 
Insure  Project  managers  plan  and  contractually 
support  the  selection  and  development  of  the 
effective  materials. 

It  Is  also  concluded  that  revision  of  existing 
technical  and  training  do  uaentatlon  may  bo  a 
viable  alternative  to  up  rading  system  perfor¬ 
mance  and  cay  be  more  cost  effective  than  the 
customary  hardware  modifications  of  Product 
Improvement  Progruas  (PIP). 

The  implication  of  the  study  Is  that  present 
practices  emphasize  Inherent  hardware  reli¬ 
ability  and  availability  values  while  Ignoring 
enhancement  through  Improved  training  develop¬ 
ment?,  a  relatively  simple  means  of  receiving 
greater  payoffe  and  Increased  user  satisfaction 
while  reiluolng  life  oycle  costs. 


INTRODUCTION 


The  Job  of  maintaining  a  allltary  force  in  ;• 
high  state  of  readiness  falls  on  the  military 
commander.  On  the  modern  battlefield  he  is  go¬ 
ing  to  be  equipped  with  sophisticated  weapons 
and  support  equipment  more  complex  than  ever 
oefore.  Io  cas  a  cajor  task  of  maintaining 
those  weapons  In  a  high  state  of  readiness  and 
to  employ  them  In  their  mission  whenever  re¬ 
quired  to  enter  the  battle.  Powever,  for  years 
reports  from  users  throughout  the  world  cave 
expressed  concern  and  great  difficulty  :n  main¬ 
taining  readiness  conditions  required.  Manv 
factors  have  been  given  as  contributing  cau-.es 
such  as  lack  of  repair  parts,  high  equipment 
failure  rates,  long  times  to  repair,  ar.d  lna ‘.e- 
quately  trained  maintenance  personnel.  Our 
servicemen  and  the  country  deserve  equipment 
that  once  employed  In  battle  can  be  expected  to 
remain  operational  for  the  duration  of  the  mis¬ 
sion.  Any  system  found  to  be  nouoperable  she.:1 
be  expected  to  be  brought  back  to  an  operable 
condition  In  the  minimum  amount  of  ttme. 

In  a  statement  to  the  99th  Congress  Second  Ses¬ 
sion  3  Feb  1976  concerning  DoD  Research,  Devel¬ 
opment,  Test  and  Evaluation  Program, 

Dr.  Malcolm  Currie  stated: 

"Since  reliability,  maintainability,  and  direct 
personnel  costs  Influence  operating  and  support 
costs,  the  DSARC  has  been  Imposing  more  strin¬ 
gent  requirements  for  reporting  actual  field 
reliability  and  maintainability  achievements 
and  related  support  costs  throughout  the  life 
of  each  program.  This  action  will  focus  In¬ 
creased  management  attention  on  these  elements 
of  life  cycle  costs...." 


•The  complete  90  page  study  with  more  Illustra¬ 
tions  In  available  from  Defense  Loglstlco  Stu:- 
los  Information  exchange,  DL.-IE,  0989!(7 
(AUTOVON  687-2290). 


I.leut  -Hunt  Oenur.il  George  S. unmet,  Jr,  Deputy 
Commanding  General  for  Materiel  Development, 
Army  Materiel  Development  and  Head Iness  Com¬ 
mand,  .speaking  at  the  American  Defense  Prepar¬ 
edness  Association  Tank  Automotive  Division 
Meeting  In  Monterey,  California,  17  Nov  76 
stated: 

"Along  with  good  maintenance  Is  good  technical 
data.  If  you  are  going  to  tone  up  your  Ford 
you  can't  U3e  a  Jaguar  manual  to  tell  you  how 
to  do  It.  Using  some  of  our  manuals  t.i  the 
past  was  about  like  using  a  Jaguar  manual  to 
fix  a  Ford.  Our  old  manuals  wars  difficult  to 
read,  or  there  were  no  Illustrations,  or  th- 
Illustrations  were  all  wrong  —  or  at  least 
wrongly  placed  in  the  manual.  Some  are  still 
that  way.  But  we  are  correcting  this  situa¬ 
tion.  We  have  to,  If  we  are  truly  going  to 
have  equipment  readiness." 

Later  he  also  stated: 

"You  can't  put  reliability  in  a  vehicle  after 
it's  In  the  field.  ...Reliability  has  to  be 
built  Into  a  vehicle,  and  It's  not  going  to 
get  there  by  accident. 

The  same  goes  for  Tech  (technical)  Manuals. 

They  don't  write  themselves,  yet  Manuals  are 
as  much  a  part  of  readiness  as  the  mechanics 
tool  kit...." 

Also,  while  dlsousslng  support  coat  and  Design 
to  Unit  Produotlon  Cost  (DTUPC)  he  stated: 

"Our  or) tics  argue  that  we  should  have  been 
talking  DTUPC  and  life  cycle  costing  all  the 
time.  Since  the  life  cycle  cost  Is  a  lot 
tougher  number  to  predict,'  we  did  push  It  Into 
the  background.  Well,  Its  time  has  come  —  as 
they  say  on  TV  —  to  get  the  whole  package  un¬ 
der  a  life  oycle  cost  figure." 

Over  the  past  ten  years,  DoD  has  put  much 
emphasl3  on  Improving  the  aaincenanaa  of  the 
hardware  by  emphasizing  reliability  and  main¬ 
tainability  as  design  criteria  and  the  develop¬ 
ment  of  automatic  and  bullt-ln  test  equipment. 
Very  little  attention,  however,  has  gone  Into 
Improving  the  maintenance  Information.  The 
conventional  technical  manual  system  has  ex¬ 
isted  without  ohange  for  decades.  Some  gradual 
Improvement  has  occurred  but  there  has  been  no 
Innovative  thrust  to  Improve  thu  effect lve.<ess 
of  the  people  portion  of  our  maintenance  sys¬ 
tem.  Also,  as  stated  by  Dr.  Currie  later  In 
his  referenced  presentation,  approximately  25$ 
of  all  military  personnel  are  employed  In  full 
time  maintenance  service.  This  does  not  In¬ 
clude  operators  of  truoku,  tanks,  guns,  eto. 

If  we  consider  the  Individual  cost  at  $20,000 
per  man  year  (a  low  estimate)  this  represents 


$10  billion  per  year  (this  figure  varies  with 
total  DcD  strength  currently  2.1M).  If  we, then 
inject  training  costs,  the  DoD  maintenance  pel-  . 
sonnet  support  Is  easily  in  excess  of  $12. V 
billion  per  year  (1:50).  The  primary  purpose' 
for  stating  these  facts  is  to  put  emphasis  on 
the  publications,  training  and  personnel  rys- 
teas  —  three  of  the  many  disintegrated  (2). 
elements,  reference  Figure  1,  of  systems  under 
development,  each  of  which  should  Integrate  *mi 
Improve  system  effectiveness  by  better  training 
developments.  Within  the  DoD  community 
m..ny  experiments  and  demor.stratlpns  have  shown 
'.hat  Improvements  to  technical  manuals  and 
other  new  ways  c  '  presenting  Information  may  i 
enable  technic  la.  is  to  perform  faster  and  mare 
accurately,  and  with  less  training.  These 
techniques  have  the  potential  of  reducing  the 
cost  of  maintenance  and  maintenance  support 
(training)  by  25-50$  and  at  the  sa-ie  time 
Improve  the  equipment  availability.  Two 
studies  conducted  for  DoD  elements  la  recent 
years  were  relied  on  heavily  for  this  paper 
(1,2).  Each  of  them  reviewed  and  reported  the 
many  techniques  and  concepts  used  In  -Improving 
training  and  maintenance.  This  paper  will  pre¬ 
sent  the  results  of  many  of  these  examinations, 
discuss  the  applications  and  rocouupend  several 
steps  that  DqD  should  take  In  Implementing.’ the 
results. 


PUHP0.SE  OF  THIS  STUDY  PROJECT 


It  Is  tha  p'.ppose  of  this  paper  to  examine ’the 
the  reaUlts  of  studies  and  experiments  concern¬ 
ing  new  training  development  concepts  (Section 
III)  and  to  consider  the  Influence  on  System 
Life  Cyole  costa  when  epplylng  these  new  con¬ 
cepts. 


SPECIAL  GOALS  OF  THIS  PAPER 


The  goal  of  this  paper  Is  to  puswer  the  follow¬ 
ing  question:  Can  training  and  technical  docu¬ 
mentation  developaents  for  achieving  lower’life 
cycle  costs  and  if  so,  how? 


SIGNIFICANCE  OF  THE  STUDY 


Many  Department  of  Defense  Directives  and  In¬ 
structions  have  been  published  stating  Life 
Cycle  Cost  will  bo  used  as  a  constraint  In  Sys¬ 
tem  Acquisition.  Other  documents  have  statel 
the  Importance  of  user  Involvement.  However, 
the  primary  eaphasls  of  program  managers  and 
the  systeu  acquisition  process  continues  to  be 
hardware  development  and  acquisition.  'While  it 
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'UBUCATtOHS 


TRAINING 


is  obvious  that  the  primary  element  of  the  sys¬ 
tem  Initially  is  the  hardware,  and  the  early 
concern  is  in  hardware  development,  It  la  not 
at  all  clear  to  this  writer  why  the  'hardware 
fascination'  continues  throughout  the  acquisi¬ 
tion  process  at  the  expense  of  the  other  system 
elements.  If  the  many  results  of  this  study 
are  recognized  by  DoD  policy  makers  as  worth¬ 
while,  the  'hardware  acquisition  process'  will 
become  the  'system  acquisition  process'  in  fact 
and  not  Just  in  print.  The  benefits  of  such  a 
change  are  obvious  as  hardware  is  only  one  of 
the  many  subsystems  of  the  total  system. 


TRAINING  DEVELOPMENTS  AND  OTHCR 
RELATED  SUPPORT  DEFINITIONS 


This  section  la  to  examine  the  meaning  of 
training  developments  and  related  terms  such  as 
Job  Performance  Aids,  teohnloal  data,  and  main¬ 
tainability  as  used  in  this  stud;'. 


TRAINING  DEVELOPMENT 


Training  development  as  evolving  throughout  DoD 
(k:33)  Integrates  technical  documentation  and 
training  into  a  composite  package  which  pro¬ 
vides  a  reference  state  of  all  Information 
needed  to  operate  and  maintain  an  equipment 
system.  The  technical  documentation  contains 
fully  detailed,  illustrated  instructions  which 
enable  novice  technicians  to  perform  complex 
tasks  with  little  or  no  training.  The  training 
materials  consist  of  self  study  lessons  which 
teach  the  preliminary  skills  neoesaary  to  use 
the  documentation  in  operating  and  maintaining 
the  equipment. 


JOB  PERFORMANCE  AIDS 


Job  Performance  Aida  may  be  booklets  or  viewing 
devices  which  present  step-by-step  procedures 
wit-1'  simple  illustrations  supported  by  easy  to 
read  cext.  They  present  the  soldier  with  tech¬ 
nical  data  in  an  illustrated,  easy-to-read, 
step-by-step  format  supported  by  a  training 
package  whloh  Integrates  the  necessary  material 
to  teach  critical  tasks,  frequently  recurring 
tasks,  and  procedures  relative  to  troubleshoot¬ 
ing,  safety,  and  emergencies.  Key  features  of 
the  new  training  development  concepts  are  that 
(4:3U): 

-  Development,  is  based  on  an  analysis  of  Job 
and  task  requirements. 


-  Material  is  developed  with  the  target  au¬ 
dience  and  work  conditions  in  mind. 

-  Technical  data  i3  presented  in  Job  se¬ 
quence  ’d  organized  for  accessibility. 

-  Trains'.,  and  Teohnloal  Documentation  are 
integrated. 

-  Technical  manuals  and  training  packages 
are  verified  by  U3ei’3  under  realistic  con¬ 
ditions  prior  to  acceptance. 

Man's  limitations  and  capabilities  must  be  con¬ 
sidered  early  in  the  hardware  design  and  then 
personnol  must  be  trained  to  the  skill  level 
required  to  operate,  maintain,  and  support  sys¬ 
tems  and  equipment  for  ultimate  effectiveness. 
They  can  do  this  only  with  proper  technical 
data. 


TECHNICAL  DATA 


Technical  data  provides  the  link  between  the 
man  and  the  machine,  the  maintenance  technician 
and  the  part,  the  driver  and  his  tank.  Tech¬ 
nical  data  are  written  instructions  such  as 
drawings;  operating,  maintenance,  and  modifica¬ 
tion  manuals,  specifications,  inspection  test, 
and  calibration  procedures;  and  computer  pro¬ 
grams  required  to  guide  people  performing  oper¬ 
ations  and  support  tasks.  It  is  difficult  and 
impractloal  to  maintain  or  operate  much  of  the 
complex  equipment  now  being  produoed  without 
clear  and  simple  written  guidance.  Thus  the 
scheduling  of  technical  data  developments  and 
distribution  must  mesh  with  equipment  produc¬ 
tion  schedules. 


Maintainability 


Maintainability  is  a  design  characteristic 
which  is  expressed  as  the  probability  that  an 
item  will  be  retained  in,  or  restored  to,  a 
specified  condition  within  a  given  time  period 
when  maintenance  action  is  performed.  A  para¬ 
meter  often  used  as  an  expression  of  maintain¬ 
ability  is  mean  time  to  repair  (MTTR) . 


A  REMINDER 


Maintainability  is  the  ability  of  the  item  to 
be  maintained  whereas  maintenance  is  a  series 
of  actions  to  restore  or  retain  the  item  in 
the  specified  condition. 


The  maintainability  characteristic  of  hardware 
dominates  the  number  and  types  of  trained  per¬ 
sonnel,  tools,  equipment,  spare  parts,  and 
technical  data  for  support  of  the  equipment  In 
an  operational  environment. 


RESULTS  OK  STUDIES  EXAMINING  NEW 
CONCEPTS  IN  TRAINING  AND  DOCUMENTATION 


This  section  presents  the  results  of  the  many 
studies,  tests,  and  experiments  conducted  to 
develop  Improvements  in  the  military  training 
and  technical  documentation. 

There  have  been  approximately  eighty  'new  con¬ 
cepts'  designed  or  developed  to  make  Improve¬ 
ments  on  the  performance  of  the  personnel, 
primarily  through  Improved  manuals  (2:12). 
Twenty-five  research  reports  on  some  30  new 
concepts  report  improvements  in  Job  performance 
or  reduction  of  training  time  when  manuals  In¬ 
corporating  the  new  concepts  were  used.  These 
reports  were  examined  with  the  following  two 
questions  In  mind: 

1 .  How  are  the  research  results  converted 
.nto  lowering  the  cost  of  ownership? 

2.  What  are  the  fundamental  prooesses  that 
make  these  new  concepts  so  effective? 

The  examinations  revealed  that  Improvements 
must  come  from  one  of  these: 

1.  Reduced  training  time. 

2.  Reduced  number  of  personnel  required  to 
do  the  job.  (Increased  proficiency  of  Individ¬ 
ual  men.) 

3.  Reduced  errors  (reduction  or  false  re¬ 
movals  improved  by  increased  proficiency). 

The  assumptions  common  to  the  new  concepts  are 
that  experts  can  analyze  the  equipment,  deter¬ 
mine  what  should  be  done  to  It  In  every  possi¬ 
ble  situation,  and  record  this  In  technical 
manuals  so  that  even  a  mv'ce  can  use  It  to 
perform  the  task  correct  .  Using  the  new 
kinds  of  documentation,  personnel  with  half  as 
much  training  as  groups  using  standard  tech¬ 
nical  manuals,  were  able  to  correct  threo  times 
as  many  malfunctions  per  unit  time  in  a  major 
radar  system  (2:10).  All  the  concepts  are 
directed  at  telling  the  man  what  to  do  Instead 
of  teaching  him  about  the  system  details  and 
training  In  what  Is  basically  design  engineer¬ 
ing  Information.  It  emphasizes  training  and 
not  t.aaahing-  The  now  types  of  documentations 
provide  a  more  Intelligible  product. 


While  one  would  assume  that  the  current  main¬ 
tenance  documentation  is  aultable,  it  rarely 
le.  In  analyzing  the  maintenance  actions  f->- 
the  doppler  radar  system  of  the  C- 1 t 1 ,  the  Air 
Force  found  that  the  Isolation  and  repair  of 
one  malfunction  required  reference  to  165  pages 
of  8  documents  (2:10). 

In  all  of  the  experiments  and  field  tests,  In¬ 
experienced  technicians  performed  better  with 
fully  proceduralized  aids  than  with  convention¬ 
al  documentation.  Often,  particularly  when 
troubleshooting,  the  Inexperienced  technicians, 
even  those  who  had  attended  the  prescribed 
school,  were  unable  to  perform  at  all  using 
conventional  manuals.  However,  'hey  -'ere  able 
to  perform  with  minimal  errors  usin’,  'he  aids 
and  their  time  to  repair  approached  the  time 
experienced  technicians  required  when  the  lat¬ 
ter  used  either  conventional  or  experimental 
documentation. 

To  sumraa; Ize  some  key  findings  of  the  studies: 

-  Repair  time  was  reduced  by  up  to  33  per¬ 
cent,  with  80  percent  fewer  errors  (BFIC) 
(2:13). 

-  As  much  as  forty-two  percent  more  malfunc¬ 
tions  were  found  In  41  percent  less  time 
(MAINTRAIN)  (2:12). 

-  Diagnosis  time  Tell  by  as  much  as  67  per¬ 
cent  (British  Algorltthm)  (2:13). 

-  Training  time  was  reduced  as  much  as  60 
percent  for  troubleshooting  tasks  and  up 
to  100  percent  for  non-troubleshooting 
(1:35). 

-  Inexperienced  technicians  using  Job  Per¬ 
formance  Aids  performed  better  than  expe¬ 
rienced  technicians  using  traditional-type 
technical  manuals  (Non-Troubleshooting 
JPAs)  (2:13). 


CONSIDERATIONS  OF  APPLYING  THESE  CONCEPTS 
TO  REDUCE  LIFE  CYCLE  COSTS 


This  section  examines  the  effects  of  the  total 
systems  life  cycle  costs  when  the  3tudy  results 
are  applied.  For  the  maximum  savings  to  be 
realized,  Incorporation  of  these  new  training 
concepts  must  be  planned  for  as  early  In  a  sys¬ 
tems  development  as  possible. 

Many  Program  Managers  will  undoubtedly  feci 
that  training  and  logistic  ruoport  arc  either 
minor  elements  of  their  program  or  s.>->eone 
else’s  primary  responsibility.  Foi  them  the 
following  Is  provided: 
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QUOTE  FROM  DESIGN  TO  COST  POLICY  IN  THE  ARMY 
MATERIA><  COMMAND  GUIDE,  DEC  71  AND  INDORSED  ON 
3  JUL  71  IN  A  SECRETARY  OP  THE  ARMY  fCMORANDUM 
TO  THE  CHIEF  OF  STAFF,  US  ARMY.  SUBJECT:  DE¬ 
SIGN  TO  COST 

"Our  ultimata  objective  is  to  minimize  the 
total  life  cycle  cost  of  ownership  of  a  weapons 
system....  potential  cost/performance  trade 
offs  and  engineering  changes  must  be  evaluated 
In  terms  of  their  Impact  upon  the  overall  cost 
of  ownership  of  the  system  and  appropriate 
weight  should  be  given  to  this  factor  during 
source  selection  evaluation.  Higher  acquisi¬ 
tion  costs  are  acceptable  provided  that  the  ad¬ 
ditional  Investment  will  be  amortized  in  a 
reasonable  period  of  time  through  lower  opera¬ 
ting  costs.  However,  designers  should  not  be 
permitted  to  lower  hardware  acquisition  costs 
to  meet  a  deslgn-to-cost  goal  If  It  would  re¬ 
sult  in  an  uneconomical  lnorease  in  operating 
and  maintenance  costs." 

The  systems  of  the  future  will  be  required  to 
follow  a  design  to  coat  philosophy.  As  human 
resources  are  a  significant  part  of  the  life 
cycle  costs  of  a  system,  to  demand  that  systems 
be  designed  to  human  quality  and  quantity  re¬ 
source  constraints  from  the  very  beginning  is 
not  only  reasonable  but  necessary.  The  charts 
on  Figure  2  show  growth  curves  that  can  be  ex¬ 
pected  in  developing  hardware  and  documentation 
(6:23). 
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"Note  the  scale  of  the  two  curves  Is  not  the 
same.  A  $100K  investment  in  training  and  docu¬ 
mentation  oould  be  expected  to  provide  consid¬ 
erably  more  performance  lnorease  In  system  ef¬ 
fectiveness  than  the  same  investment  in  hard¬ 
ware. 


Most  system  acquisition  programs  are  constrain¬ 
ed  by  dollars,  schedule,  and  performance.  As 
money  is  Invested  over  time,  the  performance 
parameters  grow.  Characteristically  the  hard¬ 
ware  performance  growth  ourve  reaches  a  level 
where  very  little  growth  Is  realized  even  with 
extreme  investments.  The  marginal  return  on 
the  Investment  is  very  low.  This  portion  of 
the  ourve  is  usually  readied  in  the  Full  Scale 
Engineering  Development  Phase.  Also,  during 
this  phase  the  technical  documentation  and  the 
training  aids  must  be  developed  and  demonstrat¬ 
ed.  The  management  approach  to  getting  the 
greatest  life  oyole  cost  benefit  should  be  to 
invest  the  money  in  the  portion  of  the  program 
to  provide  the  greatest  marginal  pay  off,  i.e., 
the  greatest  Incremental  return  for  the  incre¬ 
mental  Investment.  If  Improved  training  aids 
or  technical  documentation  provide  a  greater 
expected  LCC  savings  with  a  $1M  Investment  than 
the  same  $1M  investment  in  hardware  reliability 
or  maintainability  Improvement,  then  the  in¬ 
vestment  should  go  into  training  aids  and  docu¬ 
mentation. 


Using  a  Life  Cyole  Cost  model  accessible  by 
coaputer,  this  writer  used  the  results  of  some 
of  the  earlier  studies  to  determine  expected 
savings.  The  model  was  exerolsed  using  a  hypo¬ 
thetical  but  realistic  electronio  system  under 
development.  All  Inputs  were  held  constant  ex- 
oept  those  treated  as  variables  for  this  exami¬ 
nation.  Base  case  was: 

a.  Number  of  job  skills  (base  x  1) 
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FIGURE  3 


ANALYSIS  OF  SYSTEM  COST  PARAMETERS  AS 
AFFECTBO  BY  MAINTENANCE  TRAINING  VARIATIONS 
USING  THE  GENERALIZED  EQUIPMENT  MAINTENANCE  MODEL 
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b.  Probability  of  false  maintenance  diag¬ 
nostic  (4:33)  (30*) 

c.  Training  tine/coat  (20  wks/$20K  for  Job 
Skill  1,  $30K  for  Job  Skill  2) 

d.  Retraining  cycle  (2-1/2  yr) 

e.  Mean  time  to  repair  (MTTR)  (varied  with 
task)  (used  a  factor  of  1.0) 

The  study  results  used  were: 

a.  Reduce  MTTR  10* 

b.  Cut  Job  skill  requirements  SO* 

c.  Reduce  training  time  by  50* 

d.  Reduce  false  maintenance  actions  (parts 
replacements) 

e.  Examine  a  5  year  period  between 
training 

The  model  was  exercised  after  changing  eaoh 
variable.  The  results  are  summarized  in  Figure 
3.  It  is  recognized  that  this  exerolse  has 
been  limited  to  a  single  model,  however,  the 
manpower  and  Life  Cyole  Coet  reductions  are  so 
significant  the  results  demand  we  can  no  longer 
afford  to  Ignore  the  personnel  subsystem. 

The  results  indicate  that  a  10*  reduotlon  in 
mean  time  to  repair  (MTTR) : 

a.  Reduced  the  test  equipment  oost  by  10* 

b.  Reduced  the  manpower  cost  by  10* 

c.  Reduced  the  training  costs  by  50* 

d.  Reduced  the  Total  Life  Cyole  Costs  by 
15.9* 

A  50*  reduction  in  the  number  of  Job  skills 
further: 

a.  Reduced  manpower  costs  an  additional  80* 

b.  Reduced  training  costs  an  additional  30* 

c.  Reduced  the  Total  Life  Cyole  Costs  an 
additional  36.5* 

A  lowering  of  the  false  part  removal  from  30* 
to  10*  and  reducing  training  time  by  50*  fur¬ 
ther: 

a.  Reduoed  training  oosts  an  additional  50* 


With  all  other  parameters  held  steady,  the  MTTR 
was  varied  from  90*  to  80*to  70*  resulting  in: 

a.  Reductions  in  test  equipment  cost  by 
11.27*  and  12.7*  respectively 

b.  Reductions  in  manpower  costs  by  10.7* 
and  12.5*  respectively 

c.  Reductions  of  training  cost3  by  10.7* 
and  10.5*  respectively 

d.  Reductions  of  Life  Cycle  C03t  by  5.34* 
and  5.8*  respectively 

In  addition  to  the  cost  savings  available  by 
improving  training  and  technical  documentation, 
other  benefits  can  be  postulated: 

-  Job  enrichment , hence  higher  expected  re- 
enlistment  rate  (7:21) 

-  Fewer  errors  in  the  contractor  produced 
documentation 

-  More  utilization  of  men  now  in  supervisory 
positions  (presently  71*  of  inexperienced 
labor  observes  and  assists)  (2:48) 

-  Fewer  personnel  moves  as  average  stay  on 
Station  for  first  termer  is  longer 

-  Technicians  leaving  service  should  be 
better  trained  for  production  in  civilian 
economy  (2:47) 

-  Improve  reliability  and  operational  readi¬ 
ness  time 

-  Reduce  unscheduled  maintenance  manpower 

Althougn  a  cost  savings  can  be  shown,  the 
new  techniques  will  oertalnly  meet  with  opposi¬ 
tion.  One  objection  to  acquiring  documents 
with  the  new  conoepts  has  been  that  they  cost 
more  than  conventional  documentation  and  that 
projeot  managers  faced  with  competing  require¬ 
ments  resist  their  adoption.  If  the  oost  sav¬ 
ings  potential  is  even  a  small  fraction  of  what 
is  claimed  by  proponents,  the  initial  cost 
should  not  be  an  overriding  factor.  A  budget 
quotation  submitted  to  AFLC  in  1971  for  comple¬ 
tion  of  flight  line  JPAs  for  the  C-141  wa3 
$1,300,000  with  troubleshooting  aids  and 
$800,000  without.  McDonnell-Douglas  reportedly 
estimated  that  JPAs  for  the  F-15  would  cost  $45 
million  versus  $35  million  for  conventional 
documentation  (2:50). 

Most  estimates  indicate  the  cost  at  100*  to 
125*  of  conventional  documentation.  In  at 
least  one  case,  cost  estimates  were  less  than 
the  estimates  for  conventional  manuals  (2:50). 


b.  Reduced  Life  Cycle  Coats  an  additional 

6.3* 
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RECOMMENDATIONS 


If  new  documents  or  JPAs  were  widely  adopted, 
the  production  costs  would  probably  come  down 
due  to  the  contractor  learning  and  production 
techniques.  Current  JPA  estimates  from  con¬ 
tractors  aocu3tcmed  to  producing  conventional 
manuals  are  probably  Inflated  because  of  un¬ 
certainty.  The  Industrial  base  for  this  kind 
of  product  would  expand  although  fortunately 
there  are  currently  at  least  a  half  dozen  con¬ 
tractors  who  have  demonstrated  capability  in 
tnls  area. 


CONCLUSIONS 


(1)  That  DoD  direct  each  service  to  examine 
the  possible  life  cycle  cost  savings,  to  each 
system  undergoing  Research  and  Development,  as 
a  result  of  U3lng  the  documentation  and  train¬ 
ing  concepts  developed  by  referenced  studies 
and  to  Implement  tnose  showing  sufficient  cost 
savings. 

(2)  Realizing  that  documentation,  training 
■>'ds,  and  devices  mu3t  be  developed  as  compo¬ 
nents  of  each  system,  this  writer  recommends: 


The  user  1?  program  manager's  customer. 

The  whole  purpose  of  system  development  or 
acquisition  Is  to  satisfy  the  user's  need. 

The  service  users  have  emphasized  the  need  for 
technical  and  training  documentation  written 
at  a  lower  reading  level.  The  many  studies 
conducted  over  the  past  two  decades  provide  a 
means  of  satisfying  this  need  and  at  the  same 
time,  reduce  the  manpower  burden  while  improv¬ 
ing  the  overall  systems  effectiveness. 

A  major  problem  13  expected  In  Implementing 
these  study  results.  The  institutional  proce¬ 
dures  don't  change  quickly.  As  long  as  Project/ 
Program  Managers  emphasize  Unit  Production  Cost 
at  the  expense  of  Lire  Cycle  Cost  the  'hardware 
fascination'  will  continue.  The  effect  of  the 
personnel  subsystem  must  be  considered  as  the 
imperfect  subsystem  it  13.  Hardware  design 
parameters  should  be  modified  upward  according¬ 
ly  to  allow  for  the  degradation  due  to  Imper¬ 
fect  personnel  and  yet  meet  the  operational  re¬ 
quirements  as  stated  In  the  requirements  docu¬ 
ment. 

Life  Cycle  Costs  are  being  emphasized  In  DoD 
5000.28  and  other  CoD  Instructions,  however, 
mo3t  Iraplementers  nave  difficulty  getting  a 
handle  on  the  operations  and  support  costs. 

The  U3e  of  models  such  a3  the  one  U3ed  to  sup¬ 
port  this  3tudy  are  available  In  each  service 
(9).  They  can  provide  sufficient  data  to  sup¬ 
port  trade-off  decisions  1-  design,  support 
equipment,  manpower,  and  .her  resource  lim¬ 
iting  areas.  To  successfully  use  3uch  models, 
Information  such  as  maintenance  concepts,  re¬ 
quired  operational  and  maintenance  crews,  types 
of  maintenance  task3  and  the  operational  and 
logistic  mission  profile  must  be  developed  as 
Inputs.  In  so  doing  the  models  will  aid  In  de¬ 
sign  decisions  (10).  The  Life  Cycle  Costs 
developed  by  this  analysis  Indicates  that  al¬ 
though  absolute  costs  may  not  be  available, 
relative  merit  can  be  determined  by  examining 
trade-offs,  and  forcing  the  contractor  to  con¬ 
centrate  on  the  system  cost  drlvors. 


(a)  Invest  the  Research  ar.d  Development 
dollars  in  the  areas  where  the  expected  margin¬ 
al  return  Is  greatest.  This  requires  acknowl¬ 
edging  that  the  Investment  may  legitimately  oe 
applied  to  Improving  a  subsystem  other  than  the 
hardware . 

(b)  That  each  new  requirement  document  be 
examined  for  satisfaction  of  its  requirement  by 
the  following  priority  methods: 

-  New  .lob  Performance  Aids  on  exist¬ 
ing  equipment 

-  Product  Improvement  to  existing 
equipment 

-  New  System  development. 

(c)  That  DoD  schools  dealing  with  systems 
acquisition  take  a  more  responsible  role  In 
teaching  the  development  and  contracting  for 
Improvement  of  high  cost  subsystems  (other  than 
hardware)  such  a3  personnel  and  logistic  sup¬ 
port.  Also  that  the  DoD  schools  be  charged 
with  assessing  recommended  methods  to  obtain 
Life  Cycle  Cost  Savings  and  distribute  promis¬ 
ing  methods  to  PM  offleoa  In  each  service. 
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INTRODUCTION 


Tne  conceptualisation,  design,  development, 
production,  and  deployment  of  a  major  weapon 
system  constitute  the  five  phases  of  the  major 
systems  acquisition  cycle.  This  cycle  is  ini¬ 
tiated  with  the  approval  of  a  mission  need  and 
is  omplete  when  the  weapon  system  has  been 
phased  out  of  the  operational  inventory.  Over 
the  past  sevei  1  years  the  Defence  Department 
has  shown  concern  for  the  increased  total  life 
cycle  costs  (LCC)  of  major  weapon  systems.  In 
an  attempt  to  lower  these  costs,  the  acquisition 
cycle  has  bean  subject  to  many  new  innovations. 
One  of  the  moot  significant  changes  has  been 
that  of  increased  emphasis  of  logistics  support 
concerns  during  the  early  stages  of  the  acqui¬ 
sition  cycle.  Tills  has  been  accomplished  by 
attempting  to  introduce  logistics  support  cri¬ 
teria  in  the  design  phase  of  the  acquisition 
cycle.  The  complexities  of  this  phase  of  the 
acquisition  cycle,  the  lack  of  experienced 
logisticians  ii>  the  design  discipline,  the 
inability  to  correlate  design  decisions  to 
logistics  support  requirements,  and  the  lack  of 
available  and  acceptable  techniques  for  inte¬ 
grating  logistics  as  a  criteria  for  System 
Program  Office  (SPO)  decision  making  are  all 
important  factors  that  have  contributed  to  the 
difficulty  of  this  task.  This  paper  discusses 
the  issues  surrounding  these  factors,  describes 
an  approach  that  was  used  in  a  major  Air  Force 
weapons  system  acquisition,  and  summarizes  some 
ot  the  current  issues  that  need  to  be  addressed 
to  further  improve  the  use  of  logistics  support 
criteria  during  the  design  phase  of  a  major 
system  acquisition 


BACKGROUND 


LCC  another  dimension  '  these  criteria,  logis¬ 
tics  support,  ha3  rece  zed  much  more  emphasis. 
Numerous  weapons  systems  and  subsystems  have 
recently  used  an  average  unit  flyaway  cost  tar¬ 
get  during  the  development  and  production  phase 
of  the  program  as  a  contract  technique  to  control 
program  coats.  The  concept  of  deoign-to-cost 
(DTC)  wa»  introduced  to  increase  the  visibility 
of  ri  p*nm*  ..oat  goal*.  DTC  la  defined  in  De¬ 
partment  of  Defense  (l/>D)  Directive  5000.28(h) 
as  *a  management  concept  wherein  rigorous  cost 
goals  are  established  during  development  and  the 


control  of  system  costs  (acquisition,  opera¬ 
ting,  and  support)  to  these  goals  is  achieved 
by  practical  tradeoffs  between  operational 
capability,  performance,  cost,  and  schedule." 

To  establish  adequate  DTC  goals  and  to  develop 
management  criteria  for  making  program  deci¬ 
sions,  it  became  apparent  that  not  only  were 
development  and  production  costs  important  but 
there  was  a  need  m  Defense  acquisition  to 
manage  the  operational  and  support  (O&S;  costs 
of  a  weapon  system.  This  requited  management 
to  introduce  O&S  cost  factors  into  t'.e  design 
analysis.  Since  the  design  of  major  weapons 
systems  is  generally  accomplished  by  contrac¬ 
tors,  it  became  necessary  to  develop  methods 
that  would  permit  the  O&S  cost  factors  to  be 
stated  in  measurable  numbers  and  terns  appro¬ 
priate  for  contracts.  Such  factors  as  .('li¬ 
ability,  maintainability,  producibil tty,  and 
human  factors  (man/machine  interface)  needed 
to  be  specified  in  measurable  terms  and  pi.*c*  * 
in  the  early  acquisition  contracts  as  man¬ 
ageable  goals.  Also,  with  management’s  desue 
to  emphasize  LCC,  these  parameters  had  to  fc*» 
constructed  in  terms  of  dollars.  Another  rea¬ 
son  for  stating  these  design  support  goals  . n 
dollar  terms  was  that  other  program  parameters 
such  as  performance  and  schedule  i npacts  were 
often  stated  ir.  terms  of  program  dollars.  In 
order  to  establish  design  system  operational  ar.  I 
support  cost  goals,  there  was  a  need  to 
reliability,  maintainability  and  producibil ity 
factors,  in  terras  of  design  standards.  Quan¬ 
tifiable  standards  of  these  factors  for 
existing  designs  are  difficult  to  identify  and 
relate  to  new  system  designs.  Past  reliability 
and  maintainability  data  from  the  operational 
environment  has  proven  to  be  difficult  at  best 
to  use  for  establishing  qoaH  during  new  desigr 
efforts.  The  use  of  engineering  analysis  and 
similarity  to  other  systems  have  been  u »cd  to 
establish  these  design  guidelines  in  a  few 
recent  procurerents. 

Two  contractual  mechanisms  for  emphasizing 
the  reduction  of  0&s  costs  are  now  being 
selectively  used.  These  include  the  Reliability 
Improvement  Warranty  (RIW)  and  the  Logistic 
Support  Cost  Commitment  (LSCC).  The  Liy'O  is 
also  referred  to  as  the  Support  Cost  Guarantee. 
The  LSCC  techniques  involve  establishing  nr-wt 
Logistics  Support  Costs  (TLSC)  in  tern:.  *>f  a 
COfit  model  that  predicts  logistic*  costs  hist’*! 
on  logistics  fartoiii.  These  TLS<  *  »  must  t»»* 
mensurable  and  t./*  table  i  •*  *.  ir ‘Sited  f  seid 
tent  environment  where  Meam. :.,*•}  *.  *  :  t<  . 
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Support  Costs  (MLSC)  can  be  produced.  To 
incentivise  this  mechanism,  a  contract  price 
adjustment  based  on  the  comparison  of  the  TLSC 
and  the  MLSC  during  the  verification  test  must 
he  provided. 

The  RIW  is  a  contractual  agreement  under  which 
the  contractor  is  required  to  assume  responsi¬ 
bility  for  all  repair  of  an  item  over  a  given 
period  of  time  at  a  prenegotiated  fixed  price. 
RIW  also  provides  for  increased  profits  if 
increased  equipment  reliability  i3  demonstrated. 
Engineering  changes  are  encouraged  to  reduce 
future  operation  and  support  costs.  An  addi¬ 
tional  incentive  to  design  in  higher  reliabil¬ 
ity  is  provided  when  the  RIW  is  part  of  the 
development/production  contract. 


The  RIW  and  LSCC  are  being  used  in  several 
major  system  acquisitions.  Management  is 
employing  these  techniques  with  a  great  deal  of 
caution  since  their  usefulness  has  not  been 
completely  evaluated.  Some  of  the  concerns  of 
the  Air  Force  with  the  use  of  RIW  are:  fund¬ 
ing,  equipment  performance,  measurement, 
engineering  changes,  and  transition  to  organic 
support.  The  LSCC  technique  is  more  complex 
than  the  RIW  to  implement  and  administer.  Its 
dependence  on  a  cost  model  framework  that  must 
be  tailored  to  the  specific  system  design 
characteristics  assumes  a  degree  of  stability 
in  the  design  onca  the  technique  is  initiated. 
The  requirement  for  a  field  teat  verification 
may  cause  delays  in  obtaining  useful  results. 
These  and  other  issues  must  be  evaluated  before 
this  technique's  usefulness  will  be  completely 
appreciated.  RIW  is  limited  in  application  to 
a  small,  select  group  of  equipment  whereas  the 
LSCC  technique  can,  if  proper  tailoring  is 
accomplished,  be  applied  to  total  system  acqui¬ 
sitions.  To  increase  the  role  of  logistics 
support  as  a  major  program  criteria  early  in 
the  acquisition  cycle,  the  above  techniques 
need  further  verification,  improvement,  and 
additional  techniques  need  to  be  developed. 

To  accomplish  this  several  areas  must  be  given 
careful  consideration.  These  include:  greater 
understanding  of  logistics  support  and  its 
relation  to  design  analysis;  increased  integra¬ 
tion  of  design  and  logistics  engineering 
activities;  increased  use,  evaluation,  and 
improvement  of  such  techniques  as  RIW  and  LSCC; 
increased  integration  of  logistics  concerns  in 
the  program  management  office;  and  improved 
feedback  of  operational  data  on  specific 
designs.  Hie  raaaining  portion  of  this 
paper  will  discues  each  of  these  areas  ss  they 
relate  to  a  recent  major  system  acquisition 
experience. 


LOGISTICS  SUPPORT 
CONSIDERATIONS  IN  DESIGN 

Logistics  support  as  it  relates  to  a  system 
(weapon  system)  can  be  described  aa  the  teat 
and  support  equipment,  consumables  spares  and 
repair  parts,  personnel  and  training,  trans¬ 
portation  and  handling,  facilities,  and  tech¬ 
nical  data  necessary  to  successfully  operate  the 
system.  In  many  cases  the  system,  which  con¬ 
sists  of  both  the  prime  mission  equipment  and 
the  associated  logistics  support,  is  designed 
as  the  prime  mission  equipment  alone  without 
duo  concern  for  the  associated  logistics  sup¬ 
port.  Cost-effective  systems  cannot  be 
developed  without  effectively  including  logis¬ 
tics  support  considerations  throughout  the 
entire  system  acquisition  cycle.  Particularly 
during  the  initial  stages  of  design  and  devel¬ 
opment,  logistics  support,  performance,  and 
input  resources  must  be  considered  each  time 
the  total  system  design  is  assessed.  An 
iterative  process  is  needed  since  the  design  of 
the  prime  equipment  influences  logistics  sup¬ 
port  requirements  and  the  logistics  support 
will  impact  the  total  system  effectiveness  and 
cost.  The  objective  should  be  to  provide  the 
proper  amount  of  support  at  the  proper  time. 

It  is  important  to  recognize  that  too  much 
support  can  be  as  detrimental  as  too  little, 
but  proper  planning  and  integration  of  the 
logistics  concerns  into  the  total  acquisition 
cycle  will  optimize  the  system's  total  per¬ 
formance. 

In  order  to  integrate  logistics  support  as  one 
of  the  prime  program  criteria  along  with  cost, 
schedule,  and  performance,  logistics  functions 
must  be  established  for  each  program  phase. 

These  functions  mutt  then  be  Implemented  in  the 
total  system  acquisition  by  identifying  spe¬ 
cific  logistics  support  requirements  and  tech¬ 
niques  tailored  to  the  maturity  of  the  system 
design.  Tailoring  is  very  important  because 
the  lack  of  it  will  eliminate  the  usefulness  of 
any  technique  and  cause  management  to  lose 
credibility  of  the  process.  Decision  making 
will  be  ineffective. 

Emphasis  is  placed  on  the  design  phase  of  acqui¬ 
sition  in  this  discussion.  The  logistics  func¬ 
tions  generally  most  appropriate  to  this  phase 
of  acquisition  Include:  deeign  coordination 
and  logistics  support  services,  predictions, 
utilization  of  design  aids,  logistics  support 
analysis,  logistics  provisioning  dsta,  design 
review,  and  component  test  and  evaluation.  The 
logistics  support  requirements  that  must  be 
considered  include  the  logistics  support  design 
analysis  and  the  identification  of  initial 
logistics  resource  requirements. 

The  deeign  attributes;  functional  design,  reli¬ 
ability,  maintainability,  human  factors,  and 
produclbllity  correspond  to  the  following  logis¬ 
tics  support  elements:  maintenance  planning, 
test  end  support  equipment,  spare/repair  parts, 
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personnel  training,  and  technical  data,  respec¬ 
tively.  Facilities  and  transportation/handling 
are  logistics  support  elements  that  rau3t  be 
considered,  but  they  relate  somewhat  indirectly 
to  the  above  design  attributes  of  the  prime 
equipment. 

The  design  attributes  and  logistics  support 
elements  must  be  of  primary  concern  to  the 
system  acquisition  manager  who's  objective  is 
to  acquire  an  effective  system.  The  system 
effectiveness  is  a  function  of  the  performance 
parameters,  availability  (operational  readi¬ 
ness)  and  dependability.  Dependability  is  the 
effectiveness  factor  that  relates  directly  to 
the  design  phase  of  the  acquisition  cycle. 

Since  dependability  is  a  function  of  operating 
time  (reliability)  and  downtime  (maintaina- 
bility/cupportab  lity)  these  two  parameters, 
reliability  and  maintainability  provide  the 
necessary  linkage  between  design  activities 
and  logistics  support  requirements.  They 
represent  the  measurable  parameters  that  the 
logistics  support  design  analysis  employs  S3 
the  system  design  engineer  works  to  meet  total 
system  effectiveness  requirements  during  the 
design/ development  process. 

The  logistics  support  analysis  during  the 
design  phase  of  major  weapons  systems  should 
aid  in  the  evaluation  of  specific  characteris¬ 
tics  in  the  equipment  design  which  can  be 
measured  in  terms  of  reliability  and  maintain¬ 
ability  features.  Alternatives  in  design  such 
a3  te3t  approaches,  packaging  schemes,  access¬ 
ibility  features,  transportation,  and  handling 
provisions  should  be  cubject  to  the  analysis. 

The  logistics  support  design  analysis  must  he 
accomplished  by  the  design  engineering  team  in 
direct  response  to  the  customer's  requirements. 
Tins  obviously  will  require  that  the  design 
engineering  team  and  the  customer  be  knowl¬ 
edgeable  a!>out  establishing  guidelines  for  the 
logistics  support  analysis.  It  also  will 
require  that  the  engineering  team  be  made  up 
of  both  design  engineer/:  and  logistics  engi¬ 
neers  who  can  Incorporate  the  reliability  and 
maintainability  (RAM)  disciplines  into  the 
design  process.  RAM  cannot  be  limited  to  the 
role  of  verification  of  design:  they  must  be 
used  as  design  criteria.  These  two  disciplines 
are  intricately  related  t  initial  design 
analysis  and  dosign  cone-  tuaiization.  The 
myriads  of  detail  decisions  and  tradeoffs  made 
during  design  must  Include  RAM  concerns.  An 
interrelated  analysis  that  includes  RAM  and 
other  design  analysis  techniques  must  be  estab¬ 
lished.  This  requires  technically  strong 
individuals  who  are  RsM  motivated  and  can  con¬ 
vert  RAM  principles  into  the  product  design. 
Familiarity  with  past  equipment  field  problems 
also  is  desirable.  These  individuals  should 
perform  such  task*  ae  educating  the  design 
engineer  prior  to  and  during  design,  analyze 
the  planned  ayntera  mission  profiles,  perform 


in-process  design  analysis,  provide  field 
experience  feedback  to  design  engineers,  coor¬ 
dinate  on  design  package  release,  perform 
tradeoff  analysis,  and  create  checklists  and 
tracking  systems  for  managing  discrepancies. 

These  ideas  should  be  considered  by  weapon 
system  acquisition  managers  as  they  evaluate 
the  producer’s  capability  to  integrate 
logistics  support  into  their  design  activity 
and  use  it  as  a  program  criteria.  The  fol¬ 
lowing  section  of  this  paper  describes  a  con¬ 
tractual  technique,  the  logistics  incentive 
award  fee  approach,  used  in  a  major  system 
acquisition  in  the  Air  Force.  The  purpose  of 
this  ) jg> sties  incentive  award  fee  was  to 
encourage  the  producer  to  incoiporate  logistics 
concerns  into  his  desic.n  activities. 


LOGISTICS  EMPHASIS  By 
PROGRAM  MANAGEMENT 


Program  managers  who  perform  the  essential 
day-to-day  functions  as  the  total  system  acqui¬ 
sition  managers  must  create  an  environment  that 
encourages  and  promotes  the  incorporation  of 
logistics  support  into  the  day-to-day  decision 
making  process.  The  following  discussion 
describes  how  this  was  done  in  a  major  Air 
Force  weapon  system  acquisition,  the  A-X/A-10 
Program. 

During  the  early  stages  of  the  acquisition 
program  of  the  A-X/A-10  aircraft  the  require¬ 
ments  to  control  both  acquisition  and  opera- 
tions/maintenance  costs  were  established. 
De.sign-to-cost  coals  were  developed  to  control 
the  acquisition  costs,  but  the  attempt  to  lower 
future  operations  and  maintenance  costs  during 
design  required  the  development  of  an  unique 
management  technique. 

The  technique  developed  involved  the  adaptation 
and  application  of  an  operation  and  support 
<Of.S)  cost  model  with  a  contractor  incentive 
award  £eo.  The  O&S  cost  model  used  was  a  modi¬ 
fied  version  of  a  cost  model  developed  by 
Air  Force  Logistics  Comuand.  A  detailed 
description  of  the  model  is  contained  in 
references  3  and  5.  The  contractor  incentive 
award  fee  was  devised  to  encourage  the  con¬ 
tractor  to  make  design  changes  that  would  lower 
future  OSS  costs  during  the  full-scale  develop¬ 
ment  phase  of  the  program.  The  award  fee  was 
partially  based  on  an  evaluation  of  the  results 
of  the  OSS  cost  model  at  the  completion  of  a 
field  flight  test  period.  This  relationship 
of  the  award  fee  to  the  cost  model  was  estab¬ 
lished  to  provide  the  incentive  for  iwith  con¬ 
tractor  and  Government  personnel  to  •■Stabiis'i 
an  effective  process  to  man.  '■*  ard  emphasize  the 
logistics  support  aspects  of  the  sy**—  lesion 
ef  fort . 
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The  logistics  support  cost  control  technique 
used  d\irirg  the  A- 10  acquisition  program  was 
implemented  over  a  seven-year  period.  It 
began  in  May  1970  during  the  Competitive  Proto¬ 
type  Program  (CPP)/  continued  through  full- 
scale  development  (PSD),  and  ended  in  the  pro¬ 
gram  production  phase  with  the  award  <**  being 
made  m  August  1977.  During  the  CPP  phase  the 
contractors  were  told  that  the  estimated  ten- 
year  operation  and  support  costs  of  their 
design  would  be  a  major  factor  in  the  selection 
of  the  full-scale  development  (FSC)  program 
contractor.  When  the  request  for  proposal  for 
the  FSD  program  was  issued  it  included  the 
requirement  that  each  contractor  provide  their 
ten-year  o&S  cost  estimates  in  a  comparative 
cost  model  framework.  This  logistics  support 
design  information  was  used  in  the  source  selec¬ 
tion  for  the  FSD  contractor. 

The  FSD  contractor  was  required  to  provide 
target  logistics  effect  (TLB)  estimates  for  his 
FSD  design  early  in  the  FSD  phase  of  the  pro¬ 
gram.  The  TLE's  were  developed  employing  the 
cost  model  framework  and  were  the  result  of 
estimated  reliability  and  maintainability 
design  characteristics  of  selected  major  system 
line  replaceable  units.  These  TLE's  were  used 
as  goals  for  the  system  design  effort  in  termn 
of  logistics  support.  The  engineering  changes 
submitted  by  the  contractor  were  evaluated  in 
relation  to  the  targets,  "hie  provided  a 
method  for  the  logistics  engineers  and  program 
office  managers  to  conduct  a  day-to-day  evalua¬ 
tion  of  the  system  design  In  terms  of  logistics 
support.  The  first  production  aircraft  ware 
flown  to  measure  the  logistics  effects  of  the 
A-10  aircraft.  A  test  program  was  established 
and  line  replaceable  unit  removal  data  was 
accumulated  during  the  first  5,000  hours  of 
operational  flying.  This  removal  data  was  then 
used  to  develop  measured  logistics  effects 
(MLE).  These  MLE  were  compared  to  the  TLE 
(adjusted  for  certain  program  changes)  for 
determining  the  contractor's  logistics  design 
performance  and  to  assist  In  making  the  award 
fee  determination. 

This  entire  application  is  summarized  in  Figure 

1. 


The  technique  described  below  and  used  by 
the  A-10  Program  included  some  very  important 
characteristics.  It  was  Initiated  early  in 
the  acquisition  cycle.  Competition  between 
contractors  was  still  available  in  the  program 
when  the  ten-year  <’&s  coat  esMmntes  were 
eeiahl (shed.  Targe*  logistics 
ware  established  and  qef inert  in  a  nea»uta!‘te 
cost  framework.  A  field  verification  test 
procedure  wae  utilized.  The  technique  was  on 
contract  and  it  employed  a  contract  remedy/ 
price  adjustment.  It  was  incentivised  by  the 
award  fee.  The  technique  used  available  Air 
Force  data  sources  and  it  was  simple,  manage¬ 
able,  and  understandable. 

The  technique  was  used  in  several  decision 
making  situations.  During  the  FSD  source  selec¬ 
tion  the  O&S  cost  estimates  were  evaluated  and 
used  as  one  of  the  selection  criteria.  The 
engineering  change  proposals  (ECP)  submitted  by 
the  contractor  were  evaluated  and  monitored 
by  applying  the  06S  cost  model.  The  final 
measured  logistics  effects  were  used  by  the 
Fee  Evaluation  Hoard  in  addition  to  other  man¬ 
agement  considerations  to  make  the  final  award 
fee  determination.  It  is  important  to  note  chat 
the  continuous  application  and  implementation 
of  this  technique  emphasized  the  concern  for 
logistics  support  costs  to  program  managers  and 
decision  makers  throughout  the  design  phase  of 
the  program. 

The  actual  impact  of  this  effort  on  the  field 
operations  of  the  A-10  is  difficult  to  quantify. 
The  A-10  squadrons  are  experiencing  a  lower 
than  anticipated  NORS  rate,  and  the  OR  rate  has 
been  higher  than  similar  systems  during  initial 
field  deployment.  Logistics  support  involves 
such  a  wide  range  of  functions  that  to  assess 
the  effectiveness  of  this  effort,  only  on  an 
operational  basis  would  be  Insufficient  and 
misleading.  The  effort  to  emphasize  logistics 
concern  during  the  early  stages  of  system  acqui¬ 
sition  will  enhance  the  accomplishment  of  the 
entire  logistics  support  activity. 


A-10  ACQUISITION  CYCLE  LOGISTICS  SUPPORT  MANAGEMENT  TECHNIQUE 

COMPETITIVE  PROTOTYPE 

FULL  SCALE  DEVELOPMENT 

PRODUCTION 

MAY  70 

JAN  73 

JUL  74 

-  CPP,  RFP  CALLS  FOR  OSS  COST 

-  TLE  FROM  FSD  CONTRACTOR 

-  FINAL  TLE  ADJUSTMENTS 

-  MODEL  TO  BIDDERS 

-  ECP  TO  LOWER  O&S  COSTS 

-  BEGIN  5,000  HOUR  LOGIS¬ 
TICS  EFFECTS  MEASURE¬ 
MENT  PERIOD 

-  IMPROVEMENTS  TO  MODEL 

-  PRELIMINARY  COST  MODEL 
APPLICATIONS 

-  END  LOGISTICS  MEASURE¬ 
MENT  PERIOD 

-  FSD,  RFP  FINAL  MODEL 

-  AWARD  FEE 

-  10  YEARS  O&S  COST  tSTIMATE 
RECEIVED  FROM  CONTRACTORS 
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CONTINUED  LOGISTICS  SUPPORT 
EMPHASIS  IN  SYSTEM  ACQUISITION 


The  management  initiatives  in  the  A-10  Program 
represent  a  positive  step  toward  incorporating 
logistics  support  concerns  in  the  early  stages 
of  major  system  acquisitions.  Similar  efforts 
are  being  initiated  on  other  Air  Force  procure¬ 
ments.  These  activities  represent  continuing 
strong  support  and  the  increased  concern  for 
logistics  support  as  a  major  system  effective¬ 
ness  factor  by  acquisition  managers. 

This  continued  integration  of  logistics  support 
requirements  as  a  program  management  decision 
criteria  can  lie  a  major  factor  in  increasing  the 
quality  of  weapons  systems.  The  following 
recommendation,  arc  made  to  identify  actions 
that  will  continue  to  increase  the  effective¬ 
ness  of  system  acquis iton  subject  to  logistics 
support  requirements. 

—  Increased  program  management  awareness  of 
logistics  support  requirements.  This  may  seem 
to  indicate  a  weakness  in  program  managers,  but 
that  is  not  the  thrust  of  this  recommendation. 
Thu  responsibility  for  making  logistics  sup¬ 
port  visible  and  manageable  in  the  progr-  ~> 
office  belongs  to  the  logistics  engineer  and 
the  deputy  program  manager  for  logistics.  The 
logistics  experts  must  develop  their  techniques 
to  give  the  system  program  manager  the  facts 
ho  needs  to  make  tradeoff  decisions  among  other 
program  constraints  (cost,  schedule,  perfor¬ 
mance)  and  logistics  support. 

—  Develop  effective  and  credible  manage¬ 
ment  techniques.  This  will  entail  such  things 
as  continued  development  of  logistics  cost 
modols,  better  assessment  techniques  for  deter¬ 
mining  new  systems  impact  on  present  capabili¬ 
ties  and  improved  cout  tracking  systems. 

—  Provide  adequate  incentives.  The 
accomplishment  of  an  analysis  of  a  design  in 
terms  of  the  logistics  support  requirements 
requires  the  application  of  resources.  If  it 
is  to  be  properly  accomplished,  funds  and  per¬ 
sonnel  must  be  made  available.  These  resources 
should  be  cxpHcitoly  identified  by  both 
parties  in  the  procurement.  The  program  man¬ 
agement  documents  shou’  specifically  identify 
these  dedicated  roccur  s. 

—  Obtain  greater  contractor  participation. 
To  get  proper  emphasis  from  the  contractor  of 
logistics  support  during  design  is  a  very  impor¬ 
tant  and  difficult  task.  Clear  guidance  to  the 
contractor  should  be  provided.  Methods  for 
verification  of  the  actual  design  review  in 
terms  of  logistics  concerns  should  be  estab¬ 
lished  and  agreed  upon  by  the  contractor  and 
Government  engineers. 

—  Development  of  logistics  design  exper¬ 
tise.  The  neod  for  individuals  with  the 


expertise  to  incorporate  logistics  factors 
into  the  aystem  engineering  design  process  is 
great.  These  Individuals  must  have  a  workinc 
knowledge  of  the  engineering  design  process 
and  have  a  detailed  understanding  of  what 
logistics  parameters  (reliability,  maintain¬ 
ability,  and  producibility )  can  be  used  to 
evaluate  the  design  by  the  design  engineer. 

—  Development  of  contractual  provisions. 
The  development  of  contractual  procedures 
and  terms  that  express  the  logistics  criteria 
m  clear,  understandable  terms  for  efficient 
contract  administration  is  required.  Two  areas 
of  concern  exist  that  must  be  considered, 
rirc-,  the  general  availability  of  models 
relating  design  parameters  to  operating  and 
support  costs  with  the  required  accuracy  must 
be  developed.  Second,  proceuures  which  will 
accurately  measure  the  support  requi  '"ements 
demonstrated  by  production  equipment  m  the 
field  must  be  developed  and  validated.  To  do 
this,  the  final  important  area  of  concern 
must  be  addressed. 

—  improvement  of  operational  systems 
history.  The  need  for  feedback  from  the  opera¬ 
tional  environment  that  will  be  properly  under¬ 
stood  by  the  design  engineer  is  extremely 
Important  In  the  effort  to  get  greater  reli¬ 
ability  designed  into  systems.  The  identifi¬ 
cation  of  the  kind  of  information  needed  and 
determination  of  how  it  should  be  used  must  be 
accomplished  with  more  effectiveness. 


SUMMARY 


Acquisition  management  review  levels  must  pro¬ 
vide  the  incentive  for  improving  the  system 
acquisition  process.  They  cm  do  this  by 
emphasizing  that  the  total  system  must  bo  iden¬ 
tified  (prime  mission  equipment  and  associated 
logistics  support)  and  that  it  will  be  evaluated 
by  the  review  levels  of  the  acquisition  cycle. 
The  program  managers  and  their  staffs  must 
develop  a  complete  system  management  framework 
for  their  day-to-day  decision  making.  This 
framework  will  depend  to  a  great  deal  on  the 
usefulness  and  credibility  of  the  staff 
specialists  who  develop  and  implement  the 
trade-off  study  techniques  used  in  decision 
r.oking.  To  increase  the  uso  of  logistics  as  a 
criteria  in  i.yscem  acquisition,  the  logistics 
engineers  and  logiatics  managers  must  continue 
to  participate  ui  tlia  early  phases  of  the  sys¬ 
tem  acquisition  process-  To  do  this  they  will 
be  required  to  provide  the  effective  monaqenent 
techniques  to  justify  their  contentions. 
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BACKGROUND 


An  ever  Increasing  group  of  practitioners  and 
educators  has,  for  several  years,  advocated 
that  regionally  accredited  institutions  should 
offer  graduate  degree  programs  with  concentra¬ 
tions  in  procurement  and  contracting  or  mate¬ 
rials  management.  As  the  number  of  supporters 
has  expanded  so  too  has  new  terminology  more 
descriptive  of  the  needed  program  content. 

The  new  terminology  Includes,  variously,  ac¬ 
quisitions  management  or  acquisitions  and  as¬ 
sistance  management.  There  are  Indications 
that  such  a  degree  would  be  valuable  not  only 
to  the  holder  and  to  the  acquisitions  com¬ 
munity  but  to  our  evolving  social  system. 

During  the  last  10  years,  a  substantial  group 
of  masters  degree  holders  with  concentrations 
In  Procurement  and  Contracting  has  been  intro¬ 
duced  into  the  acquisitions  management  field 
by  existing  programs.  It  would  seam  that  the 
views  and  experiences  of  that  group  can  con¬ 
tribute  much  to  our  understanding  of  the  need 
tor  such  concentrations. 

Interest  in  the  development  of  model  graduate 
degree  programs  has  been  accentuated  by  the 
Federal  Acquisition  Institute's  (FAX)  initia¬ 
tives  as  published  in  the  FAI  Director's  re¬ 
port  each  month  since  its  inception  in  Octo¬ 
ber,  1977.  As  part  of  the  process  of  formu¬ 
lating  such  programs,  a  review  of  the  succes¬ 
ses  and  problems  experienced  by  existing  de¬ 
gree  granting  institutions  that  have  offered 
similar  programs  would  be  useful. 

One  of  the  first  such  programs,  the  Procure¬ 
ment  and  Contracting  (P&C)  program  at  The 
George  Wasnington  Unlveraity  (GVU)  was  begun 
in  the  Pall,  1968,  and  continues  today.  While 
this  paper  looks  briefly  at  the  GWU  program, 
its  major  thru6t  lc  to  examine  the  idea  of 
creating  graduate  degree  programs  in  acquisi¬ 
tions  and  assistance  management.  It  addresses 
the  matter  from  these  perspecr* «es:  (1)  the 
need  for  such  programs,  (2)  the  curriculum/ 
Institutional  environment  best  suited  to  such 
programs,  (3)  the  generally  low  Inte.est  in 
such  programs  expressed  by  accredited  institu¬ 
tions  to  dace,  ani  (4)  a  proposition  as  to 
what  attributes  would  interest  universities 
and  schools  In  adopting  such  programs.  In 
part,  the  paper  Is  baaed  on  a  survey  conducted 
in  March,  1978  of  graduate 3  of  the  GWU  pro¬ 
curement  and  contracting  program.  A  brief  de¬ 
scription  of  the  GWU  rrogram  will  perhaps  aid 
readers  not  faailiar  with  it. 


GWU  has  offered  its  P&C  program  as  a  field  of 
concentration  for  students  pursuing  either  of 
two  masters  degrees,  both  offered  by  GWU's 
School  of  Government  and  Business  Administra¬ 
tion.  The  two  degrees  are  the  Master  of  Busi¬ 
ness  Administration  (MBA)  and  the  Master  of 
Science  in  Administration  (MSA).  To  date, 
these  two  degrees  have  been  distinguished  in 
that  the  MBA  requires  the  student  to  accom¬ 
plish  the  full  cotanon  body  of  knowledge  as 
prescribed  by  the  American  Assembly  of  Col¬ 
legiate  Schools  of  Business  whereas  the  MSA 
has  not  required  the  full  common  body.^l/  Ad¬ 
ditionally,  at  GWU  the  MBA  has  been  offered 
as  en  "on-campus"  degree  whereas  the  MSA  has 
generally  been  available  "off-campus"  within 
the  Washington,  D.C.  area.  A  philosophical 
distinction  exists  in  that  the  MBA  is  con¬ 
ceived  aa  a  generalist  degree  that  prepares 
the  student  for  broadly  bused  business  mana¬ 
gerial  performance  and  roles  in  executive  de¬ 
cision-making.  The  MSA  is  designed  to  pro¬ 
vide  the  student  with  the  expertise  essential 
to  the  conception,  and  effective  management 
and  control  of  large-scale  organizational 
activities. 

The  P&C  program  was  initiated  at  GWU  with  sub¬ 
stantial  support  in  the  form  of  student  inputs 
from  the  armed  services.  It  shortly  gained 
additional  support  by  the  input  of  civilians 
drawn  from  the  Federal  procurement  workforce, 
particularly  from  the  Navy.  These  early  com¬ 
mitments  of  students—many  of  them  supported 
on  a  full-time  bosis—were  essential  to  the 
viability  of  the  new  program.  During  the  first 
three  years  of  the  program  nearly  all  P&C  stu¬ 
dents  were  government  employees.  With  the  de¬ 
velopment  of  the  program,  the  source  of  stu¬ 
dents  has  changed.  Increasing  numbers  of  stu¬ 
dents  employed  by  industrial  firms  in  the 
Washington,  D.C.  area  have  elected  the  P&C  pro¬ 
gram  as  they  pursued  their  master's  degree 
work  on  a  part-time  basis.  Also  a  number  of 
civilian  agency  personnel  are  enrolling  for 
part-time  study.  In  the  last  -■  years  a 


1/  Author's  note:  In  1977  the  GWU  BBA  program 
was  accredited  by  the  AACSB  and  at  present  the 
School  is  undergoing  an  intensive  self-examina¬ 
tion  of  its  masters  degree  offerings  in  prepa¬ 
ration  for  their  accreditation  review.  As  a 
result  some  modification  of  the  master's  pro¬ 
grams  is  likely. 
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small  but  significant  numVr  of  students  who  do 
not  have  previous  career  oriented  job  exposure 
have  been  opting  for  the  P6C  concentration  as 
they  complete  cheir  undergraduate  work  and  be¬ 
gin  pursuir  of  the  master's  degree. 

Overall  the  P&C  program  has  graduated  251  per¬ 
sons — an  average  of  25  per  year.  It  currently 
has  36  MBA  students  and  88  MSA  students  en¬ 
rolled,  for  a  total  of  124  graduate  degree  can¬ 
didates.  Additional  students  are  enrolled  In 
program  courses  on  a  non-degree  basis. 


THE  NEED 


Attempting  to  express  what  constitutes  the 
need  for  graduate  education  in  acquisitions 
and  assistance  management  leads  to  debatable 
assertions.  An  extraordinarily  complex  field 
of  study  Is  Involved.  This  complexity  results 
from  the  fact  that  several  recognized  and  es¬ 
tablished  academl-'  disciplines  are  drawn  upon 
in  order  to  effectively  manage  such  programs. 
The  field  Involves  largely  public  sponsorship 
and  private  performance  (but  with  frequent 
partial  reversal  of  those  roles)  of  work  ef¬ 
forts  at  the  leading  edge,  of  acientific  and/or 
te.oimo logical  experience  involving  either  the 
physical  or  social  sciences  or  both. 

Acquisitions  processes  embrace  a  broad  spec¬ 
trum  of  management  activities  critical  to  a 
central  core  subject:  i.e.,  the  decision  to 
acquire  either  goods  or  services.  This  fun¬ 
damental  decision  is  the  focal  point  of  an 
unmeasured  degree  of  organizational  effort. 

The  magnitude  of  the  effort  could  range  rrom 
near  total  organizational  mobilization  to  the 
unobservable  placement  of  automated  purchase 
orders.  Acquiultions  and  assistance  manage¬ 
ment.  however >  is  prlnciptlly  involved  In  the 
creation  and  management  oi  relationships  be¬ 
tween  organizational  entities  to  be  joined  in 
pursuit  of  significant  common  objectives. 

These  common  objectives  are  developed  thiougl 
the  articulation  of  a  need,  its  operational 
definition  and  identification  of  requisite  re¬ 
sources.  The  relationships  to  be  established 
involve  role  dcfinltir  jf  organizations, 
costing,  risk  and  res;  visibility  allocations, 
and  execution  that  assures  objective  ful¬ 
fillment. 

The  educational  product  needed  for  this  work 
is  a  manager  with  new  breadth  and  a  new  per- 
spective.  This  type  of  manager  muet  be  capable 
of  accomplishing  hla  or  her  objectives  even 
thouith  operating  without  tlirurl  authority  to 
control  either  performer  or  eponeor.  The  men- 
sfcemiMir  art  needed  llee  In  the  mnnngnr'a  abil¬ 
ity  In  1  I  ti  liiil»|toihleiit  out  I  flee* -vault  with  lit- 
dependent  urgent  in  I  Inn  i>h|«n-l  Ivon—  Into  mi  ul - 
furtive  team  with  u  ulngulut  hoi  i* r  i>h|u«  t  Ivw. 


Existing  management  literature  has  not  ade¬ 
quately  addressed  the  kinds  of  relationships 
or  the  dynamics  implied  by  such  organization¬ 
al  interfaces.  The  initiation  and  develop¬ 
ment  of  a  new  literature  Is  essential.  It 
must  address  the  concepts  of  interorganiza- 
tional  management.  In  its  traditional  form 
these  concepts  are  addressed  as  contractual 
relationships  in  which  one  organization  pro¬ 
cures  the  services  and  material  offered  by 
another.  More  recently  a  less  defined,  but 
well  known  instrument  has  increasingly  been 
employed — the  grant.  Currently  grants  have 
become  known  as  cooperative  and  assistance 
agreements.  These  kinds  of  Instruments  arc 
merely  legal  expressions  of  business  rela¬ 
tionships.  The  actual  ongoing  managerial 
challenge  is  a  dynamic,  and  frequently  ill- 
defined,  interpersonal  and  interorgam za- 
tioual  combination.  The  development  of  man¬ 
agers  with  such  lnterorganizational  capabil¬ 
ities  should  include  challenge  by  an  educa¬ 
tional  experience  that  allows  them  to  balance 
public,  private  and  personal  objectives.  They 
should  be  challenged  to  seek,  to  mediate,  and 
to  nehieve  fulfillment  on  each  front  in  a 
manner  that  simultaneously  meets  ihe  common 
set  of  objectives. 

The  author  proposes  that  a  need  exists  for 
academic  attention  focused  on  developing  pro¬ 
grams  in  acquisitions  and  assistance  manage¬ 
ment.  Today's  predominant  educational  mode — 
short  courses  conducted  in  non-nreredited 
settings  sponsored  by  employers  to  meet  spe¬ 
cific  organizational  needs  is  inadequate. 

While  the  need  for  degree  programs  can  be  as¬ 
sessed  in  numerous  ways  the  survey  of  gradu¬ 
ates  of  GWU's  P&C  program  may  prove  useful 
in  revealing  the  perceptions  of  a  group  that 
is  qualified  by  both  experience  and  educa¬ 
tion  to  make  a  knowledgeable  appraisal  of 
the  field. 


THE  SURVEY 


The  P&C  survey  was  conducted  by  use  of  a 
questionnaire  mailed  in  March,  1978  to  the 
entire  group  of  P&C  graduates  based  upon 
latest  known  addresses.  (See  Appendix  l) 
Fifty-five  undelivered  questionnaires  wen: 
returned  and  79  completed  and  usable  ques¬ 
tionnaires  had  been  received  by  April  6, 

1978.  The  data  Included  in  chit,  study  are 
based  upon  thnt  response.  The  response  rate, 
based  upon  an  assumption  that  196  question¬ 
naires  were  delivered  was  40  pot  cent.  The 
reaultnnr  sample  Is  wall  distributed  over  the 
population  of  PMI  grailuatus  .is  is  (ndliateil 
bv  Table  l. 
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A  further  Insight  Into  the  sample  Is  provided 
hv  Table  Tl.  This  'cable  seta  forth  the  gener¬ 
al  dtali  Unit  lop  of  the  respondent  a  hv  employer 
gtoup  and  lob  group.  Hased  on  Tahiti  11  It  ap¬ 
peals  that  two-thirds  of  the  PM',  graduate*  are 
working  within  the  acquisitions  field  hut 
several  (one-fifth)  of  them  have  progressed  or 
moved  into  jobs  with  broader  managerial  re¬ 
sponsibilities  . 

The  survey  sought  to  discover  the  perceptions 
of  P&C  degree  holders  regarding  the  institu¬ 
tional  environment  and  program  content  of 
greatest  value  for  personnel  in  the  acquisi¬ 
tions  field.  An  assumption  incident  to  the 
survey  is  that  the  respondents  would  be  more 
knowledgeable  of  the  field  and  of  the  educa¬ 
tional  needs  of  its  practitioners  than  any 
other  easily  defined  population.  All  of  them 
have  studied  and  nearly  all  have  practiced  in 
rhe  field.  The  results  are  set  forth  in 
Table  III. 

With  respect  to  whether  a  public  administra¬ 
tion  school  or  a  business  administration 
school  is  the  better  institutional  setting 
for  P&C  programs,  Table  Ill  provides  some 
insight.  It  is  a  tabulation  of  whether 
question  1  or  question  2  received  the  higher 
(strongly  affirmative)  rating  from  each  re¬ 
spondent.  Quite  clearly,  the  respondents 
were  supportive  of  either  (1)  the  business 
school  environment  or,  (2)  both  business  and 
public  administration.  Only  a  small  group, 

11  percent,  favored  the  public  administration 
school  over  business  administration.  However, 
the  high  number  of  "equally  affirmative" 
ratings  would  indicate  there  should  be  a 
place  in  both  types  of  schools  for  the  ac¬ 
quisitions  management  field.  The  breakout  of 
MSA  and  MBA  degree  holders  in  Table  III  is 
useful  since,  while  MBA  holders  might  be  ex¬ 
pected  to  prefer  the  business  school  environ¬ 
ment,  MSA  degree  holders  are  not  necessarily 
oriented  toward  "business"  although  they  are 
trained  In  the  administrative  and  management 
sciences. 

Whereas  Table  III  is  limited  to  indicating 
which  institutional  setting  is,  relative  to 
the  other,  felt  to  be  needed  more,  the  re¬ 
sponse  to  questions  1  and  2  is  summarized 
directly  in  Table  IV.  This  suntary  indicates 
the  strength  of  perceived  need  for  P&C -pro¬ 
grams  in  Business  and  Public  Administration 
schools. 

Respondents  were  strongly  affirmative  in  their 
view  that  procurement  and  contracting  programs 
should  be  available  in  public  and  business  ad¬ 
ministration  schools.  The  two  strongest 
ratings  (1  and  2  on  a  scale  of  5)  if  combined 
^for  public  administration  schools,  received 
53  percent  of  respondent  ratingc  while  the 
two  strongest  ratings  for  business  adminis¬ 
tration  schools  received  85  percent.  The  ap¬ 
parent  stronger  advocacy  of  business  adminis¬ 


tration  may  be  attributed  in  part  at  least  to 
support  of  certain  content  of  most  hualnsse 
piogimtvi.  This  oom'lunlon  !*  I  tulle  a  led  hv 
th«  t  oapotiMttH  tu  ipisut  ton  1  of  ills  quest  Ion 
ititlrn.  Question  ’)  nuked  respondent*  to  rule 
the  need  for  students  to  be  exposed  to  the 
full  business  common  body  of  knowledge  and  It 
referred  the  respondent  to  a  list  of  subjects 
representative  of  the  business  conation  body. 

The  response  to  this  question  provided  the 
most  strongly  affirmative  response  of  the 
entire  questionnaire.  It  is  recorded  in 
Table  V. 

As  shown  by  Table  V,  73  percent  of  the  sample 
answered  question  3  with  the  highest  per¬ 
ceived  need  (1) .  Also  78  percent  of  MBA  re¬ 
spondents  rated  it  with  (1),  and  for  the  whole 
sample  89  percent  rated  it  in  the  top  two 
categories.  Clearly  this  group  of  degree 
holders  perceives  the  business  common  body  of 
knowledge  to  be  an  important  element  of  the 
knowledge  needed  by  P&C  personnel. 


INSTITUTIONAL  CONSIDERATIONS 


Regionally  accredited  institutions  have  been 
8 low  to  embrace  degree  programs  in  acquisi¬ 
tions  management  at  either  the  bachelor’s  or 
master's  level.  Understanding  their  reasons 
for  slowness  is  critical,  and  several  aspects 
of  the  educational  process  need  to  be  consi¬ 
dered  in  this  context.  ^One  of  these  is  the 
reality  that  degree-oriented  programs  are  not 
generally  adopted  solely  because  some  spon¬ 
soring  institution — such  as  the  Federal  Gov¬ 
ernment — expresses  a  desire  for  a  particular 
program.  They  are  more  likely  to  be  adopted 
in  response  to  student  pressures  derived  from 
opportunities  for  employment.  Opportunities 
for  employment  are  also  critical.  Ideally, 
to  justify  installation  of  a  degree  program, 
the  opportunities  should  be  widely  distributed 
across  the  economy's  institutional  framework. 
Degree  programs  have  limited  appeal  if,  for 
example,  they  prepare  a  student  exclusively 
for  an  occupation  sponsored  by  a  single  in¬ 
stitutional  sector.  Occupational  mobility 
is  too  highly  valued  a  capability  among  our 
increasingly  professionalized  workforce  for 
narrowly  conceived  management  programs  to  be 
sustained  in  degree-granting  institutions. 

In  the  field  of  acquisitions  management  (or 
procurement  and  contracting,  purchasing, 
materials  management,  or  logistics  management 
as  various  programs  may  be  characterized), 
there  is  no  need  for  limited  institutional 
appeal.  All  levels  of  Government,  diverse 
public  and  non-profit  organizations,  industry 
and  construction  plus  all  other  major  employ¬ 
ment  sectors  have  need  for  creative  talent 
chat  knows  and  understands  acquisitions  pro¬ 
cesses  and  complexities.  Thus  it  would  appear 
that  the  design  of  acquisitions  management 
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programs  should  embrace  Che  demands  and  needs 
perceived  by  a  broad  group  of  management  peo¬ 
ple. 


(2)  A  belief  that  the  proposed  academic  pro¬ 
gram  has  multi-sector  appeal  in  our  economy; 


CONCLUSIONS 


(3)  A  philosophical  basis  and  position  for  the 
curriculum  that  addresses  all  of  its  elements; 


Educational  institutions  have  an  opportunity 
created  by  the  current  effort  of  FAI.  They 
may  come  forward  with  innovative  educational 
concepts.  The  Federal  interest  in  this  field 
provides  a  strong  motivational  basis.  How¬ 
ever,  the  educational  package  to  which  ac¬ 
credited  institutions  may  respond  may  require 
several  ingredients  beyond  an  expressed  need 
and  even  beyond  '•('sources  in  dollars.  The 
elements  of  that  package  include: 


(4)  Availability  of  basic  textual  and  case 
material; 


(5)  Academically  creditable  literary  oppor¬ 
tunities. 


While  parts  of  this  educational  package  exist 
for  acquisitions  management,  it  has  not  been 
broadly  articulated  to  date. 


(1)  A  belief  that  continued  student  partici¬ 
pation  and  Interest  will  be  present; 


TABLE  I 


DEGREE  &  DATE  OF  DECREE  OF  RESPONDENTS  TO 
PROCUREMENT  AND  CONTRACTING  QUESTIONNAIRE 


Date  of  Degree 


TABLE  II 


EMPLOYER  GROUP  4  JOB  GROUP  DISTRIBUTION 
OP  RESPONDENTS  TO  PROCUREMENT  AND 
CONTRACTING  QUESTIONNAIRE 


Job  Group 


General 

Management 


Materiale/Procurement 
u  Supply  Management 


Other 

Specialization 


U.S.  Govt. -Defense  Agencies 
U.S.  Govt. -Civil  Agencies 
Private  Business  Firms 
Non-Profit  Organlaationa 
Public  Agencies  (not  Federal) 


I 


I 


>1 


TABLE  III 

PUBLIC  ADMINISTRATION/ BUSINESS  ADMINISTRATION 
INSTITUTIONAL  SETTING  FOR  PROCUREMENT 
AND  CONTRACTING  DEGREE  PROGRAMS 


BA  setting  preferred 
PA  setting  preferred 
Equally  affirmative 
TOTAL 


MSA  Degree  Holders 

MBA  Degree  Holders 

Total 

10 

27 

37 

4 

4 

8 

12 

17 

29 

26 

48 

74 

STRENGTH  OT  PERCEIVED  NEED  FOR  PROCUREMENT 
AND  CONTRACTING  PROGRAMS  IN  BUSINESS 
AND  PUBLIC  ADMINISTRATION  SCHOOLS 

Strongly 

Affirmative 


Rating 

Public  Administration 
Business  Administration 


Degree  Respondent 
Holds 


PERCEIVED  NEED  FOR  PROCUREMENT  AND  CONTRACTING  STUDENTS 
TO  BE  EXPOSED  TO  THE  FULL  BUSINESS 
ADMINISTRATION  COMMON  BODY  OF  KNOWLEDGE 

Strongly 

Affirmative  No 


APPENDIX  I 


The  questionnaire  included  several  questions. 
The  section  pertinent  to  this  study  was: 

Having  completed  a  degree  with  c  procurement 
and  contracting  major,  your  evaluation  of 
the  following  questions  would  be  moat  valu¬ 
able  and  would  aid  us  in  our  planning  for  the 
future. 

Based  on  your  experience,  Indicate  how 
strongly  you  see  a  need  for: 

1.  PSC  programs  in  a  public  administration 
.school. 

2.  P&C  programs  in  a  business  administration 
school . 

3.  Exposure  of  P&C  students  to  the  full 
business  administration  common  body  of 
knowledge  (subjects  as  identified  on 
page  2). 


Strongly 

Affirmative  No 

1 _  2  3  4 _ 5__ 

1 _ 2  3  A _ 5_ 

1  2  3 _ A _ 5 


■=^1? 
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A  CRITICAL  REVIEW  OF  DEPARTMENT  OF  DEFENSE 
CIVILIAN  PROCUREMENT  CAREER  DEVELOPMENT  PROCRAMS 

Richard  T.  Cheslow  and  Thomas  M.  O’Hern,  Jr. 
Logistics  Management  Institute 


NOTE:  This  paper  is  a  condensation  of  a  report 
prepared  in  August,  1977.  Since  that  time,  or¬ 
ganizational,  definitional  and  scope  changes 
have  occurred  in  the  acquisition/contracting/ 
procurement  field.  These  changes  have  not  been 
implemented  into  the  career  program,  and,  con¬ 
sequently,  no  attempt  has  been  made  to  incor¬ 
porate  such  changes  into  this  paper.  However, 
the  findings  and  recommendations  remain  valid 
for  the  current  career  program  and  are  appli¬ 
cable  to  a  program  covering  either  the  acqui¬ 
sition  or  contracting  career  fields.  Although 
the  research  was  performed  in  the  procurement 
career  program,  many  of  the  conclusions  and 
recommendations  are  applicable  to  other  career 
fields. 


INTRODUCTION 


During  FY  1977  ,  the  Logistics  Management 
Institute  (LMI)  reviewed  and  evaluated  the  DoD 
civilian  procurement  career  program,  focusing 
on  certain  elements  to  determine  where  prob¬ 
lems  existed  and  to  recomnend  actions  for  im¬ 
provement. 

The  study  methodology  included  a  review  of 
career  development  and  management  1 iterature, 
DoD  directives  and  instructions,  and  Civil 
Service  Commission  (CSC)  regulations.  To  sup¬ 
plement  the  written  Information,  we  visited 
selected  offices  and  organizations  and  attended 
meetings  of  the  Defense  Procurement  Management 
Board  (DPCMB) ,  its  Subcommittee  on  the  Auto¬ 
mated  Career  Management  System  (ACMS) ,  and  the 
ACMS  Test  Team. 


FINDINGS  AND  RECOMMENDATIONS 


The  study  concentrated  on  eight  program  ele¬ 
ments:  personnel  recruitment,  mandatory  train¬ 
ing  requirements,  equivalency  tests,  career  ap¬ 
praisal  procedures,  personnel  inventory  and 
referral  systems,  personnel  mobility,  executive 
development^  and  organization  for  career 
development. 


A.  PERSONNEL  RECRUITMENT 


No  significant  problems  were  found  in  the  re¬ 
cruitment  of  new  personnel  into  the  procurement 
career  field.  In  the  preparation  of  new  em¬ 
ployees  for  a  procurement  career,  however,  some 
deficiencies  exist.  The  current  program 


applies  to  civilian  procurement  employees  in 
DoD  components  at  the  GS-5  and  above  levels  in 
the  GS1 101/1102/1103/1150  series.  For  other 
positions  and  series,  the  career  development 
program  applies  if:  (1)  more  than  50  percent 
of  the  duties  and  responsibilities  involve  pre¬ 
award  and  post-award  contracting  and  purchas¬ 
ing  functions,  and  (2)  the  experience  qualifi¬ 
cations  for  entry  into  one  of  the  four  series 
are  met. 

Positions  in  the  GS1105  (Purchasing)  andGS1106 
(Procurement  Clerical  and  Assistance)  series 
are  excluded  from  the  current  program  unless 
the  above  conditions  are  met.  However,  the 
major  or  descriptive  differences  between 
GS1105/U06  and  GS1101/U02/1150  positions  is 
that  the  former  emphasize  manual  skills  and  the 
latter  place  greater  emphasis  on  mental  and 
interpersonal  skills.  We,  therefore,  suggest 
that  the  relationship  between  the  career  pro¬ 
gram  for  GS1102  and  the  training  program  for 
GS1105/1106  should  be  mode  closer  for  two  rea¬ 
sons.  First,  since  the  GS 1105/1106  personnel 
are  performing  the  detailed  procurement  tasks, 
the  procurement  training  program  should  include 
them  to  ensure  effective  job  performance.  Sec¬ 
ond,  more  attention  to  GS1105/1106  personnel 
would  improve  implementation  of  upward  mobility 
programs  within  the  DoD,  as  recommended  in  a 
recent  GAO  report.  [8)  Another  personnel  re¬ 
cruitment  problem  i6  that  none  of  the  current 
DoD  intern  programs  cover  all  entrants.  This 
is  contrary  to  the  CSC  requirement  that: 

Each  program  is  to  include  all  employees 
in  the  agency  entering  an  identified 
career  field  at  any  level  below  the  recog¬ 
nized  Journeyman  without  regard  to  their 
source  of  recruitment.  (Emphasis  added) 

15T 

Recommended  Actions 

(1)  Include  training  for  GS1105  and  1106  in 
the  overall  civilian  procurement  train¬ 
ing  program. 

(2)  Comply  with  the  CSC  regulatlons-vhich 
require  training  of  all  entrants. 


B.  MANDATORY  TRAINING  REQUIREMENTS 


The  CSC  does  not  impose  specific  types  of  man¬ 
datory  training  upon  a  career  function.  It 
only  requires  that  first-line  supervisors  be 
given  suitable  initial  training  and  that  en¬ 
trants  be  given  proper  orientation. [3] [A] 
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Within  the  DoD, (17)  careerists  oust  -  ooplete 
"mandatory"  courses  or  approved  cquiv.lent 
courses  or  pass  the  equivalency  tests.  How¬ 
ever,  tills  requirement  is  nor  being  rig  irously 
enforced. 

In  1970,  the  GAO  reviewed  the  DoD  procuresent 
career  program  and  discovered  that  many  career¬ 
ists  were  not  completing  "mandatory"  training. 
17)  Little  improvement  was  noted  during  a 
follow-up  survey  in  1975(9)  when  GAO  found 
that,  of  13,882  employees  in  the  career  work 
force,  2,776  had  completed  their  mandatory 
training,  6,855  were  exempt  under  the  "grand¬ 
father"  clause,  and  360  were  under  waiver  due 
to  being  less  than  one  year  in  grade  at  their 
current  position.  Tims,  3,880  employees  were 
found  to  lack  the  "mandatory"  training  re¬ 
quired  at  the  previous  lc/el. 

The  condition  has  not  improved.  During  1977, 
only  311!  of  the  cureer  personnel  needing  a 
particular  course  completed  It.  (10)  However, 
since  the  qualification  standards,  as  set 
forth  by  the  CSC  (6),  do  not  Include  specific 
educational  or  training  requirements,  the  DoD 
cannot  impose  such  requirements  unilaterally. 
An  agency  can  only  recommend  that  certain 
education  or  training  would  be  helpful  in 
carrying  out  the  duties  and  responsibilities 
of  a  specific  job. 

1  The  DoD  will  soon  have  an  effective  means  of 
determining  specific  job  training  needs  — 
the  ACMS  appraisals.  These  appraisals,  con¬ 
sisting  of  a  set  of  technical  and  standard  fac¬ 
tors  for  each  series,  are  conducted  for  per¬ 
sons  intended  to  ee  at  the  C.S-13  level  and 
above  and  are  used  for  referral  purposes.  By 
analyzing  the  individuol  needs  shown  by  the 
appraisal  forms,  apejiiflc  training  require¬ 
ments  cun  be  formulated.  ACMS  contains  regis¬ 
trations  or  all  program  employees  below  GS-12 
and  the  CSC  requires  that  an  annual  evaluation 
of  euch  civil  service  employee  be  made.  There¬ 
fore,  it  appears  appropriate  for  DoD  to  add  nn 
appraisal  requirement  for  all  ACMS  registrants. 
Such  an  addition  is  not  intended  to  alter  the 
present  practice  of  filling  positions  below 
CS-13  at  the  discretion  of  Installation  mana¬ 
gers.  Ratlter,  the  appraisals  would  be  used 
for  training  purposes  onl- 

Recommended  Actions  < 

(1)  Confine  mandatory  training  to  those 
levels' authorized  by  CSC  regulations. 

(2)  line  ACMS  appraisals  to  pinpoint  the 
■ubjacta  and  skill  a  an  individual  needs 
in  order  to  perform  bio  job  satisfac¬ 
torily  and  to  prepare  him  for  greater 
responsibility . 

(3)  Analyze  current  procurement  courses  to 
determine  how  effectively  they  maet  the 
ne.vti  indicated  by  the  ACMS  appraisal*. 


C .  EQUIVALENCY  TESTS 


Currently,  procurement  employees  are  not  re¬ 
quired  to  take  mandatory  training  if  they 
(1)  have  successfully  completed  an  equivalent 
course,  or  (2)  have  passed  the  Procurement 
Knowledge  Test  (equivalency  test)  for  the 
course. 

There  is  a  serious  problem  in  the  lack  of  com¬ 
munication  between  civilian  personnel  offices 
administering  the  equivalency  tests,  the 
schools  preparing  the  tests,  and  the  functional 
managers.  One  consequence  of  this  information 
deficiency  Is  tint  it  is  unclear  at  the  moni¬ 
toring  levels  whether  the  most  current  tests 
are  being  given.  Because  the  equivalency  tests 
are  the  final  examinations  of  the  mandatory 
courses,  and  hence,  vary  in  emphasis  as  changes 
occur  in  the  functional  field,  such  lack  of 
communication  can  hinder  the  upgrading  of  the 
orocurement  career  force  by  not  properly  test¬ 
ing  on  current  subject  matter.  Furthermore, 
this  lack  or  feedback  makes  it  difficult  for 
toe  schools  to  assess  Che  quality  (and  needs) 
o ■  courses . 

Re'.ently,  the  Army  accepted  responsibility  for 
supervising  procurement  equivalency  tests  and 
is  -.orrecting  this  deficiency.  Therefore,  no 
fnriher  recommendation  in  needed. 


D.  CAREER  APPRAISAL  PROCEDURES 
AND  PERSONNEL  INVENTORY  AND 
REFERRAL 


The  1>>D  Civilian  Procurement  Career  Manual  de¬ 
fines  career  appraisal  as 

that  process  of  inventorying  and  evalu- 
at'  ng  the  attributes  and  potential  capa- 
bi  ities  of  each  employee.  It  includes 
analysis  of  career  training  needs  for 
on  crly  progression  within  the  caruer 
fluid  and  the  planning  for  fulfillment  of 
tta  se  needs.  [17) 

The  &  inual  also  stresses  that  career  appraisal 
shoul 1  be  an  ongoing,  day-to-day  responsibil¬ 
ity  i  F  the  supervisor.  Annual  forma)  career 
appr.  ibais  are  also  required. 

DoD  ,aa  maintained  the  Centralized  Automated 
Invc  itory  and  Referral  System  (CA1RS) ,  which 
was  intended  to  contain  a  current  resume  for 
each  employee  In  the  procurement  career  pro- 
grsi  .  The  purpose  of  the  referrol  system  was 
to  y rovlde  management  with  a  listing  o(  the 
be8i  qualified  candidates  for  procurement 
pos.  tion  vacancies  at  tne  CS-1J  lev  i  end 
nboi’C  while  ensuring  tnnt  all  eligic. .  candi¬ 
dates  are  considered  for  Job  openings  and  en¬ 
couraging  movement  across  geographical  and 
departmental  boundaries. 
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CAIRS  has  not  been  successful  in  achieving  its 
purposes  due  to  the  inadequacy  of  its  single- 
number  appraisal  process.  Too  many  referrals 
for  an  opening  results  when  this  inadequacy  is 
coupled  with  CAIRS'  empnasis  on  experience  and 
Its  Inability  to  identify  individuals  not  in¬ 
terested  in  a  Job  change. 

ACMS  is  to  replace  CAIRS  and  is  presently  being 
tested.  Its  most  significant  feature  is  a  now 
appraisal  system  which  provides  for  evaluation 
ia  a  large  number  of  Job-related  factors, 
thereby  permitting  a  more  accurate  review  of 
an  individual's  strengths  and  weaknesses. 

Recommended  Action 

Continue  to  monitor  the  implementation  of  ACMS 
and  evaluate  its  effectiveness  for  one  year 
after  on-line  operation  starts. 


E.  PERSONNEL  MOBILITY 


Mobility  Includes  occupational,  organizational, 
program,  functioaal,  or  geographic  change.  The 
CSC  recognizes  that  mobility  can  be  an  impor¬ 
tant  factor  in  a  person's  career  and  the  Mili¬ 
tary  Services  encourage  mobility  and  often  make 
it  a  requirement  for  entry  into  certain  pro¬ 
grams. 

The  CURS  Annual  Report  for  1977  revealed  that, 
of  271  selections  made  during  that  year,  141 
of  the  selectees  crossed  -component  lines,  12X 
changed  major  organizations  within  the  compon¬ 
ent,  4%  changed  classification  series,  and  21% 
moved  to  another  geographical  area.  Evidence 
of  executive  mobility  in  the  DoD  was  also  pre¬ 
sented  in  a  study  119]  covering  Federal  execu¬ 
tives.  The  portion  of  the  study  dealing  with 
62  supergrades  found  that  91.9%  had  experienced 
"organizational  mobility,"  77.4%  had  private 
sector  experience,  and  46.8%  were  "geographic¬ 
ally  mobile."  These  data  show  that  civilian 
Federal  executives  are  mobile  and  mobility  need 
not  be  a  concern  in  civilian  procurement  career 
development. 


F.  EXECUTIVE  DEVELOPMENT 


Problems  exist  in  reviewing  executive  develop¬ 
ment  programs  because  of  the  many  different 
definitions  of  "executives."  In  its  policy 
guidance,  the  CSC  used  the  term  "executive"  to 
mean  G5-16,  17,  18,  or  equivalent.  [1]  In  de¬ 
veloping  its  guidelines,  however,  the  CSC 
tended  to  use  characteristics  descriptive  of  a 
"general"  manager.  This  has  led  to  the  inclu¬ 
sion  of  individuals  in  supervisory  positions  at 
lesser  grades  who  had  relatively  broad  opera¬ 
tional  responsibilities.  Another  CSC  issuance 
states  that  the  term  "managerial  position" 
refers  to  the  duties  of  a  position,  regardless 


of  the  grade  or  salary.  12]  In  applying  tills 
latter  standard  for  identifying  executlvca, 
there  are  many  CS-13s,  14s,  and  15s  in  field 
installations  who  satisfy  it. 

Each  agency  is  required  to  have  a  formal  high- 
potential  identification  system  and  the  CSC 
permits  each  agency  to  make  its  own  decisions 
regarding  the  Identification  process  best 
suited  to  its  managerial  manpower  needs. 

In  a  study [18]  concerning  civilian  executive 
development  programs  In  the  DoD,  it  was  found 
that  DoD  management  perceived  the  following 
inadequacies  in  the  programs:  (i)  absence  of 
a  well-defined  system  for  eorly  identification 
of  potential  executive  talent;  (2)  unsatisfac¬ 
tory  means  for  tracking  the  ptogresu  of  high- 
potential  executive  candidates;  and  (3)  devel¬ 
opment  of  civilians  tends  to  be  unsystematic 
and  unreliable.  None  of  the  DoD  components 
had  a  fully  operative  executive  development 
program  in  compliance  with  CSC  regulations, 
although  most  have  policy  implementation  guide¬ 
lines  and  regulations. 

Recommended  Actions 

(1)  Redefine  "executive"  so  as  to  avoid  ura- 
biguity  and  to  enhance  uniformity  in 

the  use  of  executive  development  programs. 

(2)  Apply  the  recommendations  in  Section  B 
above  to  determine  the  training  needs 
of  executive  personnel. 

(3)  Utilize  the  ACMS  appraisal  system  to 
identify  potential  executives  and  track 
their  progress  more  efficiently. 


G.  ORGANIZATION  FOR  CAREER  DEVEI-OPMENT 


A  number  of  DoD  directives  and  instructions 
provide  the  basis  for  career  development  pro¬ 
grams.  (11)  [12]  (14)  [15] 

Two  additional  Instructions  are  relevant  in 
the  procurement  career  field.  DoD  Directive 
5010.16  (13)  establishes  the  Defense  Manage¬ 
ment  Education  and  Training  (DMET)  Board  whose 
responsibilities  include  developing  policy 
guidance  and  plans  for  management  training  and 
for  reviewing  and  approving  education  and 
training  programs.  DoDI  5100.58  (16)  estab¬ 
lishes  the  Defense  Procurement  Career  Manage¬ 
ment  Board  which  assists  the  DoD  functional 
head  in  carrying  out  his  responsibilities  for 
the  operation  of  the  career  program.  The 
DPCMB  is  a  part-time  board  which  meets  approx¬ 
imately  once  a  month. 

A  1970  GAO  report [7]  stated  that  an  ineffec¬ 
tive  working  relationship  existed  between 
these  two  boarda,  having  a  negative  impact 
on  the  procurement  career  program.  The  career 
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program  was  not  likely  to  succeed  in  the  ab¬ 
sence  of  a  single  focal  point  with  full  re¬ 
sponsibility  for  effectiveness. 

The  problem  which  CAO  identified  still  exists. 

A  major  contributor  to  the  management  problem 
appears  to  be  the  ambiguity  that  characterizes 
caieer  program  directives.  Similar  ambiguities 
concerning  the  proper  roles  of  the  civilian 
personnel  and  procurement  functions  also  exist 
at  the  lloD  component  levels. 

Our  findings  indicate  that  greater  precision 
in  the  assignment  of  organizational  responsi¬ 
bilities  might  resolve  this  problem.  This  can 
be  dotu.  by  revising  the  basic  career  program 
directives  to  wreate  responsibilities  similar 
to  the  following: 


-  Recruitment 

-  Kntry  program  administration 

-  Course  scheduleing 

-  Inventory  &  referral  systems 

-  Personnel  scheduling  for  training 

-  Personnel  appraisal  development 

-  Administration  of  training  resources 

Responsibility  of 
the  Functional  Office 

-  Course  content 

-  Job  training  requirements 

-  Conduct  personnel  appraisals 

-  Maintain  liaison  with  MRA&L 

-  Evaluate  effectiveness 

The  rationale  for  such  a  division  of  responsi¬ 
bilities  is  that  manpower  and  training  offices 
possess  the  expertise  necessary  to  develop  and 
administer  the  career  programs,  while  the  func¬ 
tional  offices  possess  the  expertise  necessary 
to  determine  the  requirement  for  training  and, 
therefore,  the  content  of  each  program. 

Recorcoended  Action 

The  OSD  should  clarify  and  simplify  the  multi¬ 
ple  directives  regarding  career  programs. 


SUMMARY 


This  paper  notes  a  number  of  deficiencies  In 
the  present  DoD  civilian  procurement  career 
development  program:  low  utilization  of  train¬ 
ing  courses,  non-compl lsnce  with  CSC  raguls- 
ciona,  and  diffused  organizational  rsaponul- 
bllitiea. 

In  ao  dynamic  and  highly  regulated  a  field  es 
governmental  acquisition,  the  esse  for  aetruc- 
cured  career  development  system  ia  very  strong. 
Without  formal  training,  the  risk  of  retaining 


obsolete  concepts  and  procedures  In  current 
operations  is  high.  In  addition,  DoD's  career 
development  program  must  be  supportive  of  the 
Federal  Government's  commitment  to  the  upward 
mobility  program  and  true  equality  of  oppor¬ 
tunity.  Affirmative  management  action  toward 
meeting  these  goals  necessarily  involves  a 
system  concept  of  career  development.  Tills 
concept  Involves  a  reformation  of  the  goals, 


definitions,  and  structure  of  the  entire  pro¬ 
gram  with  emphasis  on  individuals'  career  plans 
and  DoD's  organizational  requirements.  The 
essence  of  the  system  should  be  "mandatory" 
career  development  rather  than  "mandatory" 


training 


For  the  proposed  system  to  be  effective,  a 
control/evaluation  mechanism  is  needed.  The 
new  ACMS  should  be  used  for  thi6  purpose. 

ACHS,  as  currently  defined,  includes  evalu¬ 
ation  of  the  employee's  needs  for  further 
training  in  specific  job  functions.  It  also 
provides  for  Identification  and  planning  for 
employee  and  agency  future  needs.  Expanded 
use  of  the  ACMS  system  can  result  in  specific 
Identification  of  training  needs,  better  plan¬ 
ning  for  training  resources,  more  effective 
use  of  existing  resources,  and  more  effective 
control  of  resources. 
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SHOULD  COST" -WHY  ARE  HE  NOT  UTILIZING  THIS  CONCEPT  TO  A  GREATER  EXTENT? 
H.C.  Hoehl,  Air  Force  Institute  of  Technology 


INTRODUCTION 


!  f'.iosl  f'Mir  decades  the  single  largest  buy¬ 
ing  agency  In  the  United  States  (perhaps  the 
world)  has  ’'een  the  Department  of  Defense(DOD)  . 
With  the  exception  of  the  past  few  years,  DOD 
has  traditionally  received  the  major  share  of 
t^e  federal  budget  and  if  current  world  condi¬ 
tions  follow  their  present  course  a  greater 
share  of  Che  budget  must  again  be  allocated  to 
defease . 

Department  of  lit  rense  agencies  do  expend 
"’ll)  Ions  annually  for  Items  which  do  not  con¬ 
tribute  to  increasing  our  living  standard, 
because  of  their  ambivalent  nature  these  ex¬ 
penditures  naturally  cone  under  close  scrutiny 
and  even  become  a  "whipping  boy"  for  certain 
members  of  Congress,  pacifists,  and  unilateral 
disarmament  advocates.  The  fact  that  the  DOD 
budget  is  annually  spent  on  contracts  with 
thousands  of  private  firms  and  educational 
institutions  employing  several  million  people 
Is  gene: oily  overlong*.!.  Furthermore,  that 
our  national  security  is  based  upon  our  mili¬ 
tary  strength  Is  apparently  of  lessor 
Importance  to  chose  with  more  Immediate  person¬ 
al  motives.  On  the  ocherhand,  these  groups, 
unknowingly,  may  be  the  conscience  of  our 
society  and  arc  providing  the  catalyst  we  re¬ 
quire  to  strive  ever  harder  to  obtain  the 
necessary  defense  at  the  least  possible  cost. 
This  U  a  goal  we  have  not  achieved  according 
to  repeated  cost  overruns  in  many  DOD  con¬ 
tracts.  With  reference  to  such  cost  overruns, 
the  frequent  unanswered  question  la — WHY? 

In  an  effort  to  answer  this  question,  the  au¬ 
thor  researched  several  areas  and  found  the 
"Should  Cost"  concept  a  most  logical  answer 
*-nd  solution  to  the  problem  and  developed  this 
into  a  1975  Doctoral  Dissertation. 

Many  people  arc  unfamiliar  with  the  term 
"Should  Cost."  Unfortunately,  there  Is  no 
universally  accepted  definition.  It  is  pri¬ 
marily  an  approach  to  f  pricing  of  "High- 
Cost"  hardware,  bought  rom  private  industry 
operating  In  a  non-conpetltive  environment, 
and  which  assures  that  a  contractor's  propos¬ 
als  do  not  include  the  cost  effect  of  past 
Inefficiencies  or  uneconomical  management  prac¬ 
tices.  Furthermore,  It  attempts  to  supply  the 
scope  and  detail  necessary  to  determine  what 
weapons  system,  or  major  component  thereof 
ought  to  cost,  assuming  reasonably  attainable 
economy  and  efficiency  In  the  contractor's 
operations,  and  still  permitting  a  contractor 
a  reasonable  profit,  If  he  operates  prudently. 
It  dots  not  develop  a  "rock-bottom"  figure 
which  would  require  a  contractor  to  drastically 


alter  his  operations.  The  government  docs  not 
seek.  In  the  "Should  Cost"  method,  data  bv 
which  the  contractor  will  be  told  how  to  con¬ 
duct  Ills  business.  Nor  does  It  assume  chat 
contractors  should  be  able  to  forsee  all  the 
intangibles  and  unknowns  confronting  him  during 
the  life  of  a  contract.  It  slmplv  attempts  to 
eliminate  the  perpetutatlon  of  :>ast  Ineff iclen- 
ics  and  uneconomical  management  practice*,  h” 
contractors.  A  Spin-off  to  this  should  resu! : 
In  a  ..w.e  ponpet Jtlvc  contractor  In  the  futuri  . 

The  first  "Should  Cost"  studv  was  conducted  bv 
the  Navy  at  the  direction  of  the  '.sser  Seer,, 
tary  of  Defense,  Robert  S.  McNamara,  i'  <ne7. 
The  location  was  the  Pratt  &  Vhitncv  Aircraft 
Company's  engine  plant  in  East  Hartford  CT. 
There  was  great  concern  for  the  company's  hist' 
proposed  contract  price  for  the  TR-30  Jet  en¬ 
gine  destined  to  power  the  F— 111  aircraft. 

The  outcome  of  the  studv  reduced  the  estimated 
contract  price  bv  S10D  millions.  The  Armed 
Services  Ptocurcmcnt  Regulations  (AS^R) ,  \r-.  , 
Air  Force,  and  Navy  directives  ••pull  out  t’>- 
"Should  Cost"  concept. 


OBJECTIVES  CONTAINED  IN  THF.  DT.r-RTATTON 
RESEARCH 


Accepting  the  premise  that  the  "Should  Cost" 
concept  could  answer  the  earlier  question, 

"Why  do  major  weapons  systems  contracts  exper¬ 
ience  frequent  cost  overruns?",  the  primary 
objective  for  the  studv  was  to  letcrmlne  the 
educational  requirements  to  prepare  future 
"Should  Cost"  team  members  to  function  effec¬ 
tively  In  their  specific  tasks. 

Considering  thp  recency  of  "Should  Cost",  the 
following  specific  objectives  guided  the  con¬ 
duct  of  the  study:  1.  To  Identify  the  key 
elements  of  "Should  Cost."  2.  To  identify  any 
association  as  well  as  any  significant  differ¬ 
ences  in  the  responses  to  questions  In  each  of 
the  key  element  areas  provided  bv  persons  who 
served  as  team  Leaders  compared  with  the  re¬ 
sponses  to  the  same  questions  by  team  Workers. 
3.  To  identify  any  association  In  the 
responses  toward  "Should  Cost",  in  general, 
between  Vhe  two  groups — Leaders  vs  Workers. 

A.  To  identify  any  association  In  the 
responses  toward  "Should  Cost",  In  general, 
between  those  who  participated  In  sue1-  effort 
prior  to  ’aauarv,  1971  as  opposed  to  those 
participating  ince  tnnunrv,  1973.  3.  To 

identify  an-'  assr r i at *or.  1.:  M-p  t^sponscs  to¬ 
ward  "Should  Cost",  In  general ,  a  <  •*'  'ir 
Force,  Army,  Navy,  IlCAS,  and  DCAA  pcrmar.’i  as 
Independent  demographic  groups.  6.  To  Iden¬ 
tify  thp  ef fpet  of  formal  train!'’.,  in  prer-aring 
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team  members  for  their  tasks,  as  compared  with 
those  who  had  received  no  formal  training 
prior  to  serving  as  a  team  member.  7.  To  iden¬ 
tify  the  educational  needs  for  future  team 
members  as  perceived  by  former  team  Leaders  as 
opposed  to  former  team  Workers. 


ASSUMPTIONS  APPLIED  IN  THE  RESEARCH 


Public  demand  for  more  domestic  programs  will 
inc-ease,  resulting  in  pressure  to  cut  or,  as 
a  minimum,  not  permit  defense  spending  tu 
grow.  This  Implies  more  careful  scrutiny  cf 
defense  contractors. 

Inflationary  trends  and  increasingly  complex 
technology  assures  continued  high  cost  for  de¬ 
fensive  weapons. 

Either,  or  both,  of  the  above  will  tend  to  ex¬ 
pand  the  application  of  "Should  Cost",  to 
include  lesser  procurement  actions  currently 
excluded. 

World  tensions,  especially  in  the  Middle-East, 
will  remain  high  causing  continuing  demand  for 
our  military  hardware. 

"Should  Cost"  could  become  a  two-edged  sword. 
Where  it  1:  now  directed  sclely  toward  improv¬ 
ing  contractor  efficiency,  it  might  readily  be 
broadened  to  encompass  improving  government 
responsibility  as  a  party  to  the  contract; 
e.g.,  correctly  written  specifications,  accu¬ 
rate  drawings,  timely  delivery  of  serviceable 
government  furnished  items,  and  realistic  de¬ 
livery  schedules. 

That  a  single  elite  DOD  agency  might  be 
created,  staffed  with  carefully  selected 
qualified  persons,  and  assign  the  responsibil¬ 
ity  for  all  "Should  Cost"  analyses  to  this 
agency  rather  than  permitting  each  service  to 
perform  independent  studies. 


LIMITATIONS 


Two  distinct  limitations  were  applied  to  the 
research  effort:  1.  The  names  of  former 
"Should  Cost"  team  members,  furnished  by  their 
respective  agencies,  must  be  accepted  as  the 
total  population.  (Persons  who  had  transfer¬ 
red,  or  retired  with  no  lanedlately  available 
forwarding  address,  and  those  deceased  were 
excluded.)  The  extensive  effort  by  persons 
within  those  Services  in  screening  personnel 
records,  with  the  full  knowledge  that  the  re¬ 
search  effort  was  officially  approved,  would 
indicate  that  the  Hat  of  names  developed  does 
represent  the  total  population.  2.  The  re¬ 
search  was  not  Intended  to  develop  any  specif¬ 
ic  curriculum  or  course  of  study  for  future 
"Should  Cost"  team  members.  The  findings  may. 


however,  serve  as  a  guide  in  such  effort. 


RESEARCH  METHODOLOGY 


The  research  was  the  first  attempt  within  DOD 
to  study  the  attitudes  toward  "Should  Cost"  by 
former  team  members.  The  methodology  was  pri¬ 
marily  two-fold;  inductive  and  statistical. 

For  the  former,  the  author  sought  to  draw  gen¬ 
eral  conclusions  from  an  examination  of 
literature,  official  documents,  personal  inter¬ 
views,  and  an  evaluation  of  responses  to  a 
survey  questionnaire  sent  to  fifty  percent  of 
the  identifiable  former  "Should  Cost"  team  mem¬ 
bers  randomly  selected  from  the  total 
population. 

One  specific  result  of  the  first  method  was  the 
firm  evidence  that  four  key  element  areas  were 
identified  with  the  "Should  Cost"  concept. 
(These  were  utilized  in  the  statistical  portion 
of  the  research).  They  are:  Planning;  On-Site 
Data  Collection  and  Evaluation;  Report  Writing; 
and  Negotiations.  Responses  to  questions  I> 
these  key  elements  constituted  a  major  factor 
in  the  research. 

The  statistical  portion  of  the  research  at¬ 
tempted  to  detect  either  an  association  or 
significant  differences  in  the  responses  to 
questions  in  one  general  category  area  and 
four  key  element  areas  by  former  "Should  Cost" 
team  Leaders  compared  to  responses  to  the  same 
questions  by  former  "Should  Cost"  team  Workers. 

Thirteen  hypothesis  were  developed  and  tested 
to  measure  the  perceptions  of  former  "Should 
Cost"  team  members.  The  Spearman  rank  cor¬ 
relation  coefficient  (rs)  was  applied  to 
measure  the  association  in  responses  to  the 
same  questions  answered  by  the  two  specific 
grqups — Leaders  and  Workers.  The  chi-square 
(X‘)  test  was  utilized  to  measure  any  signifi¬ 
cant  difference  in  responses  to  the  same 
questions  by  the  two  groups.  Both  tests  were 
concerned  with  responses  to  questions  relating 
to  the  four  key  elements.  The  researcher  was 
willing  to  accept  a  five  percent  probability 
of  a  Type  I  error  rejecting  the  null  hypothe¬ 
sis  when  it  is  true,  thereby  setting  a 
significance  level  of  .05. 


POPULATION  AND  SAMPLE 


In  order  to  assure  that  responses  to  the  ques¬ 
tionnaire  did,  in  fact,  represent  the  total 
population,  a  random  sampling  technique  was 
utilized  to  select  fifty  percent  of  the  former 
"Should  Cost"  team  members  identified  by  the 
Army,  Air  Porce,  Navy,  Defense  Contract  Admin¬ 
istration  Service  (DCAS)  and  the  Defense 
Contract  Audit  Agency  (DCAA) .  The  latter  two, 
although  not  procuring  agencies,  did  have 
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members  serving  on  "Should  Cost"  toans . 

A  total  of  378  names  and  addresses  were  ob¬ 
tained  in  the  following  proportion:  The  Army 
Material  Command  (now  DARCOM) ,  196  people;  Air 
Force  Systems  Command,  96;  Navy  Material  Com¬ 
mand,  8;  DCAS,  33;  and  DCAA,  4J5.  The  small 
uura'er  of  N’avy  people  was  attributed  to  the 
fev  such  studies  conducted  by  the  Navy  after 
thev  initiated  this  concept  in  1967.  Most  of 
the  Navy's  former  tear,  members  had  either  re¬ 
tired  or  were  noc  readily  traceable.  The 
names  were  arranged  alphabetically  within 
their  respective  agencies  and  numbered  con¬ 
secutively.  A  validated  list  of  random  numbers 
wjs  applied  to  select  the  sample  to  be  surveyed 
plus  a  ten  percent  alternate  group.  Each 
selectee  was  as .  gned  a  Schedule  Control  Num¬ 
ber  and  suffix  letter  for  Identification, 
since  names  or  other  coding  might  have  invali¬ 
dated  Che  research.  The  relationship  of  each 
name  to  the  Control  Number  and  suffix  letter 
was  known  only  to  the  researcher. 

Responses  to  the  questionnaire  was  ninety-two 
percent.  Of  190  questionnaires,  160  were 
utilized.  This  represented  84.2  percent  of 
the  sampled  population.  This  reduction  wan 
necessary  because  fifteen  completed  question¬ 
naires  arrived  after  the  cut-off  date  and 
could  not  be  Included  In  the  study. 

A  Honeywell  635  computer  was  extensively  em¬ 
ployed  during  this  study.  A  special  computer 
program  was  developed  to  record  and  store  re¬ 
sponses.  Each  response  on  the  questionnaire 
was  coded  and  transcribed  onto  a  scan  sheet 
which  the  computer  read  and  scored.  Relation¬ 
ship  studies  arc  infinlcc.  Only  a  fraction 
of  the  available  Information  was  utilized  in 
this  study. 


LITERATURE  RESEARCH 


Three  computer  interrogations  were  conducted 
in  search  of  literature  on  the  topic  "Should 
Cost."  The  Educational  Resources  Information 
Center  (ERIC)  and  the  Current  Index  of  Journal 
Entries  (CIJE)  both  proved  negative.  The  De¬ 
fense  Documentation  Ccntr-  Cameron  Station, 
Virginia,  did  provide  a  lef  listing  of  arti¬ 
cles  in  Procurement  rclat- d  periodicals. 

These  proved  peripheral,  at  best.  The  scar¬ 
city  of  published  material  is  believed  a 
reflection  of  the  recency  of  this  concept. 


PERSONAL  INTERVIEWS 


Twenty-seven  people  were  privately  interviewed. 
Six  Air  Force;  twelve  Army;  two  Navy;  four 
DCAS;  two  DCAA;  and  two  from  the  Central  Ac¬ 
counting  Office  (GAO).  Only  two  of  this 
number  were  willing  to  be  quoted  which,  by 


itself,  might  lead  to  all  kinds  of  conlecture. 


FINDINGS 


Perhaps  the  most  relevant  feature  of  the  find¬ 
ings  was  the  extremely  high  percentage  of 
completed  questionnaires  returned  to  the  re¬ 
searcher  (92  percent).  The  population  Includ¬ 
ed  both  team  Leaders  and  team  Workers.  The 
Leaders  were  either  Team  Chiefs,  Deputy  Team 
Chiefs,  Operations  Officers,  or  Sub-Team.  Lead¬ 
ers.  The  Workers  comprised  all  other  tv*.* 
mcebef .  More  importantly,  every  Service.  A- 
gency,  and  Sub-Agency  involved  in  "Should  lost" 
studies  are  represented  in  the  research. 

The  researcher  anticipated  six  possible  curves 
which  might  be  drawn  to  show  the  opinions  ex¬ 
pressed  in  the  survey  questionnaire  by  two 
independent  groups  (team  Leaders)  and  (team 
Workers)  in  a  common  area.  Their  responses 
were  tabulated  on  a  range  from  a  low  score  of 
"1"  to  a  high  score  of  "5”.  Based  upon 
earlier  interviews  and  a  pre-test  question¬ 
naire,  the  researcher  anticipated  the  responses 
would  ultimately  evolve  Into  a  bi-oodal  curve 
with  the  team.  Leaders  scoring  on  the  higher 
side  and  team  Worker  responses  generally  scor¬ 
ing  on  the  lower  half  of  the  scale.  For 
further  clarification,  the  lower  ratings  on  the 
scale  would  Indicate  dissatisfaction  with 
"Should  Cost"  experience  and  vice  versa. 

Had  a  curve  been  constructed  to  reflcct  the 
actual  responses  to  the  questionnaire  by  the 
two  groups  (Leaders  vs  Workers),  the  resulting 
curve  would  have  been  skewed  well  to  the  right, 
or  high  side  of  the  scale.  This  would  reflcct 
that  both  groups  had  a  positive  attitude  to¬ 
ward  "Should  Cost".  It  would  also  support  the 
researcher's  earlier  thesis  that  the  "Should 
Cost"  concept  has  merit  and  an  educational 
program  for  future  teas  members  is  worthy  of 
consideration. 

The  most  significant  finding  during  the  analy¬ 
sis  was  the  consistency  with  which  the  null 
hypothesis  were  rejected.  Testing  the  associ¬ 
ation  in  responses  to  questions  between  the 
former  team  Leaders  and  Workers,  in  the  four 
key  clement  areas,  only  one  clement  was  found 
(Report  Writing)  where  the  computed  (rs)  fail¬ 
ed  to  reject  the  null  hypothesis.  A  probable 
reason  for  the  fsilure  to  reject  the  null 
hypothesis  in  this  element  is  the  contro¬ 
versial  aspect  of  "Report  Writing."  The  Air 
Force  does  not  write  a  report  as  it  generally 
understood  In  the  "Should  Cost"  concept.  In¬ 
stead  it  prepares  a  Price  Negctiacion 
Memorandum  fpNM) .  The  attitude  exnressed  by 
team  members  from  the  other  ser-'lr,-*  ,-nd 
agencies  was  that  the  Air  Force’s  FN“.  rot 
satisfy  the  requirement  of  "Report  Writing.” 
More  importantly,  they  did  not  see  the  Air 
Force  effort  as  being  a  "Should  Cos:"  studv 


because  the  Air  Force  does  not  use  the  full 
team  approach. 

Another  unanticipated  finding  was  the  Navy's 
reluctance  to  utilize  this  concept,  even 
though  they  gave  it  birth  in  196/.  As  a  con¬ 
sequence  rho  general  Accounting  Office  has 
been  highly  critical  toward  the  Navy.  No 
clear  reason  for  the  Navy's  position  was  es¬ 
tablished  by  the  research.  On  the  contrary, 
the  Army  has  been  applying  the  "Should  Cost" 
studies  regularly  and  with  excellent  results 
in  reducing  contract  costs. 

In  addition  to  the  circle'1  responses  on  the 
questionnaire  required  for  the  statistical 
measurements,  comments  were  also  solicited. 

One  hundred  thirty-three  were  provided. 

These  comments  ween  recorded  and  ranked  ac¬ 
cording  to  their  frequency.  Examples  were: 
"Supervisors  will  not  release  their  best  people 
to  serve  on  "Should  Cost"  teaoj."  "Contractors 
resist  these  studies”;  "Lack  of  understanding 
the  purpose  and  objectives  of  these  studies"; 
"Not  enough  time  to  plan  adequately";  and 
"Communication  is  vital."  These  comments 
added  a  dimension  which  reinforced  the  sta¬ 
tistical  findings;  the  belief  that  "Should 
Cost"  studies  are  highly  beneficial.  However, 
the  method  of  organizing  the  teams,  their 
preparation  for  the  effort,  the  conduct  of  the 
study,  etc.  all  need  further  review  and  over¬ 
haul 

The  single  most  consistently  low  rated 
response  was  to  the  question,  "Would  you  like 
a  permanent  assignment  as  a  "Should  Coat"  team 
member?"  The  reason  for  this  low  rating,  in 
addition  to  the  frequently  appearing  comments 
cited  above,  were  the  lorg  absences  from 
families,  the  effort  demanding  twelve  hour 
days  and  six  days  per  week  without  extra  re¬ 
muneration  or  compensatory  time  off,  and  no 
expense  money  to  return  home  occassionally 
during  the  study. 


CONCLUSIONS  AND  RECOMMENDATIONS 


Several  general  conclusions  and  recommenda¬ 
tions  are  based  on  this  study:  1.  The  "Should 
Cost"  concept  is  sound,  however,  it  is  lack¬ 
ing  in  several  aspects.  2.  A  formal  training 
program  would  help  future  team  members. 

3.  The  comments  provided  would  provide  a  sound 
basis  for  developing  an  educational  program 
for  future  team  members.  Progress  through 
such  a  program  as  a  "team"  would  be  most 
beneficial.  A.  Change  the  procedure  for 
selecting  team  members.  Selection  prerogative 
must  be  above  the  Immediate  supervisory  level. 
S.  Standardize  "Should  Cost"  procedures  for 
all  services.  6.  Initiate  such  studies  ear¬ 
lier  in  the  procurement  cycle,  preferrablv 
during  the  research  and  development  phase, 

7 .  Contractors  need  to  be  informed  of  an 


impending  "Should  Cost"  study  at  time  of  in¬ 
itial  solicitation.  There  appears  little 
Justification  for  withholding  such  Information 
until  after  the  contractor  rubmits  his  pro¬ 
posal.  8.  Contractors  should  be  appraised  of 
the  benefits  "Should  Cost"  studies  may  provide 
their  company.  That  they  would  become  more 
competitive  in  the  future  is  manifest.  Q.  In¬ 
clude  Ceneral  Accourting  Office  personnel  on 
"Shculd  Cost"  teams.  This  would  provide  the 
team  with  CAO  expertise  in  a  timely  manner  and 
minimize  a  costly  duplication  of  effort:  each 
procuring  agency  engages  in  follow-  .p  studies 
as  does  the  GAO.  10.  Consideration  should  he 
given  to  establishing  Joint  Government-Indus¬ 
try  "Should  Cost"  teams.  Since  a  major 
portion  of  DOD  procurement  costs  are  incurred 
in  sub-cont ranting  by  a  prime  contractor, 
joint  studies  warrant  attention.  11.  Apply 
some  form  of  "Should  Cost"  toward  procuring 
agency  activities  to  insure  the  government 
provides  accurate  drawings,  clear  specifica¬ 
tions,  realistic  delivery  schedules,  and 
servicable  government  furnished  components  at 
the  proper  time  and  in  required  quantities. 
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A  NEW  LOOK  AT  PROFESSIONAL  CERTIFICATION 


Daniel  Roman,  George  Washington  University 
Robert  Springer,  Jr.,  The  American  University 


ABSTRACT 


Professional  certification,  as  now  offered  by 
various  private  associations,  may  be  a  feasible 
approach  to  Increasing  procurement  professional¬ 
ism  in  the  public  sector,  according  to  a  study 
recently  completed  by  the  authors.  This  method 
of  encouraging  professionalism  has  been  very 
beneficial  when  employed  in  the  private  sector. 
There  are,  however,  a  number  of  cautions  which 
must  be  observe'1  if  such  programs  are  to  be 
offered  by  the  public  sector,  as  shown  by  the 
experience  of  private  associations  in  developing 
these  oroqrams. 

Approximately  sixty  private  certification  pro¬ 
grams  offered  by  professional  associations  were 
contacted,  and  in-depth  studies  conducted  by 
field  interview  with  the  managers  of  nine  of 
these  programs.  In  every  case  the  associations 
are  enthusiastic  about  their  programs  and  plan 
to  continue  them.  A  number  of  individuals  who 
had  been  certified  also  were  contacted  and  their 
views  solicited.  In  general,  the  attitude  of 
those  certified  also  was  favorable,  although 
perhaps  net  to  the  degree  found  in  the  sponsoring 
organizations. 

Professional  certification  is  not,  of  course,  a 
new  concept.  Certification  programs  have  been 
deeply  rooted  in  the  structure  of  the  traditional 
professions  for  at  least  one  hundred  years.  They 
developed  for  a  combination  of  reasons,  including 
t.he  desire  of  the  professions  to  raise  their  pro¬ 
fessional  standards  by  establishing  qualifications 
for  entry,  the  encouragement  and  recognition  of 
skills  development,  and  the  enhancement  of  the 
prestige  of  the  professional  or  the  profession 
in  the  eyes  of  the  public.  Also,  in  some  cases, 
self-certification  was  initiated  by  professions 
to  eliminate  abuses  and  preclude  government  In¬ 
tervention  and  regulation.  In  other  instances, 
certification  was  developed  for  economic  reasons, 
primarily  to  reduce  the  danger  of  an  oversupply 
of  skills  which  result  i>  ncreased  competition 
and  lower  rewards. 


hospital  adnini  strati  on,  information  sciences, 
insurance,  banking,  traffic  and  transportation, 
contracting,  procurement,  material  management, 
and  management. 

The  following  are  some  of  the  preliminary  find¬ 
ings  of  the  study: 

1.  Certification  programs  have  been  a 
strong  ana  effective  force  in  increasing  pro¬ 
fessional  awareness,  pride  and  confidence  in 
nearly  all  organizations  investigated.  Officials 
and  members  alike  speak  with  enthusiasm  of  their 
certification  programs. 

2.  Examinations  are  essential  to  effective 
certification  programs.  Of  one  group  of  thirty 
programs  Investigated,  only  one  permitted  experi¬ 
ence  to  be  used  in  lieu  of  examinations.  If  a 
certification  program  Is  to  have  "teeth"  and  be 
effective,  this  form  of  objective  quality  control 
is  essential, 

3.  "Grandfathering,"  or  waiving  examinations 
for  practitioners  with  certain  levels  of  experi¬ 
ence,  is  a  highly  controversial  issue,  with 

good  arguments  both  for  and  against  this  tech¬ 
nique.  The  study  found  that  while  "grandfather¬ 
ing"  may  be  unavoidable  in  some  cases,  the  less 
grandfathering  the  better,  and  that,  if  possible, 
grandfathering  should  be  eliminated  completely. 
Grandfathering  often  dilutes  the  effectiveness 
of  programs  and  weakens  quality  control. 

4.  One  of  the  major  advantages  of  certifi¬ 
cation  programs  for  all  professions  is  that  they 
fcrce  a  disciplined  examination  and  identifica¬ 
tion  of  the  body  of  knowledge  of  the  profession. 
Many  professions  have  existed  for  years  with  only 
a  loose,  vague  appreciation  or  understanding  of 
their  own  concepts,  techniques,  theories,  and 
practical  applications.  The  requirement  for 
certification  examinations  forces  a  profession 

to  state  these  things  clearly  and  concisely. 


Professional  validation  and  some  form  of  certifi¬ 
cation  are  becoming  increasingly  important. 

Many  of  the  professions  which  have  traditionally 
had  some  form  of  certification  are  reviewing 
their  standards  and  processes  for  continuing  pro¬ 
fessional  validation.  Additionally,  many  pro¬ 
fessions  which  previously  had  no  established 
standards  or  processes  for  professional  recogni¬ 
tion  have  seriously  embarked  upon  certification 
programs.  To  give  some  indication  of  the  range, 
certification  programs  have  existed  or  been 
initiated  in  recent  years  in  finance,  accounting, 
engineering,  personnel  and  industrial  relations, 
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AN  ANALYSIS  OF  THE  CAS  >tlO  TRANSITION  METHOD 

CAPTAIN  GRADY  L.  JACOBS 
HEADQUARTERS  UNITED  STATES  AIR  FORCE 


INTRODUCTION 

Cost  Accounting  Standard  (CAS)  lilO,  "Alloca¬ 
tion  of  Business  Unit  General  and  Administra¬ 
tive  Expenses  to  Cost  Objectives,"  (l)  pro¬ 
vides  criteria  for  the  allocation  of  business 
unit  general  and  administrative  (G&A)  expenses 
to  business  unit  final  cost  objectives  based 
on  a  beneficial  or  causal  relationship.  One 
of  the  fundamental  requirements  of  the  stand¬ 
ard  is  that  the  G&A  expense  pool  of  a  business 
unit  shall  be  allocated  to  final  cost  objec¬ 
tives  of  a  cost  accounting  period  by  means  of 
a  cost  input  base  (2)  representing  the  total 
activity  of  the  business  unit.  A  business 
unit  whose  disclosed  or  established  C03t 
accounting  practice  prior  to  1  October  1976 
was  to  use  a  sales  or  cost  of  sales  allocation 
base  may  elect  to  use  a  transition  method  con¬ 
tained  in  Appendix  A  of  the  standard  in  lieu 
of  an  equitable  adjustment  under  the  CAS 
clause.  According  to  the  CAS  Board  (3),  the 
transition  method  was  designed  to  avoid  poten¬ 
tial  disputes,  minimize  the  impact  of  shifting 
from  a  sales  or  cost  of  sales  base  to  a  cost 
input  base,  and  avoid  the  need  to  use  the 
equitable  adjustment  provision  of  the  CAS 
clause  to  reprice  prime  contracts  and  subcon¬ 
tracts.  In  general  the  transition  method  pro¬ 
vides  that  G&A  expenses  will  continue  to  be 
allocated  to  contracts  with  effective  dates 
prior  to  the  applicability  date  of  the  stand¬ 
ard  (pre  CAS  UlO  contracts)  by  using  a  sales 
or  cost  of  sales  rate  and  base,  until  these 
contracts  are  completed.  At  the  same  time, 

G&A  expenses  will  be  allocated  to  contracts 
with  effective  dates  subsequent  to  the  appli¬ 
cability  date  of  the  standard  (post  CAS  UlO 
contracts)  by  using  a  cost  input  rate  and 
base.  The  simultaneous  use  of  different  rates 
and  bases  for  different  classes  of  contracts 
continues  until  all  pre  CAS  1*10  contracts  are 
completed.  A  consequential  result  of  the 
transition  method  is  aggregate  G&A  expense 
allocations  which  exceed  actual  G&A  expenses 
incurred  by  the  business  unit  (>i). 


(1)  !.  CFR  1*10 

(2)  Total  cost  input,  value  added,  or  single 
element 

(3)  CAS  Board  Prefatory  Comments  to  CAS  hlO , 

1*1  Fed  Reg  l6,lUl  (1976) 

(It)  It  is  also  possible  to  have  an  underallo¬ 
cation  of  G&A  expenses  in  e  given  account¬ 
ing  period  under  certain  circumstances. 
Over  the  entire  transition  period,  how¬ 
ever,  there  will  be  a  net  overallooat.ior. 
of  G&A  expenses. 


This  paper  presents  the  results  of  research 
conducted  for  the  purpose  of  better  under¬ 
standing  the  overalloeation  of  G&A  expenses 
tinder  CAS  UlO  and  for  evaluating  various  pol¬ 
icy  options  for  dealing  with  problems  engen¬ 
dered  by  the  overalloeation.  This  paper  does 
not  attempt  to  treat  a  number  of  quite  compli¬ 
cated  legal  and  accounting  issues  which  are 
also  germane  to  establishing  u  DOD  position  on 
the  overalloeation  problem,  except  to  the 
extent  necessary  to  provide  perspective  and 
context  for  the  research  conducted.  The  prob¬ 
lem  of  attributing  overallocated  G&A  expenses 
to  different  categories  of  contracte  is  dis¬ 
cussed,  and  an  attribution  model  is  developed. 
Policy  options  for  dealing  with  overallocated 
G&A  expenses  are  identified  and  discussed, 
along  with  a  computer  model  which  was  devel¬ 
oped  for  simulating  these  options  for  various 
business  units.  The  paper  concludes  with  a 
discussion  of  the  policy  option  selected  for 
implementation  within  DOD. 

OVERALLOCATIOH 

Figure  1  provides  a  summary  of  the  CAS  i*10 
transition  procedure  which  has  two  main  fea¬ 
tures  -  the  simultaneous  allocation  of  G&A 
expenses  using  different  rates  and  bases,  and 
a  suspense  account  provision,  which  was 
designed  to  prevent  overreimburBcmant  (5)  of 
G&A  expenses.  The  mechanics  of  the  transition 
accounting  procedure  are  illustrated  ir.  figure 
2,  which  utilizes  data  from  the  example  con¬ 
tained  in  CAS  1*10,  appendix  A.  This  figure 
shows  how  allocations  are  made  over  a  three 
year  transition  period. 

In  order  to  understand  the  overalloeation,  it 
is  first  enlightening  to  perform  a  simple 
graphic  analysis.  Figure  3a,  based  on  example 
year  1978,  illustrates  how  the  allocation 
bases  overlap,  which  results  in  an  overalloca¬ 
tion,  shown  by  the  shsded  area.  The  overallo- 
cation  can  be  calculated  from  the  graph  as: 

($1850  -  $1700)  x  .125  =  $18.75 

Figure  3b,  based  on  example  year  1979,  is  a 
more  typical  situation  where  there  are  differ¬ 
ences  in  both  the  G&A  rates  and  the  allocation 
bases.  Here  the  overalloeation  can  be  calcu- 
cated  from  the  graph  as: 


(5)  It  is  important  to  distinguish  between 
overalloeation  and  overreimbursement . 

Here  overreimbursement  relates  to  a  situa- 
tioi.  where  a  contractor  would  receive  pay¬ 
ment  for  overallocated  G&A  expenses  and 
maintain  this  cash  flow  advantage  into 
perpetuity. 
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FIGURE  1 

TRANSITION  METHODOLOGY 

«  G&A  FOR  CAS  COVERED  CONTRACTS  AWARDED  PRIOR  TO  THE  EFFECT  I VE  DATE 
OF  CAS  410  WILL  CONTINUE  BEING  ALLOCATED  ON  A  COST  OF  SALES  BASE. 

•  G&A  FOR  CAS  COVERED  CONTRACTS  AWARDED  AFTER  I  HE  EFFECTIVE  DATE  OF 
CAS  410  WILL  BE  ALLOCATED  ON  A  COST  INPUT  BASE. 

•  AN  INVENTORY  SUSPENSE  ACCOUNT  EQUAL  TO  THE  BEGINNING  INVENTORY  OF 
CAS  COVERED  CONTRACTS  ON  THE  EFFECTIVE  DATE  OF  CAS  410  IS  ESTAB¬ 
LISHED. 

„  1C  the  ENDING  INVENTORY  OF  CAS  COVERED  CONTRACTS  AWARDED  AFTER  THE 
EFFECTIVE  DATE  OF  CAS  410  BECOMES  LESS  THAN  THE  AMOUNT  IN  THE 
INVENTORY  SUSPENSE  ACCOUNT,  THE  GOVERNMENT  RECEIVES  A  CREDIT  IN 
THE  AMOUNT  OF  G&A  ALLOCATED  TO  CAS  COVERED  CONTRACTS  IN  THAT  YEAR 
COMPUTED  AS  FOLLOWS: 

-  THE  DIFFERENCE  BETWEEN  THE  INVENTORY  SUSPENSE  ACCOUNT  AND  THE 
FNOING  INVENTORY  OF  CAS  COVERED  CONTRACTS  TIMES  THE  COST  OF 
SALES  G&A  RATE  FOR  THE  FIRST  YEAR  OF  TRANSITION. 

•  THE  INVENTORY  SUSPENSE  ACCOUNT  IS  THEN  REDUCED  BY  THE  AMOUNT  OF 
THE  DIFFERENCE  BETWEEN  THE  INVENTORY  SUSPENSE  ACCOUNT  AND  THE 
ENDING  INVENTORY  OF  CAS  COVERED  CONTRACTS. 


FIGURE  2a 

Contracts]  Prior  to  lJan78  Contract!  After  »ap7j 


yen r  1978  Work  _  _.jjgrk 

Beginning  Inventory  $300  $200 

Coat  Input  <09  $0° 

Total  $700  seoo 

Cost  of  Sales  $00  $90 

Ending  Inventory  $100  $250 

GSA  Rates 

Coat  of  Safer  $375/$3000  «  12.5% 
Cost  Input  $375/$3000  *  12.5% 

G*A  Allocation 

Cost  of  Sales  |  75.00  68. 75 

Cost  Input  50.00  75. OC 

Transition  73.00  68.7! 


Non- CAS 
WorK 

CAS  Fixed 
Price 
Work 

CAS  Cost 
Contracts 

Hon -CAS 
Work 

CAS  Plx«d 
Price 
Work 

CAS  Coat 
Contracts 

Total 

$300 

$200 

0 

0 

0 

0 

$500 

4C0 

600 

700 

500 

500 

300 

3000 

$700 

$600 

$700 

$500 

$500 

$300 

$3500 

600 

5  SO 

700 

4S0 

400 

300 

300_0 

$100 

$250 

0 

$50 

$100 

0 

$500 

37.50  375.06 
37.50  375.00 
37.50  393.75 


Over  allocation  of  GSA  due  to  transition  method  -  $18.75 
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FIGURE  2b 


Contract!  Prior  to  IJ«n78  Contract!  Aftsr  !J«n78 


No.i-CAS 


Year  1979 

Work  . 

Beginning  Inventory 

$100 

Cost  Input 

400 

Total  , 

$500 

Cost  of  Sales 

450 

Ending  Inventory 

$  50 

CAS  Fixed 


Price 

Work 

CAS  Cost 
Contracts 

Non-CA£ 

Work 

$250 

0 

$  50 

600 

700 

500 

$850 

$700 

$550 

650 

700 

150 

$200 

0 

$400 

CAS  Fixed 
Price 
Work 

CAS  Cost 
Contracts 

Total 

$100 

0 

$500 

500 

300 

3000 

$600 

$300 

$3500 

250 

300 

2500 

350 

0 

$1000 

GtA  Rates  - 

Cost  of  Sales  $375/52500  -  15% 

Cost  Input  $375/53000  «  12.5% 


GtA  Allocstion 
Cost  of  Sales 
Cost  Input' 
Transition 


[67.50  97.50  105.00 
50.00  75.00  87.50 
67.50  97.50  10S.O0 


22.50  37.50  45.00  375. Q0 

62.50  .  62.50  37,50  [  375.00 

62.50  62.50  37.50  432.50 


Over  allocation  of  GtA  due  to  transition  nethcd  -  $57.50 


FIGURE  2c 


Contracts  Prior  to  !Jan78  Contracts  After  !Jan78  - 


Y#ar  1980 

Won-CAS 

Work 

CAS  Fixed 
Pries 
Work 

CAS  Cost 
Contracts 

Won-CAS 

Work 

CAS  Fixad 
Prica 
Work 

CAS  Cost 
Contracts 

Total 

Beginning  Inventory  $  50 

$200 

0 

$400 

$350 

0 

$1000 

Cost  Input 

400 

600 

•  700 

500 

500 

300 

3000 

Totel 

$450 

$800 

$700 

$900 

$850 

$300 

$4000 

Cost  of  Sales 

4S0 

800 

700 

450 

550 

300 

3250 

Ending  Inventory 

$  0 

$  0 

$  0 

$450 

$300 

$  0 

$  750 

GtA  Hates 

Cost  of  Sales 

$375/$3250 

-  11.5% 

Cost  Input 

$375/$3000 

•  12.5% 

GtA  Allocation 

Cost  of  Sales 

1 51.75 

92.00 

80.50  | 

51.75 

63.25 

34.50 

373.75* 

Cost  Input 

50.00 

75.00 

87.50 

|62.50 

62.50 

37.50  | 

375.00 

Transition 

51.75 

92.00 

80.50 

62.50 

62.50 

37.50 

386.75 

Over  allocation  of  GtA  due  to  transition  netliod  -  $11.75 
•Due  to  roundoff  in  GtA  rste 


($1800  -  $1700)  X  .125  =  $32,5 
plus  $1800  x  (.15  -  .125)  «=  1*5.0 


Tills  prlmative  analysis  does  not  establish  a 
general  relationship,  however,  since  the  allo¬ 
cation  rate  is  itself  a  function  of  the  allo¬ 
cation  base;  and  inventory  changes,  which  are 
the  basic  difference  between  allocation  of  G&A 
expenses  on  a  sales  or  cost  of  sales  basis  and 
allocation  of  G&A  expenses  on  a  cost  input 
basis,  are  not  considered.  In  order  to  estab¬ 
lish  a  general  relationship  between  cost 
inputs,  cost  of  sales  and  inventory  changes 
which  would  better  explain  the  G&A  expense 
overallocation,  it  is  necessary  to  derive  a 
rather  complicated  formula.  This  derivation 
is  given  m  Appendix  A,  while  figure  h  suamar-' 
izes  the  relationships  developed  (6). 

From  this  formula,  it  ia  clear  that  the  amount 
of  G&A  expenses  which  will  be  over  or  under 
allocated  in  a  given  accounting  period  is 
dependent  on  two  main  factors  -  the  amount  and 
direction  of  change  in  the  pre  and  po3t  CAS  LlO 
inventories  and  the  ratios  of  pre  and  post  CAS 
Alt)  cost  inputs  to  total  cost  input.  Figure 
5  provides  a  summary  table  that  explains  what 
will  h :pen  to  G&A  allocations  under  different 
circumstances. 


ATTRIBUTION  OF  THE  OVERALLOCATION 


Given  that  the  G&A  overallocation  can  be  pre¬ 
cisely  calculated,  there  is  also  a  question  of 
how  this  overallocation  can  be  attributed  to 
individual  contracts,  since  each  contract 
apparently  receives  an  allocable  share  of  G&A 
expenses  in  accordance  with  CAS  1*10.  When  con¬ 
tracts  are  viewed  individually ,  there  appears 
to  be  no  problem.  Costs  that  are  allocated  for 
estimating,  accumulating  and  reimbursement  pur¬ 
poses  are  based  on  expected  on.i  actual  costs 
incurred  for  the  accounting  period.  It  i3  only 
when  contracts  are  viewed  collectively  that  the 
overallocatior  becomes  apparent. 


Application  of  this  forumla  to  the 
example  data  in  figure  2c  gives  an  over¬ 
allocation  of  $12,50,  which  is  correct. 
The  $1175  amount  in  figure  2c  results 
from  roundoff  in  calculating  the  cost 
of  sales  G&A  rate.  This  incorrect 
amount  was  included  in  the  example  In 
CAS  U10. 


As  previously  discussed,  the  overallocation 
results  from  the  interaction  of  inventory 
changes  and  coat  inputs  between  pre  and  post 
CAS  &10  categories  of  contracts.  Since  this 
is  the  case,  the  overallocation  can  be  con¬ 
sidered  as  the  summation  of  jointly  interac¬ 
tive  component  parts,  i.e.,  the  interaction  of 
pre  CAS  !*10  non-CAS  covered  contracts  with 
post  CAS  bio  CAS  covered  contracts,  etc. 

Since  there  are  three  typos  of  contracts  with¬ 
in  each  category,  there  are  3  x  3  or  nine 
joint  contributors  to  the  total  G&A  overallo¬ 
cation.  Marginal  totals  of  this  matrix  for 
each  type  of  contract  can  be  interpreted  as 
conditional  amounts  which  can  be  atrributed  to 
either  pre  or  post  CAS  1*10  categories  of  con¬ 
tracts  if  it  is  desired  to  do  so.  The  equa¬ 
tions  for  this  model  arc  given  in  Appendix  B, 
while  figure  6  snows  the  results  of  these  cal¬ 
culations  using  the  prior  example  data. 

While  this  attribution  model  is  theoretically 
correct,  it.  poses  some  practical  problems 
in  application  because  of  constraints  imposed 
by  the  nature  of  the  contract  types  within 
the  pre  and  post  CAS  LlO  categories.  Whereas 
individual  elements  sum  to  the  total  G&A 
overallocation,  there  are  significant  differ¬ 
ences  between  marginal  totals  for  CAS  covered 
and  non-CAS  covered  contracts.  This  would 
preclude  use  of  this  model  for  establishing 
adjustment  amounts  under  a  policy  to  disallow 
overallocated  C&A  expenses.  The  amount  of  or. 
adjuetment  would  be  significantly  different 
depending  on  whether  pre  or  post  CAS  1*  10  con¬ 
tracts  are  adjusted,  e,g.,  in  1978,  attribution 
of  the  overallocotion  to  pre  CAS  >*3  0  contracts 
would  result  in  an  adjustment  f  $*> . >*1  to  CAS 
covered  contracts,  while  attribution  to  post 
CAS  &10  contracts  would  result  in  an  adjustment 
of  $11.09.  This  difference  arises  because 
non-CAS  covered  cont  racts  are  not.  subject  t  o 
adjustment. 


POLICY  OPTIONS 


If  no  action  were  taken  by  the  Department  of 
Defense,  the  G&A  overollocations  which  would 
result  from  the  CAS  '-no  transition  method  would 
result  ip  substantial  windfalls  to  those  •'Oi- 
tractors  who  elected  to  utilize  the  transition 
method.  This  windfall  can  be  characterized  as 
either  increased  cash  flow  or  overpricing. 

This  distinction,  vhich  can  he  argued  on  both 
legal  and  accounting  grounds,  provides  a  basis 
for  two  alternative  approaches  for  dealing  with 
the  overallocation,  each  of  which  has  its 
peculiar  advantages  and  disadvantages. 

Based  on  a  survey  conducted  by  the  Contract 
Pricing  and  Financial  Office,  Headquarters 
U.S.  Air  Force,  the  total  estimated  G&A  ovot- 
allocation  Involving  five  contractors  (some 
with  mere  than  one  coot  center)  was  $110  mil- 
lion  over  the  transition  period.  Hie  results 
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FIGURE  h 


Over/Under  Allocation  =  G.  CIa  (BIp-EIp)  -  CI0  (BIa-EIa) 


‘p  '“  a  "*a' 


Where 


G  =  Allocable  G&A  Expenses 

CIa  =  Cost  Inputs  of  Contracts  awarded  after  CAS  410 

CIp  =  Cost  Inputs  of  Contracts  av;arded  before  CAS  410 

CIt  =  Total  Cost  Inputs  (CIp  +  CIa) 

CSt  =  Total  Cost  of  Sales 

BI  =  Beginning  Inventory  of  Contracts  awarded 
p  prior  to  CAS  410 

El  =  Ending  Inventory  of  Contracts  awarded  prior 
p  to  CAS  410 

BI  =  Beginning  Inventory  of  Contracts  awarded 
a  after  CAS  410 

El  =  Endihg  Inventory  of  Contracts  awarded  after 
a  CAS  410 


FIGURE  5 

EFFECT  OF  INVENTORY  CHANGES  ON  G&A  ALLOCATION 
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FIGURE  7 

G&A  OVERALLOCATION  SUMMARY 

($  MILLIONS) 

COST  CENTER 

1977 

1978 

1979 

1980 

1981 

1982 

TOTAL 

A 

$6.  4 

$14.46 

$16.03 

$6.63 

$2.97 

- 

$46.53 

B 

- 

(.19) 

1.34 

2.51 

- 

- 

3.66 

C 

- 

1.69 

.58 

.49 

.21 

$.15 

3.12 

D 

- 

2.01 

(.20) 

(.06) 

.82 

- 

2.57 

E 

- 

1.98 

.46 

- 

- 

- 

2.44 

F 

- 

18.62 

3.89 

7.45 

91 

- 

3C.87 

G 

- 

5.56 

7.52 

6.50 

6.21 

1.16 

26.95 

$6.44 

$44.13 

$29.62 

$23.24 

$1) .12 

$1.31 

$116.14 

-  - 


FIGURE  8 

CAS 

COVERED  CONTRACTS 

GfcA  ALLOCATIONS  AND  CASH 

FLOWS 

GtA  ALLOCATIONS 
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SALES 

INPUT 

TRANSITION 

DO 

TION  YR 

ALLOCATION 

ALLOCATION 

ALLOCATION 

NOTHING 

OPTION  1 

OPTION  2 

OPTION  3 

1 

5137. 4 

5137..; 

$141.4 

5140.6 

5137.7 

5130.3 

$136.6 

2 

144.4 

144.1 

1S4.8 

152.4 

142.7 

143.5 

142.0 

3 

154.9 

153.5 

165.3 

162.7 

1S2.4 

153*5 

150.9 

4 

164.4 

163.2 

168.8 

167.3 

164.1 

163.0 

161.7 

5 

172.3 

171.3 

174.3 

174.0 

174.5 

171.6 

170.9 

TOTAL 

$773.4 

$769.2 

$804.4 

5797.0 

$771.4 

$761.9 

$762.1 

6  (PROG  PKP  CARRYOVER) 

7.4 

1.0 

7.4 

7.4 

TOTAL 

$804.7 

$772.4 

5769.3 

$769.5 

flow  advantages),  effectively  closed  out  equit¬ 
able  ad.Justr.cnt  as  a  realistic  option  for  most 
contractors.  Third  is  the  apparent  lack  of  con¬ 
sideration  given  by  the  CAS  Board  to  the  inter¬ 
play  of  the  method  with  DOD  cost  principles  and 
contract  financing  policy. 


These  concerns  do  not  appear  to  have  been  ad¬ 
equately  addressed  by  the  Board  prior  to  promul¬ 
gation  of  the  standard,  even  though  studies  at 
the  time  apparently  indicated  that  GAA  over¬ 
allocations  resulting  from  the  transition  meth¬ 
od  would  increase  DOD  contract  costs  by  about 
$3 00  million  (7)-  Moreover,  the  transition 
method  was  promulgated  over  the  strong  object¬ 
ions  sf  DOD,  with  the  CAS  Board  emphasizing  as 
their  Justification  the  "impact  on  the  financial 
statements  of  affected  contractors"  (which  was 
unspecified)  that  would  occur  if  a  transition 
method  with  essentially  the  same  concepts  were 
not  adopted  (8). 


The  executive  Secretary  of  the  CAS  Board  ac¬ 
knowledged,  in  a  letter  dated  31  January  lOyS , 
to  the  Acting  Director,  Cost  Pricing  and  Fin¬ 
ance  Directorate,  Office  of  the  Under  Secre¬ 
tary  of  Defense  (Research  A  Ssgineering) ,  that 
it  was  recognized  that  the  use  of  the  transi¬ 
tion  method  results  in  an  overallocat ion  of  GAA 


expenses,  but  stated  that  "the  provisions  of 
CAS  hlO,  and  the  transition  method,  along  with 
the  proposed  DOD  progress  payment  policy  will 
effectively  implement  the  objectives  of  the 
(CAS)  Board  and  provide  adequate  protection  of 
the  Government's  interest."  While  this  state¬ 
ment  appears  to  confirm  that  there  is  a  defi¬ 
ciency  in  the  transition  method,  it  is  inter¬ 
esting  that  even  though  DOD  is  expected  to  cor¬ 
rect  the  deficiency,  the  manner  of  accomplish¬ 
ing  the  correction  is  seen  as  limited  to  prog¬ 
ress  payment  policy  changes.  This  position 
effectively  ruled  out  options  2  and  3  discussed 
previously.  'This  position  is,  however,  consis¬ 
tent  with  the  Board's  prior  observation  that 
DOD  "should  correct  any  existing  inequity  re¬ 
sulting  from  the  Department's  progress  payment 
policies  (9)-"  In  summary,  it  is  the  view  of 
the  author  that  the  CAP  Board  promulgated  >. 
defective  transition  method,  charged  an  exec¬ 
utive  agency  (DOD)  with  correcting  the  defect, 
and  then  constrained  the  method  by  which  the 
defect  is  to  be  corrected  in  n  manner  that  im¬ 
pacts  the  agency's  ability  to  contract  with 
private  industry. 


(7)  Minutes  of  CAS  Board  Meeting  Ho.  b8. 
Attachment  A:  Dissent  by  Mr.  McClary, 

Para  8l66,  Cost  Accounting  Standards  Guide, 
Commerce  Clearing  House,  Inc. 


(8)  Ibid,  Attachment  B:  Statement  of  Board 
Members  Staats,  Bevis,  Mautz  and  Walker. 


On  29  March  1978,  the  I  eputy  Under  Secretary 
of  Defense  (Acquisition  Policy',  in  a  memo¬ 
randum  to  the  Services  and  tne  Defense  I/igis- 
tics  Agency,  directed  that  a  revised  progress 
payments  clause,  incorporating  the  provision- 
of  option  1,  as  previously  discussed  (limiting 
progress  payments  on  GAA)  be  effective  on  new 
contracts  awarded  after  31  March  19''8. 

This  has  provided  an  undisputable  procedure 
for  dealing  with  GAA  overallocation3  under  CAP 
ItlO  (an  affected  contractor  who  desires  prog- 


(9)  Ibid 
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resa  payments  will  have  no  alternative  other 
than  to  agree  to  the  terms  of  the  clause).  The 
revised  clause  provides  that  the  payment  pro¬ 
cedure  will  not  apply  when  the  CAS  1»10  suspense 
account  is  less  than  $5  million.  The  revised 
progress  payment  procedures  are  believed  to 
adequately  correct  the  deficiency  in  the  tran¬ 
sition  method,  however  they  are  extremely  com¬ 
plex  ur.d  will  be  difficult  to  administer. 
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INVESTIGATION  OF  IMPLEMENTATION  OF  DODI  7000.2 
CRITERIA  ON  NAVY  SHIPBUILDING  PROJECT 


A.  M.  Feller,  University  of  California,  Los  Angeles 


INTRODUCTION 


This  study  was  undertaken  under  the  Office  of 
Naval  Research  (ONR)  program  concerned  with 
improvement  of  the  effectiveness  of  the 
Navy's  systems  acquisition  process.  An  in¬ 
vestigation  was  made  on  the  effectiveness  of 
current  Navy  project  management  systems,  and 


the  qually  of  current  project  status  report¬ 


ing  by  the  shipbuilding  contractor  in  terms 
of  the  degree  to  which  such  information  meets 
the  Navy  project  management  office  needs. 


This  paper  summarizes  the  results,  conclusions 
and  recommendations  resulting  from  an  investi¬ 
gation  undertaken  in  late  1977  in  connection 
with  a  Navy  combatant  shipbuilding  project  in 
a  private  shipyard. 


Cost/Schedule  Control  Systems 
Criteria  (C/SCSC) 


The  net  result  of  continuing  attempts  by  DOD 
to  develop  effective  project  management  has 
been  the  evolutionary  development  of  control 
systems  culminating  in  DOD's  Co3t/Schedule 
Control  System  Criteria  (C/SC'C)  (DODI  7000.2) 
being  currently  required  on  all  new  major 
system  acquisitions. 


To  date  there  has  developed  substantial  con¬ 
troversy  concerning  what  C/SCSC  is  supposed 
to  accomplish  in  Its  application  to  private 
contractors  doing  Vusineyss  id  th  the  govern¬ 
ment.  Research  conducted  at  the  Defense 
Systems  Management  School,  Fort  Belvolr, 
Virginia, *  has  concluded  that:  (1)  contractor 
personnel,  in  general,  demonstrate  a  better 
understanding  and  make  more  effective  use  of 
C/SCSC  concepts  than  do  the  government 
recipients  of  the  data;  (2)  the  government 
program  management  com-  nity  generally  lacks 
effective  communicati.  regarding  C/SCSC 
analysis;  and  (j)  government  managers  are 
reluctant  to  use  computer  and/or  operations 
research  approaches  to  analyze  the  data 
provided.  In  suaaary,  there  is  the  question 
as  to  whether  the  data  being  furnished  by 
the  typical  contractor's  cost/schedule  control 
system  are  sufficient  for  proper  execution  of 
government' 8  project  management  responsibili¬ 
ties  . 


Critical  Path  Network  Analysis 


One  of  the  commonly  used  program  management 
tools,  critical  path  analysis,  has  in  one 
form  or  another,  been  applied  to  an  increasing 
number  of  government  and  industry  projects 
since  its  early  U9e  on  the  1960  Navy  Polaris 
Program.  Critical  path  analysis  is  now  in 
general  use  on  Navy  weapon?,  air,  ship,  shore 
installation  and  other  projects. 


If  the  critical  path  technique  is  to  be  used 
by  Navy  project  management  on  a  project  where 
the  contractor  reporting  is  in  accordance  with 
DODI  7000.2  criteria,  there  is  the  important 
question  of  whether  the  contractor's  cost/ 
schedule  control  system  alone,  provides 
adequate  data  to  support  the  critical  path 
analysis.  If  not,  it  may  be  unfeasible  to 
use  the  network  approach  or  on  the  other  hand , 
dlfilcult  to  impose  still  additional  data 
recuirementj  on  the  contractor  to  support 
such  use. 


Investigation  Objectives 


The  primary  objective  of  this  investigation 
is  to  evaluate  Implementation  of  a  representa¬ 
tive  shipbuilding  contractor's  Navy-validated 
cost/schedule  control  system  to  determine 
whether  the  existing  reporting  data  elements, 
alone,  provide  sufficient  information  to  allow 
effective  Navy  use  of  the  critical  path 
technique  for  its  project  management  purposes. 
The  investigation  is  supported  by  conducting 
a  critical  path  analysis  of  the  shipbuilding 
project  using  only  those  data  routinely  sub¬ 
mitted  to  the  Navy  by  the  contractor  under 
C/SCSC, 


A  secondary  objective  is  to  identify  any 
additional  data  elements  which  could  conven¬ 
iently  be  provided  by  the  contractor  as  part 
of  its  standard  C/SCSC  reporting — which  would 
significantly  improve  the  Navy's  project 
management  inferaatj  ’  posture. 


METHOD  OF  APPROACH 


A  currently  underway  jmbotr.nt  ship  construc¬ 
tion  project  was  selected  for  this  .uvescjga- 
tion.  The  "Time  Now"  date  for  the  analysis 
was  selected  to  be  September  I,  1977,  at  which 
point  the  ship  construction  was  about  15 
percent  complete. 
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Among  several  candidate  critical  path 
techniques,  the  probabilistic  technique, 
PROMAP,  was  used  for  the  investigation 
because: 


RESUl.Tli 

The  results  of  the  investigative  PROMAP 
analysis  are  as  follows: 


A.  PROMAP  has  been  used  earlier,  in 
connection  with  construction  of  the  Lead 

Ship  of  this  class  and  the  Investigative  staff 
had  pertinent  prior  experience  and  data. 

B.  PROMAP  project  schedule,  resource 
and  cost  performance  statistics  in  formats 
facilitate  direct  comparison  between  PROMAP 
analysis  results  and  the  contractor  C/SCSC 
report  data. 

C.  PROMAP  is  unique  in  its  ability  to 
account  for  project  uncertainties^  and  their 
effects  on  shipbuilding  schedule,  costs  and 
resource  requirements. 


Critical  Path  Network 

The  critical  path  network  developed  by  the 
investigative  staff  represents  the  project 
plan  as  of  9/1/77  and  is  based  on  the  Work 
Orders  identified  in  the  contractor's  Job 
Status  Report  dated  8/28/77,  which  contains 
significant  detail  primarily  on  hull  erection 
Work  Orders  prior  to  Launch.  Preoutf ltting, 
outfitting,  test  and  evaluation  and  other 
post-launch  Work  Orders  are  represented  in 
gross  detail  because  of  the  lack  of  detail 
data  on  unreleased  Wor.c  Orders. 


5 
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SOURCE  DATA  FOR  INVESTIGATION 


The  contractor-furnished  data  were  obtained 
largely  from  two  periodically  submitted 
reports,  Material  Order  Schedule  and  Job 
Status  Report,  which  provide: 


A.  Identification  of  the  Work  Orders 
(which  are  used  as  the  "activity"  elements 
of  the  PROMAP  network) 


B.  Work  Order  scheduled  start/finish 


dates 


C.  Budgeted  manhours  for  each  Work 
Order,  by  craft 


D.  Projected  total  manhours  for  each 
Work  Order  not  yet  completed 


E.  Percentage  complete  for  each  Work 
Order  underway  at  the  report  date 


F.  Scheduled  delivery  dates  for 
materials  and  specification  items 


Because  the  contractu;  is  not  required  to 
submit  a  critical  path  network  aa  part  of  hit 
data  submittals  (nor  did  the  contractor 
maintain  a  network  plan  as  part  of  his  inter- 
•  nal  management  system) ,  precedence  logic  for 
the  activities  (Work  Orders)  of  the  critical 
path  network  were  Initially  developed  by  the 
investigative  staff. 


Later,  prior  to  completion  of  the  investiga¬ 
tion,  the  contractor  developed  its  own  criti¬ 
cal  path  network,  but  it  was  structured  at  a 
grosser  level  of  detail  than  the  Work  Order 
level. 


Schedule  Risk  Analysi- 


Because  the  contractor  did  not  report  on 
Work  Order  labor  requirements  by  craft,  beyond 
a  60-day  period,  it  was  assumed  that  adequate 
labor  resources  would  be  made  available  by 
the  contractor  to  perform  the  work  in 
accordance  with  the  schedule  dates  shown  in 
the  Job  Status  Report.  Accordingly,  no 
attempt  was  made  to  determine  whether  such 
resources  were  in  fact  available  and,  if  not, 
the  extent  of  any  resulting  schedule  slip¬ 
pages  . 


Two  analyses  were  run:  Baseline  Analysis 
utilizing  the  data  oa  current  budget  baseline 
and  Actual  Cost  Anaxysls  utilizing  data  on 
actual  work  progress  as  reported  in  the  con¬ 
tractor's  Job  Status  Report — by  item. 


Baseline  Analysis  (See  Figure  1)  indicates 
that  there  is  a  28  percent  probability  of 
attainment  of  the  hull  Launch  by  the  scheduled 
date,  October  14,  1978.  The  analysis  also 
Indicates  that  the  scheduled  performance 
should  be  accelerated  by  12  workdays  to 
realize  a  50  percent  probability  of  meeting 
the  scheduled  Launch  date.  Correspondingly, 
if  it  is  „  tred  to  attain  a  90  percent 
probabil. of  Launch  by  the  sdhedule  date, 
shipwork  would  i.ove  to  be  accelerated  by  31 
workdays. 


The  12  days  difference  between  the  con¬ 
tractor's  scheduled  Launch  date  and  ths  PROMAP 
"50  percent"  date  is  primarily  due  to  the 
"merger  bias"  which  is  the  schedule  impact  of 
project  uncertainties*  accounted  for  by  the 
probabilistic  analysis. 


As  compared  with  the  Baseline  Analysis 
results,  the  Actual  Cost  Analysis  (See 
Figure  2)  shows  that  the  probability  of  meet¬ 
ing  the  scheduled  Launch  date  la  reduced 
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from  28  to  22  percent.  To  realize  a  50 
percent  probability  of  meeting  the  Launch 
schedule,  shipwork  must  be  accelerated  by  13 
workdays;  to  realize  a  90  percent  proba¬ 
bility,  the  acceleration  must  be  33  workdays. 


Work  Order  Criticality  Analysis 


Because  PROMAP  accou-.ts  for  work  performance 
variability,  it  is  able  to  report  on  the 
"criticality"*  of  each  Work  Order  (in  contrast 
with  deterministic  critical  path  techniques 
-itieh  identifies  only  a  single  critical  path). 


TABLE  I 

ACTIVITY  CRITICALITY:  BASELINE  ANALYSIS 


TABLE  II 

CRITICALITY  REPORT:  ACTUAL  COST  ANALYSIS 


Code 

Descrinrion  Criticality  (t) 

Mile¬ 
stone  20 

Launch  FFG-9 

100 

A002 

Procure  Reduction 

Gear 

48 

LOAD002 

Locd  Reduction  Gear 

48 

243-01C 

Mach  Shaft  Bearing 

6  Boring 

46 

150-52C 

Erect  Dk  Hse  Str 

Unit  5-3 

44 

195-33B 

Erect  On  Ways  Unit  3-3 

44 

A001 

Procure  Main  Gas  Tur- 

bines 

42 

LOADOOl 

Load  Main  Gas  Turbines 

42 

245-02 

Ins  Prop  Hub  Pk/Secure 

24 

150-52C 

Erect  Dk  Use  Str 

Unit  5-2 

24 

195-34?. 

Erect  On  Way6  Unit  3-4 

20 

The  corresponding  criticality  values  for 
Actual  Cost  Analysis,  shown  in  TABLE  II,  be¬ 
low,  reveal  only  minor  differences. 


'  Criticality  is  defined  ->  the  probability 
that  a  given  Work  Order  ill  lie  on  the  criti¬ 
cal  path  during  the  course  of  the  project. 
Criticality  is  a  convenient  measure  of  the 
"sei  ^itivity"  —  or  importance  —  of  an  indi¬ 
vidual  Work  Order. 


Description 


Criticality 


Mile¬ 
stone  20 
A002 

LOAD002 

24J-01C 


LOADOOl 

150-53C 

195-33B 

245-02 

150-52C 

195-34B 


Launch  FFG-9 
Procure  Reduction 
Gears  (GFE) 

Load  Reduction  Gear 
Mach  Shaft  Bearing  & 
Boring 

Procure  Main  Gas  Tur¬ 
bines  (GFE) 

Load  Main  Gas  Turbines 
Erect  Dk  Use  Str  Unit 
5-3 

Erect  On  Ways  Unit  3-3 
Ins  Prop  Hub  Pk/Secure 
Erect  Dk  Hse  Str  Unit 
5-2 

Erect  On  Ways  Unit  3-4 


Production  Labor  Analysis 

PROMAP  presents  labor  requirement  statistics 
for  any  individual  craft  or  combinations  of 
crafts,  as  desired.  Because  contractor 
labor  pool  data  was  not  made  available,  It 
was  necessary  to  assume  that  sufficient 
labor  is  on  hand  to  meet  demand,  in  order  to 
avoid  "levelling"  of  the  work  load  due  to 
manpower  constraints. 

The  PROMAP  Baseline  Analysis  expected  total 
resource  utilization  of  2,067,254  manhours 
closely  matches  the  budgeted  2,067,818 
manhours  nhown  in  the  contractor's  Job  Status 
Report  while  the  Actual  Cost  Analysis  pro¬ 
jected  total  of  2,188,142  manhours  compares 
favorably  with  the  contractor's  projected 
2,117,437  manhours. 

As  shown  in  Figure  3,  s  peak  daily  Baseline 
requirement  for  592  workers  occurred  during 
the  two-week  period  ending  10/21/77;  dropping 
off  rapidly  so  thot  by  the  end  of  February 
1978  only  about  400  workers-per-day  are 
required. 

For  the  same  two  week  period,  the  Actual 
Cost  Analysis  (Figure  4)  indicates  an 
actual  peak  labor  requirement  of  670  workers- 
per-day,  or  a  13.3  percent  incrcanc  over 
the  Baseline  peak  requirement. 
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FINDINGS 


Budgeted  Cost  for  Work  Scheduled  (BCWS) 

BCWS  is  the  budget  applicable  to  the  labor 
scheduled  to  be  accomplished  within  a  given 
time  frame.  As  shown  in  Figure  5,  the 
cumulative  BCWS  expected  value  at  "Time  Now" 
is  interpolated  to  be  $7.28  million;  at 
project  completion,  $28.50  million.  The 
minimum  and  maximum  values  of  $27.87  million 
and  $29.01  million  respectively,  reflect  the 
variability  of  project  performance. 


Budgeted  Cost  for  Work  Performed  (BCWP) 

BCWP  is  the  budget  applicable  to  the  work 
actually  accomplished.  The  BCWP  tabulation 
of  Figure  6,  is  based  on  the  percentage 
completion  estimates  for  underway  activities 
contained  in  the  contractor's  Job  Status 
Report  (8/23/77).  The  value  of  BCWP  at 
"Time  Now"  is  interpolated  to  be  $6.8 
million. 


Actual  Cost  for  Work  Performed  (ACWP) 

ACWP  is  the  "Time  Now"  value  of  the  actual 
accumulated  hours  spent  on  Work  Order  line 
items.  As  shown  in  Figure  7,  the  ACWP  at 
"Time  Now"  is  interpolated  to  be  $7.1  million. 


Schedule  Variance  Analysis 

The  difference  between  BCWS  and  BCWP  values 
provides  a  schedule  variance  in  terms  of 
dollars.  In  the  FFG-9  case,  less  work  was 
performed  by  "Time  Now"  than  was  scheduled 
to  be  done  by  that  time  and  Che  resulting 
schedule  variance  is  $0.48  million,  which 
indicates  a  schedule  variance  in  terms  of 
time,  equal  to  9  workdays. 


Cost  Variance  Analysis 

The  difference  between  the  BCWP  and  ACWP 
values  at  "Time  Now"  provides  a  cost 
variance  between  the  actual  cost  of  work 
performed  to  date  and  the  budgeted  cost  for 
that  work.  The  cost  variance  amounts  to 
$0.3  million,  with  "actual"  cost  exceeding 
"budget"  cost. 


Estimated  Cost  at  Completion  (ECAC) 

ECAC  is  the  cumulative  totaJ  of  the  projected 
cost  at  completion  of  all  Woi.k  Order  items 
as  shown  in  Figure  7.  The  Expected  Value 
for  ECAC  is  $30.18  million  with  minimum  and 
maximum  values  of  $29.63  million  and  $30.58 
million,  respectively,  resulting  from 
variability  of  project  performance. 


The  investigation  resulted  in  a  number  of 
findings,  both  general  and  specific: 


General 

The  routine  data  submittals  resulting  from  the 
contractor's  validated  cost/schedule  control 
system  constitute  a  marginally  adequate  data 
base  to  support  a  Navy-maintained  critical 
path  network-based  project  monitoring  and 
control  system. 

The  contractor's  cost/schedule  control  system 
does  not  provide  adequate  data  upon  which  to 
base  a  meaningful  "forward  look"  which  in  a 
predictive  manner  may  be  used  to: 

(a)  Identify  potential  problems 

(b)  Evaluate  contractor’s  work  load  and 
work  force  planning 

(c)  Evaluate  cost/schedule  impacts  of 
change  orders  or  other  contract 
changes . 

The  contractor's  use  of  a  "deterministic" 

(as  opposed  to  "probabilistic")  scheduling 
approach  results  in  schedules  which  are 
inherently  optimistic. 

There  is  no  available  indication  of  the 
nature  of  the  contractor's  estimating  philo¬ 
sophy  which  provides  the  basis  for  his 
scheduling,  costing  and  resource  allocation. 
For  example,  were  estimates  "best,"  "most 
likely,"  "expected"  values,  or  other  deter¬ 
ministic  values?  Or  did  the  contractor 
obtain  three  values,  "optimistic,"  "pessimis¬ 
tic,"  and  "most  likely”  and  then  calculate  an 
"expected"  value.  Without  such  indication, 
it  is  difficult  to  determine  whether  the  in¬ 
puts  to  the  contractor's  cost/schedule  control 
system  are  biased  in  one  direction  oi  another 
(or,  for  that  matter,  whether  the  Navy’s 
independent  estimating  for  progressing  pur¬ 
poses,  is  similarly  biased). 

Although  the  contractor's  Monthly  Job  Status 
Report  and  other  submittals  identify  all  of 
the  Work  Orders,  the  absence  of  any  com  rec¬ 
tor-furnished  critical  path  network  or  other 
Work  Order  sequence  display  makes  it  difficult 
to  define  the  logical  predecessor-successor 
relationships  of  the  Work  Orders.  This 
deficiency  is  especially  critical  when 
considering  equipment  procurement  and  subse¬ 
quent  installation  schedule  pairs.  Accord¬ 
ingly,  it  Is  difficult  to  determine  the 
identity  of  the  Work  Orders  which  have  some 
level  of  criticality  and  therefore  require 
particular  Navy  management  attention. 
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Work  Order  duration  data  do  not  accompany 
the  schedules  shown  in  the  Monthly  Job  Status 
report,  which  makes  it  difficult  to  interpret 
the  significance  of  Che  Work  Order  scheduled 
start  and  finish  dates.  For  example,  the 
contractor  informed  the  investigative  staff 
chat  the  "start"  date  represents  Che  "earliest 
start  date"  and  the  "finish"  date  represents 
the  "latest  allowable  finish  data"  for  a 
Work  Order.  If  such  is  Che  case,  then  the 
contractor's  scheduling  approach  has  fully 
allocated  all  available  "float."  In  other 
words,  all  the  Work  Orders  arc  100  percent 
"critical." 

Many  Work  Order  schedules  shewn  on  the  Job 
Status  Report  a- a  not  compatible  with  the 
progressing  information  shown  thereon.  In 
some  instances.  Work  Orders  which  should  have 
been  completed  prior  to  the  "Time  Now"  date 
of  the  report  are  still  underway,  or  have  not 
yet  been  started.  In  many  sucli  cases,  the 
schedule  dates  are  supposed  to  be  annotated 
with  the  letter  "L"  along-slde,  denoting 
lateness;  however,  in  a  number  of  instances, 
such  a  notation  does  not  appear. 

The  contractor  releases  Work  Orders  to  the 
performing  activities  60  days  prior  to  the 
scheduled  store  dace  of  the  work.  Accord- 
tngly,  there  are  no  Job  Status  Report  details 
on  Work  Orders  scheduled  to  be  released 
beyond  the  60-day  period.  Such  information 
may  be  available  in  preliminary  form  some¬ 
where  in  the  contractor's  validated  control 
system,  but  Is  not  currently  being  required 
by  the  Navy  co  be  furnished  as  part  of  the 
contractor's  routine  data  submittals.  It  is 
concluded  that  such  data  is  not  required 
because  the  Navy  Is  not  employing  a  rigorous 
project  management  tool  which  can  employ  such 
data.  This  deficiency  seriously  handicaps 
any  "forward  look"  analysis  of  the  Impact  of 
changes,  late  deliveries  or  any  other 
"perturbations"  to  the  project  plan. 

The  different  contractor  C/SCSC  reporting 
documents  are  to  some  extent  updated  by  the 
contractor  independently  of  each  other,  with¬ 
out  suitable  cross-checking  interfaces, 
resulting  in  significant  onfliccs  in  data. 

For  example,  the  latest  lacerial  delivery 
schedule  made  available  for  the  purposes  of 
this  Investigation  represent  data  several 
months  old  and,  hence,  not  compatible  with 
the  current  contractor-released  Installation 
schedules.  Such  scheduling  Inconsistencies 
became  readily  visible  during  the  structuring 
of  the  PROMAP  critical  path  network  which 
requires  precise  Interfaces  between  Inter¬ 
dependent  Work  Orders. 

The  GFE/CFM  schedule  provided  co  us  by  the 
Navy  represented  contractuol  delivery  dates, 
not  necessarily  predicted  deltvcry  dates  on 
an  lteri-by-iten  basis,  ft  Is  suspected  thot 


Navy  tracking  of  CFE/GFM  is  not  sufficiently 
responsive  which  if  the  case,  can  lead  to 
potential  contractor  delays  and  disruptions 
resulting  from  late  deliveries. 


Specific 

The  process  of  subjecting  the  Work  Orders  to 
the  level  of  analytical  scrutiny  required  co 
develop  the  critical  path  network  revealed 
at  least  one  serious  error  In  the  sequencing 
of  hull  erection  tasks  implied  by  the 
extractor  schedules:  The  upper  units  of  the 
hull  above  c!..'  auxiliary  machine  rooms  were 
scheduled  to  be  erected  earlier  than  the 
scheduled  date  for  installing  the  diesel 
generators  in  the  auxiliary  machinery  rooms, 
immediately  below. 

The  Navy  apparently  does  not  currently  have 
routine  access  to  a  record  of  actual  start 
and  finish  dates  for  all  Work  Orders,  nor 
does  the  contractor  routinely  reschedule 
activities  which  were  due  to  start  or  finish 
by  the  "Time  Now"  date  but  have  not  actually 
done  so. 

Approximately  300  Work  Orders  were  found 
which  should  have  been  rescheduled;  200  of 
which  were  items  that  (according  to  the 
original  schedule)  should  have  started  before 
"Time  Now,"  but  did  not. 


RECOMMENDATIONS 

Based  on  the  results  of  this  investigation, 
it  is  recommended  that  the  DODI  7000.2 
criteria  as  applied  to  Navy  shipbuilding 
project  management  be  supplemented  to  Incor¬ 
porate  the  following  additional  procedures 
and  requirements  for  information  to  be 
furnished  by  a  contractor's  management  infor¬ 
mation  system. 

Within  30  days  following  award  of  a  ship¬ 
building  contract,  the  contractor  should  be 
required  to  deliver  an  "as  planned"  activity 
network  project  plan,  identifying  the  planned 
work  packages  and  the  Interdependency 
sequences  which  the  contractor  intends  to 
follow  in  order  to  meet  his  contractual 
commitments.  The  "as  planned"  project  plan 
need  not  be  regarded  as  a  commitment  as  to 
the  precise  manner  in  which  the  job  eventual¬ 
ly  will  be  done,  but  should  be  provided 
primarily  to: 

(1)  Assure  the  Navy  that  the  contractor 
has  conducted  adequate  planning, 
scheduling  and  res our c  ■  allocation 
for  proper  execution  oi  \.s  project. 
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(2)  Provide  the  Navy  with  an  important 
assist  in  interpreting  and 
rctionaiizing  the  large  amount  of 
data  otherwise  furnished  by  the 
contractor  under  DODI  7000.2 
criteria. 

Using  the  contractor's  initial  project  plan 
(6.1  above)  as  a  starting  framework,  the 
Navy  should  utilize  critical  path  analysis 
as  a  continuing  element  of  its  administration 
of  the  project.  The  critical  path  network 
should  be  maintained  and  updated  to  incor¬ 
porate  all  contractor  construction, 
procurement,  outfitting,  test,  evaluation 
and  other  actions  required  to  successfully 
complete  the  project.  In  addition,  GFE/GFM 
delivery  cycles  should  be  interfaced  with 
the  project  plan  and  continually  monitored 
and  evaluated  regarding  impact  of  GFE/GFM 
deliveries  on  contractor  performance.  Upon 
completion  of  the  project,  the  individual 
updates  of  the  maintained  critical  path 
network,  together  with  the  final,  "as  built" 
network,  will  provide  a  useful  documentation 
package  for  post-project  analysis  or  for 
claims  evaluation  purposes. 

The  Navy  should  require  early  submittal  of 
sufficient  detailed  information  on  all 
contractor  Work  Orders  to  allow  effective 
Navy  monitoring  of  the  planned  project  from 
start  to  completion.  To  allow  for  the 
preliminary  nature  of  the  details  on  Work 
Orders  that  are  scheduled  considerably  beyond 
“Time  Now,"  the  Navy  should  acknowledge  that 
any  advance  detail  data  submitted  on  Work 
Orders  are  preliminary — and  will  be  used  for 
Navy  planning  purposes,  only. 

The  Navy  should  require  that  contractor  data 
submittals  concerning  schedules  incorporate 
specific  data  on  Float,  Slack,  Criticality, 
or  other  measure  of  the  relative  importance 
of  each  of  the  Work  Orders  to  overall 
attainment  of  contractual  commitments. 

The  Navy  should  require  the  contractor  to 
routinely  submit  a  productive  labor  comparison 
by  month,  comparing  available  labor  resources 
with  the  level  required  to  meet  delivery 
commitments.  The  Navy  should  then  compare  such 
data  with  its  own  independently  developed 
data  for  the  purpose  of  evaluating  the 
adequacy  of  the  contractor's  resource  planning. 

Where  project  uncertainty  is  a  significant 
factor,  Navy  shipbuilding  project  management 
should  use  a  probabilistic  critical  path 
networking  technique  with  which  to  indepen¬ 
dently  generate  BCWP,  BCKS  and  ECAC  data 
which  can  directly  be  compared  with  contractor 
data  submittals. 
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Figure  5.  UuJ|',tc«r<]  Cost  For  Work  Scheduled 
(ICWS)  History,  Riseline  Run. 
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Figure  6.  Budgeted  Cost  For  Work  Performed  (BCVP)  History, 
Actual  Cost  Analysis. 
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replacement  COST  ACCOUNTING:  its  POSSIBLE  EFFECTS  on  government  contracts 

Captain  Robert  E.  Plzzi,  United  Static  Air  Force  Acanemj 
Lieutenant  Regis  Canny,  United  States  dir  Force  Academy 


ABSTRACT 


A  recent  development  in  the  accounting  profes¬ 
sion — replacement  cost  accounting — could  have 
a  major  impact  on  government  procurement  con¬ 
tracts.  Replacement  cost  accounting,  i.e., 
the  restatement  of  the  balance  sheet  and  income 
statement  to  reflect  the  effects  inflation  has 
had  on  corporate  assets — could  lead  manufac¬ 
turers  to  overconponsate  in  overhead  rates  and 
cost  o'  goods  sold  to  make  up  for  the  undcr- 
depreciatron  of  assets  and  the  underpilcing  of 
inventories  in  comparison  to  today's  costs. 

This  papei  will  explain  what  uolaccmenL  cost 
accounting  is  and  its  possible  >amlflcations 
for  government  contracts  in  accounting  for 
depreciation  and  cost  of  goods  sold. 


PART  I 

Tl'.L  WHY  OF  REPLACEMENT  CO-..  ACCOUNTING 


Financial  statements  based  on  historical  costs 
are  used  by  many  different  people.  Managers 
use  information  from  financial  statements  to 
improve  their  business  decisions.  Investors 
use  information  from  financial  statemcnis  In 
deciding  where  lo  invest  and  In  evaluating  the 
success  of  their  investments.  Lenders  use 
information  from  financial  statements  to  decide 
whether  to  grant  loans  and  what  conditions  to 
require.  The  U.  S.  government  in  general  and 
the  U.  S.  Air  Force  In  particular  use  financial 
statements  In  evaluating  various  procurement 
actions.  These  statements  are  used  to  evalua*. 
a  contractor's  financial  position  and  operating 
performance  to  determine  if  a  contract  should 
be  let,  continued,  or  cancelled. 

If  there  were  no  changes  In  the  purchasing 
power  of  money  and  no  changes  in  the  prices  of 
individual  Items,  historical  cost  accounting 
would  serve  all  users  of  financial  statements 
just  fine.  Assets  and  liabilities  measured  at 
historical  costs  would  reveal  the  financial 
position  of  Che  firm,  and  historical  costs 
matched  against  revenues  of  a  current  period 
would  pro  ide  n  useful  measurement  of  current 
performance.  The  past  and  present  measurements 
of  a  contractor's  performance  could  be  evalu¬ 
ated  on  the  3amc  oasis  without  having  to  worry 
about  restating  past  results  to  reflect  current 
prices.  Unfortunately,  life  is  not  Chat 
simple. 

In  recent  years,  almost  all  nations  of  the 
world  have  experienced  significant  Inflation. 
The  price  changes  that  have  occurred  have  made 


tin.  acini  statement*,  based  on  historical  coses 
useful  as  a  source  of  information  for  de" is io.t 
making  and  for  evaluating  past  performance  in 
light  ..i  today's  anLivities.  Simply  stated, 
hist  o’*  I*  al  i  ->»is  do  not  adequately  segregate 
line  operating  pn  fits  fiom  the  costs  of  sus¬ 
taining  the  business  during  periods  of  changing 
prici  levels.  For  example,  historical  cost 
1 in-iu  lal  statements  Lend  to  oeerstate  profics 
during  periods  of  rising  prUes  by  understating 
expense.  They  match  earn  nt  seventies  with 
dated  <<>sts  and  fail  tc  itvognize  the  eroding 
purchasing  power  of  the  dollar.  Specifically, 
'Lint  capacity  or  equ.pment  purchased  in  earlier 
pt i tods  becomes  "undervalued"  In  financial 
statements  during  periods  of  Inflation.  If 
1  liven  to.  ies  are  held  over  'ong  periods  o:  time, 
thee  too  are  shown  at  less  than  their  current 
value.  When  the  historical  costs  ot  these 
a -.vets  are  "matched"  with  revenues  to  measure 
income,  the  "income"  will  include  the  effects 
of  both  specific  price  changes  and  general 
inflation  and  nay  not  really  show  how  well  the 
contractor  has  performed.  Therefore,  in  infla¬ 
tionary  tines,  financial  statements  based  on 
Historical  costs  can  present  many  pmblems  to 
the  users  of  these  statements. 

In  order  u  overcome  the  problems  associated 
u  ■  t'i  the  use  of  historical  cost  statements  n. 
inflationary  periods  ond  to  provide  greater  in¬ 
formed'  o  to  the  users  of  financial  data,  the 
Si  .urines  and  Kxctinngi  Commission  (SEC)  Look 
an  inpre-edented  .step  m  tne  cccountlng 
Industry  The  SEC,  on  Norch  21,  19/6,  issuco 
Accounting  Series  Release  Ho.  UO  (ASR  No.  1901, 
wl* i ». is  requires  al)  SEC  registrants  with  inven¬ 
tories  and  gross  property,  plant  and  equipment 
viiicu  a-yregate  more  than  $100  million  and 
wliiih  i  uprise  more  than  10/  of  the  total 
assets,  ro  d»arlose  certain  specified  replace¬ 
ment  cost  data  in  financial  statements  filed 
with  the  SEC.  The  requited  data  arc:  (1)  esti¬ 
mated  current  replacement  cost  of  (a)  Inven¬ 
tories  and  tb)  productive  capacity,  at  the  eno 
of  each  fiscal  year  for  whicn  a  balance  sheet 
is  required,  and,  (2)  the  approximate  amount  of 
(a)  cost  of  sales  and  (b)  depreciation,  based 
on  replacement  cost  lor  the  two  most  recent  full 
fisril  /ears.  In  add! cion,  disclosure  will  be 
required  for  methods  of  determining  ropl  cement 
costs  and  any  additions,  information  that 
management  believes  is  necessary  to  prevent  the 
replacement  cost  information  from  being  mis¬ 
leading.  Disclosure  of  all  data  required  by 
ASk  No.  190  may  be  cither  in  t>  footnote  to  the 
financial  statements  or  In  a  separate  section 
of  the  financial  statements  following  the  notes. 
In  ils  release  the  SF.C  states  that  the  purposes 
of  Che  required  disclosure  ol  current  replace¬ 
ment  cost  information  are: 


519 


of 

'I 

V 

it 


js. 
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"CO  provide  information  to  investors 
and  other  interested  parties  which 
will  assist  them  in  obtaining  an 
understanding  of  the  current  costs 
of  operating  the  business.  .  .[and] 
to  provide  information  which  will 
enable  investors  to  determine  the 
current  cost  of  Inventories  and  pro¬ 
ductive  capacity  as  a  measure  ..£  the 
current  economic  investment  in  these 


The  SEC's  desire  to  provide  users  of  financial 
statements  with  more  relevant  cost  Information 
nas  the  potential  to  require  changes  in  many 
other  areas.  ASR  No.  190 's  asset  requirements 
of  $100  million  in  combined  inventories,  plant 
and  equipment  for  disclosing  replacement  cost 
data  will  effect  many  Air  Force  contractors, 
lor  the  past  eighteen  months,  firms  such  as 
General  Dynamics,  Lockheed,  McDonnell  Douglas, 
and  Northrup  have  been  gathering  replacement 
cost  data  In  an  attempt  to  show  what  Infla¬ 
tionary  pressures  have  done  in  the  areas  of 
inventories  and  plant  capacity.  Therefore,  it 
seems  advantageous  to  examine  exactly  w:  at 
these  firms  have  been  doing  in  the  area  of 
replacement  cost  accounting  and  then  to  analyze 
how  these  actions  might  effect  possible  govern- 
nent  procurement  activity. 


I*  ART  11 


Till.  HOW  OF  REPLACEMENT  COST  ACCOUNTING 


The  intent  of  the  SEC's  ASR  No.  190  was  to 
have  firms  show  exactly  what  it  would  cost  them 
in  today's  dollars  to  replace  their  present 
Inventories  and  production  capacity;  thereby, 
giving  a  better  picture  of  each  firm's  finan¬ 
cial  position.  Further,  this  action  was  de¬ 
signed  to  show  what  the  income  statements  of 
these  firms  would  look  like  If  these  same 
Inventories  and  production  capacities  were 
expressed  in  .nday's  dollar  values  and  nor  In 
terms  of  what  these  items  Cu.,  several  years 
ago.  flic  entire  move  toward  repia-  -..cjit  cost 
accounting  was  designed  to  provide  a  more 
current  analysis  of  a  firm's  financial  her 
during  inflationary  period-.  The  quescienu 
that  now  must  be  answerer  ire  h~w  are  these 
replacement  cost  figures  derived?  How  are  they 
presented?  And,  wlmt  effect  will  they  .i.ive  on 
a  firm's  financin',  statements?  Once  these 
questions  are  answered,  then  the  full  impact  of 
replacement  cost  accounting  will  be  evident. 

The  SEC  defines  replacement  cost  as: 

"...  the  lowest  amount  that  would 
have  to  be  paid  In  the  normal  course 
of  business  to  obtain  n  new  asset  of 
equivalent  operating  or  productive 
capability." 


For  inventories,  this  presents  no  particular 
difficulties  since  most  companies  replace  in¬ 
ventories  continually  with  similar  or  identical 
items,  it  is  a  matter  then  of  determining  the 
current  cost,  at  the  balance  sheet  date,  of 
replacing  each  item  of  inventory.  If  Hie  item 
Is  purchased  in  the  open  market  or  from  a  ven¬ 
dor,  the  cm.'ent  market  price  or  vendor  quota¬ 
tion  would  do  the  best  estimate.  When  this 
approach  is  used,  care  shouid  be  taken,  however, 
to  conside-  possible  quantity  discounts;  and 
prices  should  be  based  on  the  company's  notmal 
purchase  quantities.  If  an  item  is  to  be 
replaced  under  a  long-term  supply  contract  at  a 
price  materinllv  below  current  market  prices, 
the  lepluccment  cost  woulti  be  the  contract 
price.  If  the  contract  has  only  a  short  time 
to  run,  however,  the  yeat-end  market  price 
shouid  be  used.  The  CEC  requires  that  obsolete 
or  discontinued  items  be  set  forth  separately, 
and  not  be  Included  in  replacement  cost  t.iK il¬ 
lations.  These  items  are  not  part  of  con¬ 
tinuing  operations,  Mid  will  not  be  replaced. 
Also,  many  comprme.'.  that  employ  standard  cost 
svstems  regularly  revalue  their  inventories  at 
prevailing  cost  levels.  Timing  this  revalua¬ 
tion  to  occur  at  vear-end,  or  doing  a  supple¬ 
mentary  revaluation  to  determine  replacement 
cost  at  year-end,  would  appear  to  require 
little  additional  effort,  for  those  firms  that 
have  perpetual  Inventory  records. 

Thus,  the  task  of  computing  year-end  inven¬ 
tories  and  restating  cost  of  sales  on  a 
replacement  cost  basis  will  probably  prove  to 
be  simpler  for  most  firms  chan  the  task  of 
determining  the  replacement  cost  oi  productive 
capacity.  Inventory  transactions  take  place  on 
a  regular  enough  basis  for  most  films  so  that 
they  will  be  able  to  establish  replacement  cost 
with  little  trouble  at  year-end.  However, 
determining  the  replacement  cost  for  new  facil¬ 
ities  and  equipment  with  equivalent  productive 
capac 1 ty  presents  a  real  challenge.  To  accom¬ 
plish  this,  it  is  necessar-.  *«*  determine  what 
replacement  facilities  am*  ..quipnent  are  avail¬ 
able  and  to  equate  the  productivity  ami  tost  of 
operation  of  the  replacement  item  to  the 
original  asset.  This  puses  some  difficult 
problems.  The  replacement  cost  of  equivalent 
use.'"  equipment  docs  not  satisfy  the  require¬ 
ment.  In  most  cases,  used  equipment  would 
present  a  temporary  rather  than  a  long-range 
solution  to  the  capacity  replacement  problem. 
Where  machinery  and  equipment  an;  involved,  a 
technologically  equivalent  unit  is  ofien  not 
nvniloblc  for  all  assets.  The  cost  of  recon¬ 
structing  an  identical  piece  of  equipment  from 
service  parts,  to  replace  a  10-ycar  old  machine 
no  longer  available  commercially,  could  he  sub¬ 
stantially  above  the  cost  of  purchasing  a  new 
and  more  advanced  unit.  In  evaluating  the  sub- 
scanticl  number  of  rep  I. icemen  r  meeds  avail¬ 
able,  each  will  have  different  ,  re,  ’i-ity 
features  and  different  price  tags,  even  il 
each  Individual  capital  asset  is  evaluated  on 
an  asset-bv-asset  replacement  basis,  substantial 
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latitude  is  left  with  the  user  in  selecting 
the  replacement  unit  to  be  included. 

Since  replacement  costs  foi  -outcries  will  be 
easier  to  estimate  than  the  ■  .  ■  ' -.<ed  assets, 
the  SEC  has  provided  some  .si  •  •  in  devel¬ 
oping  replacement  -osts  ■  c  ■  .1.  ve  capac¬ 

ity.  Specifically,  in  t-i  ,  ■  '< .  r* ' 

Bulletin  Release  No  cc  f  •,  197b, 

the  Commission  provided  t<  *  f  .  /lug  direc¬ 
tions: 

Productive  capacity  1.  a  measure¬ 
ment  of  a  company's  a  I-  .  '  •  pro¬ 

duce  and  distribute.  I  •  •  .-onuctit  s 
capacity  of  a  manufar f ■  .  -id  b<. 

measured  by  the  nurnbei  1  1  .its  it 

can  presently  pi  iduce  ai  '  !  strihute 
within  a  particular  time  rame;  in 
tlic  case  of  a  telephone  company, 
for  example,  it  -oulo  be  a  measure¬ 
ment  of  the  nuu.  -.r  cf  celep-.o-e 
calls  it  can  presently  complete 
within  a  certain  time  frame. 

There  is  no  simple  conccp-  of 
re.iJa  oment  cost  which  will  be 
applicable  in  every  clrcumsta-ce. 

In  general,  replacement  cost  ul 
productive  capaci  ty  mea-.o  the  cost 
of  replacing  capacity  within  the 
existing  business  framework  of  the 
entiiy.  Thus,  replacement  cost 
does  not  generally  cont-mftaie  a 
single  time  complete  replacement 
of  total  capacity  while  total. y 
ignoring  the  structure  of  the 
busi.  >s  as  it  exists.  Neither 
does  ..aan  replacement  of  each 
of  the  specific  assets  currently 
owned  unless  that  <s  -.he  way  Jn 
which  me  business  genurally  re¬ 
places  its  capacity.  Rather,  re¬ 
placement  costs  should  be  based  on 
the  entity's  normal  approach  to 
replacement  of  capacity. 

Having  determined  how  these  replacement  costs 
are  calculated,  we  will  now  demonstrate  how 
this  data  will  be  presented.  As  stated 
earlier,  ASR  No.  190  requires  that  replacement 
costs  be  presented  In  either  footnotes  to  Lhc 
original  historical  cost  statements  or  in  a 
separate  section  of  these  statements.  In 
either  case,  the  data  presented  will  be  very 
similar  to  that  found  in  Exhibit  1  (careful 
attention  should  be  made  to  this  exhibit  since 
the  data  contained  in  the  exhibit  will  he  used 
in  the  following  two  exhibits) . 

Note:  Exhibit .  i,  2,  and  3  are  adapted  from 
the  following  text:  A  Primer  on  Cost  Replace¬ 
ment  Accounting  by  Uilliam  J.  Bruns,  Jr.,  nnd 
Richard-?.  Vnncll. 


EXHIBIT  1 

EXAMPLE  01  DISCLOSURE  OF  REPLACEMENT 
COST  AS  REQUIRED  IN  FORM  1'1-K  FILED 
WITH  SECURITIES  AND  EXCHANGE 
COMMISSION 

Cif  COMPANY 

Estim.it.  o  (eplacement  u>  t  Information  (Un- 
audi ted, 

flu*  fo1  lowing  replacement  cost  iniormation  for 
certain  of  the  Company's  a„sets  has  been  esti¬ 
mated  by  management. 


Estimate- 

Historical 

Replacer  -t 

December  31,  197/ 

Co*** 

Cost 

($  millions) 

Inventor  le*> 

4 

$  92 

$  97 

Product ivt  Capacity 

1S7 

272 

Less:  Accumulated 

Depreciation 

o3 

_ 8b 

Net  Oast  of  Capac¬ 

- 

ity 

$129 

$186 

'.-■r  Ended  December 
i  *>; 

31, 

Cost  of  sales 

$297 

$316 

Depreciation 

21 

26 

An  examination  ol  the  data  reveals  that  replace¬ 
ment  cost  data  clea-ly  reflect  that  C  4  P 
Company's  Inventories  and  productive  cnpacil, 
are  undervalued  in  terms  cf  today's  cost-s. 
consequently,  the  firm's  cost  of  sales  and 
depreciation  arc  also  mderstated,  thereby 
.csulting  in  a  greatet  net  income  basis  than 
would  exist  if  the  inventories  were  expressed, 
and  the  eq.iipment  depreciated  using  today's 
costs.  Such  information  presented  in  footnote 
form  a  step  Jr.  the  right  direction,  bu>  in 
order  to  really  appreciate  its  magnitude,  it 
should  be  analyzed  in  relation  to  the  lira's 
balance  sheet  sod  income  statement.  F.xhlblt  2 
presents  c  a  p's  balnncc  sheet  and  income 
statement  on  a  historical  cost  basis.  Exhibit 
3  shown  the  same  data  with  the  inventory  and 
productive  capacity  restated  based  on  the  esti¬ 
mated  replacement  co »ts  shown  is  Exhibit  i. 

by  analyzing  Exhibits  2  and  3  simp.' tancously, 
the  real  Impact  of  replacement  cost  accounting 
can  be  discerned.  Notice  total  assets  In 
Exhibit  3  are  S67  mill  lor.  larger  due  to 
Incrcas  s  ot  $5  mill  >n  in  Inventories  and  $b2 
miii.,..  -..el  productive  capacity.  Thus,  If 
the  firm  would  have  to  replace  these  two 
critical  Items  today,  if  would  have  to  pay  an 
additional  $67  million  because  of  inflation. 
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EXHIBIT  ?. 

CSP  COMPANY 
Balance  Sheet 

(Based  on  Jistorical  Costs) 

December  31,  197  ' 

($  millions) 


ASSETS 

Current  Assets: 

Cash 

Accounts  Rectlva* ;  e 
Inventories 


Fixed  Assets: 
hand 

Productive  Capacity  $1G7 
Less:  Accumulated 
Depreciation  63 

Ccher  A-.sets: 

Total  Assets 

EQUITIES 

Current  Liabilities: 

Notes  Payable 
Accounts  Payable 
Taxes  Payable 

Long  Term  Debt : 

Owners  Equity: 

Common  Stock. 

Retained  Earnings 
January  i,  1976  $  48 

Add:  Net  Income  17 
December  31,  1976 

Total  Equities 


$  17 
54 
92 


$  23 


12  j 


$163 


147 

13 

$323 


$  20 
41 
19 


$122 


65 


$  80 
56 


187 

$323 


EXHIBIT  3 
C  &  P  COMPANY 
Balt.nce  Sheet 

(Based  on  Estimj  ,d  Replacement  Cost  for 
Inventory  and  Productive  Capacity) 

($  millions) 

ASS,.  "S 
sets: 


Current  /• 

Car*- 

Accounts  Receivable 
Inventorler 


Fixed  Assets: 

Land 

Productive  Capacity 
Less:  Accumulated 
Depreciation 


Other  Assets: 

Total  Assets 

EQUITIES 

Current  Liabilities: 
Notes  Payable 
Accounl.  Payable 
Taxes  Pay-Ma 

Long  Term  Debt: 

Owners  Equity: 

Common  Stock 
Retained  Earnings: 
January  1,  1976 
Less:  Operating 
Loss 

Holding  Gains 


$272 

86 


$  >/ 
5s 
97 


$  23 


186 


3168 


209 

13 

$390 


$  48 
I 


$  20 
41 
IS 


5122 


41 

91 


80 

56 


Income  for  the  Year  1977 

$254 

(Based  on  Historical  Costs) 

Total  Equities 

$390 

3 

($  oil! !on» i 

J 

Income  for  I 

the  Year 

1977 

Sales 

$371 

($  million) 

-4 

Costs  of  Good3  Sold 

297 

Under 

Under 

Changes  due 

Gross  Margin 

74 

Historical 

Replacement 

to  Account¬ 

Depreciation  $  21 

Cost 

Cost 

ing  Method 

"4 

Other  Expenses  36 

Accounting 

Acco  •nf.inp. 

Total  Expenses 

£7 

Sales  $371 

371 

1 

Net  Income 

m 

Cost  of  Goods 

Sold  297 

31b 

(19) 

Cross  Margin  $  74 

$ 

55 

No  dividends  were  paid  to  siiare  holders. 

Depreciation  $21 

$26 

(5) 

rj 

Other 

n 

Expenses  36 

Su 

'i 

Total 

Expenses  57 

62 

'~N 

1 

Net  Income  (Loss)$  17 

?g»  ma 

UZ2, 

$7241 

K 
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Tho  critical  point  that  must  be  analyzed  though 
is  in  the  income  statement.  Notice  in  Exhibit 
3,  under  the  replacement  ccst  approach,  that 
the  C  &  !’  Company  shows  a  njt  loss  of  $7 
million  compared  to  a  reported  gain  of  $17 
million  using  the  historical  costing  data  at 
Exhibit  2. 

Tne  critical  point  tha*  this  analysis  portrays 
Is  that  C  6  P's  revenue  have  been  rising  due 
to  inflationary  pressures,  but  its  dated  costs 
in  the  areas  of  depreciation  and  inventory 
expense  are  $24  million  off  the  pace  in  terms 
of  today's  prices.  Thus,  what  is  actually 
being  reported  using  historical  contlng  it 
artificial  profits.  The  firm  has  not  generated 
$17  million  in  real  profits  as  the  historical 
costing  method  might  lead  one  tr  believe.  It 
must  actually  use  these  $17  mil. ion  in  reported 
profits  as  well  as  an  additional  $7  million  of 
retained  earnings  to  replace  the  inventories 
and  productive  capacity  in  terms  of  today's 
costs. 

Tiius,  replacement  cost  ' ^ counting  demonstrates 
the  true  effect  tine  i.uiatlon  has  upon  a  firm 
and  eliminates  th.  mismatching  of  current 
revenues  without  o  ta  costs.  Having  examined 
the  why  and  how  of  replacement  cost  accounting, 
it  is  an  appropriate  time  to  analyze  this 
latest  accounting  development  In  cerms  of  its 
possible  effects  In  the  area  of  government 
procurement. 


PART  III 

THE  EFFECTS  OF 
REPLACEMENT  COST  ACCOUNTING 


Tho  Sec's  pronouncement  requiring  replacement 
cost  accounting  Information  it.  mandatory  i  •. 
all  firms  whose  stock  is  traded  publicly  and 
who  possesses  at  least  $100  million  i..  inven¬ 
tory  and  gross  property  that  represent  10%  or 
more,  of  total  assets.  One  Industry  that  Is 
greatly  affected  by  this  now  accounting  con¬ 
vention  is  the  aerospace  industry- -a  prime 
supplier  of  major  weapon  systems  for  Che  Air 
Force.  Exhibit  4  shows  four  representative 
firms  from  this  industry.  All  four  meet  ASR 
No.  I90's  asset  guidelines.  Therefore,  each 
firm  must  develop  and  present  lopiacemnni  cost 
accounting  information  in  conjunction  with  the 
annual  financial  statements  presented  on  a 
hlstorlal  cost  basis. 

With  such  major  firms  as  General  Dyn-._ !  :  , 
Lockheed.  McDonnell  Douglas  and  Norchrup  having 
to  revalue  their  inventories  and  productive 
capacities  to  meat  SEC  requirements,  many 
questions  are  de /.".loping  as  to  now  this  data 
will  effect  future  company  decisions.  With 
those  firms  realizing  that  they  must  replace 
inventories  and  depreciable  assets  at  today's 
inflated  prices,  such  knowledge  may  Impact 


considerably  upon  future  pricing  decisions  and 
contract  negotiations.  Assuming  that  the 
flctious  C  5  P  Company  portrayed  in  Exhibits  1, 
2,  and  3  is  representative  of  such  firms  aa 
those  found  in  the  aerospace  industry  and  those 
that  are  mnjor  government  suppliers,  ve  can 
begin  to  analyze  what  possible  effect  thi6 
replacement  cost  data  will  have  in  the  govern¬ 
ment  procurement  arena. 


EXHIBIT  4 

AEROSPACE  FIRMS  MEETING  SEC  ASSET 
REQUIREMENTS  FOR  REPLACEMENT  COST 
ACCOUNTING  DISCLOSURE 
(dollar  figures  in  millions)* 

(1)  (2)  (3)  (4)  (3)s (4) 

2  of 

Year  Gross  Inven-  (l)+(2)  Total  Total 

Ended  Property  tories  Total  Assets  Assets 

31 


Dec  General  Dynamics 


1476 

1,153 

571 

1,724 

2,006 

86% 

1975 

1,022 

521 

1,543 

1,863 

83% 

1974 

922 

470 

1,392 

1,634 

85% 

31 

Dec 

Lockheed 

1976 

742 

405 

1,147 

1,521 

75% 

1975 

733 

388 

1,121 

1,389 

81% 

1974 

709 

893 

1,602 

1,899 

84% 

31 

Dec 

McDonnell 

Douglas 

1976 

684 

1,494 

2,178 

2,391 

91% 

1975 

666 

1,638 

2,304 

2,466 

93% 

1974 

672 

1,659 

2,331 

2,459 

95% 

31 

Dec 

Northrop 

1976 

250 

121 

371 

597 

62% 

1975 

232 

142 

374 

544 

69% 

1974 

217 

129 

346 

496 

70% 

* 

Data 

extracted 

from  Standard 

6  Poor  Corpora' 

tlon 

Industrial 

Report. 

If  we  assume  that  C  &  P  Company  Is  a  major 
supplier  of  Air  Force  resources  and  operates  on 
a  cost  plus  a  fixed  fee  basis,  then  much  may  be 
done  by  C  6  P  to  increase  the  costs  that  should 
be  reported  to  the  contracting  officer.  The 
historical  cost  data  in  Exhibit  2  shows  that 
C  4  P  would  bi.l  tho  Air  Force  $297  million  in 
cost  of  goods  sold  and  $57  million  in  operati'.., 
expenses  and  generate  a  reported  net  income  of 
$17  million  after  considering  the  fixed  fees 
chnrged.  However,  by  complying  with  SEC  re¬ 
placement  cost  requirements,  the  firm  now 
realizes  that  in  order  to  replace  the  Inventory 
sold  to  the  Air  Force,  it  must  now  repurchase 
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it  at  today's  prices  of  $316  million,  indicat-  a  hedge  against  the  economic  losses  reported 

ing  a  $19  million  increase  in  costs  actually  under  replacement  cost  accounting.  No  longer 

reported.  Further,  if  the  firm  was  to  provide  will  the  firm’s  cost  basis  be  outdated  and  its 

adequate  depreciation  allowances  for  the  re-  fixed  fee  e..ien  away  by  inflationary  price 

placement  of  its  productive  capacity,  Chen  an  increases, 

additional  $5  million  would  have  to  be  set 

aside  as  depreciation  expense  (See  Exhibit  3).  Thus,  the  SEC's  latest  pronouncement  in  the 

accounting  industry  at  first  glance  seemed  a 

Thus,  through  replacement  cost  accounting,  long  way  off  from  the  world  of  government  con- 

C  &  P  now  realizes  that  by  agreeing  to  a  cost  tracts  and  procurement  actions.  However,  once 

plus  a  fixed  fee  basis  it  is  "behind  the  power  the  full  impact  of  this  recent  accounting 

curve"  in  terms  of  replacing  its  assets  at  change  is  felt  and  corporate  executives  see  in 

today's  costs.  If  it  had  just  continued  to  print  what  they  may  have  only  suspected,  we 

report  operations  on  a  historical  cost  basis,  predict  that  many  major  government  contractors 

it  would  not  have  realized  that  the  $17  >  '* 1  ’  be  pushing  for  some  type  of  rate  structure 

million  In  "operating"  profits  as  well  as  an  which  will  compensate  them  for  this  phenomenon 

additional  $7  million  would  have  to  be  used  that  occurs  in  periods  of  rising  prices.  If 

just  to  rep:  I.-  •  the  assets  expended  in  its  the  future  does  hold  such  events,  then  procure- 

latest  yeai  of  operation.  From  an  economic  menc  specialists  should  be  prepared  foi  this 

standpoint  then,  the  firm  has  not  generated  a  and  should-  realize  the  many  complexities 

profit  of  $17  million,  but  rather  has  suffered  associated  with  this  newest  type  of  financial 

a  $7  million  loss  in  terms  of  today's  inflated  reporting.  If  replacement  cost  figures  begin 

priccs>  to  directly  enter  into  contract  negotiations, 

then  the  Air  Force  contracting  representatives 
Armed  with  these  facts  and  aware  of  the  impact  must  understand  why  these  figures  are  created, 

that  inflation  has  upon  the  operations  of  the  h°v  they  are  arrived  at,  and  how  they  effect 

firm,  C  &  P  may  attempt  to  Increase  its  procurement  activities.  What  is  now  appearing 

reported  costs  to  the  government.  Herein  lies  i-n  footnotes  to  historical  financial  state- 

the  crux  of  the  problem  with  replacement  cost  merits ,  indicating  the  replacement  value  oi 

accounting  Information  within  the  government  inventories  and  productive  capacity,  may  soon 

procurement  environment.  Most  procurement  become  the  center  of  attention  for  many 

contracts  are  worded  so  that  thv  supplier  is  government  activities, 

reimbursed  for  Ills  actual  or  "out  of  pocket" 
costs.  These  are  the  costs  reported  on  Che 
firm's  historical  financial  statements  and  the 
costs  that  should  he  reported  in  a  cost  plus 
fixed  fee  government  contract.  However,  the 
supplier  will  now  realize  chat  ho  is  not 
adequately  providing  for  the  replacement  of  the 
assets  consumed  by  the  Air  Force  in  terms  of 
today's  higher  costs.  By  being  aware  of  tills 
replacement  data,  the  firm  may  attempt  to  make 
up  for  the  ground  that  it  is  losing  by  reporting 
costs  that  are  greatly  increased  over  the 
historical  cost  incurred.  It  will  then  be  up 
to  the  procurement  authorities  to  insure  that 
the  costs  that  are  reported  are,  in  fact,  Che 
historical  or  actual  costs  agreed  upon. 

Obviously,  a  supplier  may  not  revert  to  such 
covert  actions  os  reporting  flctious  higher 
costs,  so  as  to  stay  ever  with  rising  prices 
and  report  an  economic  |  ofic,  but  it  may  start 
to  look  for  a  new  negotiated  contract  basis. 

Instead  of  seeking  remuneration  on  a  cost  plus 
a  fixed  fee  basis,  since  the  supplier  is  now 
aware  that  its  cost  basis  is  becoming  outdated 
in  an  inflationary  period,  -l  may  seek  a 
negotiated  full  price  contract.  The  price 
probably  would  be  set  substantially  higher  than 
what  was  charged  In  prior  years  under  the  cost 
plus  system  since  the  supplier  will  he 
attempting  to  cover  not  only  historical  costs 
and  realize  a  profit,  but  it  will  al60  be 
attempting  to  provide  for  inflationary  cost 
Increases.  In  this  way,  the  supplier  will  he 
staying  even  with  inflation  and  will  thus  have 
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CONTRACTOR  FINANCIAL  DATA  RETRIEVAL  AND  ANALYSIS  SYSTEM 


David  M.  Koonce 

Chairman,  DoD  Contract  Finance  Committee 


I.  INTRODUCTION 

The  increasing  number  of  management  decisions 
facing  Department  of  Defense  (DoD)  acquisition 
executives  require  a  comprehensive  analysis  of 
che  financial  impact  of  policy  changes  on 
major  defense  contracts.  For  example,  on 
programs  with  large  cost  overruns  or  claims, 

DoD  management  wants  answers  to  such  questions 
as  "How  much  money  can  the  company  borrow?"  or 
"Will  the  company  go  broke  unless  we  Increase 
che  contract  price?" 

There  is  a  need  for  an  in-depth  financial 
analysis  on  major  acquisition  programs.  We 
should  be  doing  everything  we  can  !o  predict 
financial  problems  with  major  defense  con¬ 
tractors  in  order  to  avcid  drastic  measures  of 
financial  relief  such  as  unusual  progress  pay¬ 
ments  or  extraordinary  contractual  actions 
pursuant  to  Public  Law  85-304.  Under  current 
practice  many  post-award  financial  reviews  are 
made  by  CPA  firms  under  contract  to  the  DoD. 
This  practice  is  expensive,  time-consuming, 
and  does  not  lend  itself  to  the  "  aat  if"  pro¬ 
jections  that  arc  an  essential  part  of  the 
decision-making  process. 

The  purpose  of  this  paper  is  to  describe  the 
new  Contractor  Financial  Data  Retrieval  and 
Analysis  System  (FINANDAS),  which  is  a  com¬ 
puterised  system  designed  to  assist  the  DoD  in 
the  financial  analysis  of  major  defense  con¬ 
tractors.  The  system  was  developed  by  the 
Logistics  Management  Institute  (LMI)  under  the 
sponsorship  of  the  Director  of  Contracts  and 
Systems  acquisition  within  the  Office  of  the 
Under  Secretary  of  Defense  for  Research  and 
Engineering  (Acquisition  Policy).  1  As 
Chairman  of  the  DoD  Contract  Finance  Committee, 
I  am  responsible  for  the  implementation  of  the 
system.  Ihis  paper  will  discuss  the  features 
of  FINANDAS,  haw  the  system  can  be  used  to 
solve  acquisition  problems,  and  system  imple¬ 
mentation  status. 

II.  DESCRIPTION  OF  FINANDAS 

FINANDAS  Is  a  computerized  system  for  obtaining 
and  analyzing  financial  statements  of  major 
defense  contractors.  Users,  through  a  time¬ 
sharing  computer  terminal,  can  retrieve  stored 
data  and  obtain  financial  analyses.  Reports 
are  printed  on  a  time-sharing  terminal  con¬ 
nected  by  a  telephone  link  with  the  General 

1  "Contractor  Financial  Data  Retrieval  and 
Analysis  System"  (FINANDAS),  Logistics 
Management  Institute,  Task  73-11,  January 
1977.  Much  of  the  description  of  the  system 
lias  come  from  this  report. 


Electric  "Copper  Impact."  computer  network. 
Financial  statements  of  companies  not  In  che 
system  can  be  fed  into  the  computer  for  analy¬ 
sis  and  the  system  can  make  projections  and 
simulations.  A  typical  analysis  costs  about 
$i5  per  company. 

While  the  system  can  handle  data  for  2700  com¬ 
panies,  rc  presently  Includes  financial  Infor¬ 
mation  about  900  publ icly-owr.ad  companies.  To 
illuytiate  the  system's  utility,  there  were  87 
publicly-held  companies  on  the  1977  list  of 
contractors  receiving  the  largest  volume  of 
DoD  prime  contract  awards;  74  of  these  are  in¬ 
cluded  in  the  900-companv  data  hank. 

Most  stored  financial  data  is  obtained  from 
Standard  &  Poor's  Compustat  Services,  Inc.,  a 
subsiding  of  Standard  4  Poor's  Ccrporatlon. 
This  Information,  called  "Compustat,"  Includes 
133  elements  of  audited  annual  financial  data. 
Five  years  of  financial  statements,  including 
historical  trends,  are  available  through 
FINANDAS .  Several  ratio  reports  also  are 
available.  Furthermore,  with  the  user  fur¬ 
nishing  the  assumptions,  the  system  c»n 
produce  five-year  projections. 

ANALYTICAL  OBJECTIVES 

FINANDAS  is  designed  to  analyze  liquidity 
through  such  ratios  ns  current  assets/current 
liabilities  feurrent  ratio)  and  cash  plus 
markctcblc  securities/accounts  payable  (quick 
rat lo) . 

In  the  long  run,  a  corporation's  fortunes  will 
often  rest  upon  the  strength  of  its  capital 
structure.  Solvency  is  the  relationship  of 
debt  to  equity  and  assets.  Therefore, 

FINANDAS  is  designed  to  look  at  ouch  factors 
as  capital  structure,  the  Issuance  of  addi¬ 
tional  debt  or  equity,  and  the  cost  of  capi¬ 
tal.  Racios  analyzed  Include  debt/equity, 
tangible  net  assots/long-terro  debt,  and  net 
working  capital /short-term  debt. 

Prof i  ;abil lty  probably  receives  the  widest 
visibility  of  any  component  of  financial 
anal-sis.  Net  incomc/snlcs,  and  net  income/ 
assets  are  the  traditional  measures  of  prof¬ 
itability  among  financial  analysts.  In  recent 
years,  cash  flow,  or  "actual  cash"  generated 
from  operations,  has  become  recognized  as  an 
equally  important  aspect  of  profit  analysis. 
Cash  flow  is  particularly  important  where  non¬ 
cash  charges  depress  reported  profits.  Bccouse 
fixed  charges  must  be  covered  by  real  cash, 
cash  flow  has  become  a  key  indicator  of  near 
term  visibility.  Furthermore,  cash  flow  over 
the  term  of  a  contract  will  be  a  vital  deter¬ 
minant  In  any  change  of  the  DoD  contract 
financing  provision. 
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ANALYTICAL  REPORTS 

The  Balance  Sheet,  often  called  the  "Statement 
of  Financial  Position,"  identifies  the  year- 
end  amounts  of  a  company's  assets  and  liabil¬ 
ities.  Mosc  of  the  accounts  shown  on  the 
Balance  Sheet  are  significant,  and  their 
trends  should  be  reviewed.  Trends  for  several 
key  accounts  are  flagged  witli  a  "P"  or  an  "N.“ 
for  important  positive  or  Negative  indicators 
of  financial  health.  A  unique  feature  of  the 
projected  balance  sheet  is  the  entry  for  "addi¬ 
tional  borrowing,"  which  indicates  the  cumula¬ 
tive  excess  of  cash  requirements  over  cash 
generated.  A  projected  balance  sheet  is  shown 
on  Table  1. 

The  Income  and  Retained  Earnings  Statement  is 
anothei  traditional  analytical  report.  Key 
data  for  trend  review  in  the  income  section 
are:  Met  Sales,  Gross  Income,  Operating 
Income,  Income  Before  Tax,  Income  Before 
Extras  (excraordinnry  Items)  and  Met  Income. 

A  projected  income  statement  is  shown  on  Table 


The  accounting  name  for  the  Changes  in  Working 
Capital  report  is  the  Statement  of  Changes  in 
Financial  Position,  but  It  is  often  referred 
to  as  the  "Sources  and  Applications  of  Funds," 
or  “Funds  Flow"  statement.  The  Changes  in 
Working  Capital  report  Is  oriented  more  coward 
the  total  net  working  capital  rather  than  to 
cash.  Such  an  orientation  reflects  the  need 
for  working  capital  to  fund  sales  (through 
accounts  receivable),  provide  sufficient  work- 
in-process  inventory  for  production,  and  main¬ 
tain  a  finished  goods  Inventory  to  meet  sales 
commitments,  in  governneut  contracting, 
working  capital  is  required  to  complete  the 
product  bcfoic  payment  at  delivery  or  at 
certain  milestones.  This  report  is  shown  on 
Table  3. 

The  Annual  Ratios  report  contains  key  ratios  to 
evaluate  performance,  capitalization,  liquidity 
and  debt  coverage.  The  performance  ratios 
measure  che  return  (income)  on  equity,  soles, 
capital  and  asseC3.  The  capitalization  ratios 
measure  the  balance  between  use  of  debt  for 
leverage  and  the  need  for  sufficient  equity  ro 
insure  financial  soundness.  Because  the 
liquidity  of  a  company  !  a  direct  measure  of 
its  financial  health,  a  lrge  number  of 
liquidity  ratios  are  piovided.  In  addition  to 
the  current  ratio  and  che  acid  test,  the 
liquidity  ratios  analyze  receivables,  inven¬ 
tory,  payables,  working  capital  and  cash  flow. 
The  debt  coverage  ratios  indicate  the  cash 
cushion  available  to  pay  interest  on  debt,  or 
meet  commitments  for  debt  repayment  and  capital 
expenditures.  As  or.  overall  measure  of 
financial  health,  the  system  provides  the  Z- 
Scoro,  a  weighted  sum  of  selected  ratios.  A 
projected  report  io  shown  on  Table  A. 


The  Forecasting  Factor  report,  shown  on  Table 
5,  aids  in  projecting  a  company's  financial 
position.  This  report  contains  factors  useful 
in  specifying  assumptions  for  projections. 

The  Projection  Assumptions  report,  shown  on 
Table  6,  Is  included  In  the  computer  output  to 
make  explicit  the  assumptions  used.  All 
assumptions  appear  by  account  projected,  and 
are  identified  by  source:  "input"  (provided 
by  the  user)  or  "default"  (provided  automat¬ 
ically  when  no  user  assumption  is  input). 

III.  APPLICATION  OF  FINANDAS 

FINANDAS  has  been  used  on  several  occasions  to 
analyze  the  cash  flows  and  projected  cash 
needs  for  major  DoD  contractors  with  financing 
problems.  The  first  task  was  to  gather 
history  using  the  Compustat  data  base  and 
analyze  the  current  financial  status  ot  the 
company.  The  next  step  was  to  develop  pro¬ 
jection  assumptions  using  the  trends  and 
ratios  from  FINANDAS.  It  was  a  simple  Job  to 
input  these  assumptions  and  obtain  the  pro¬ 
jected  financial  statements.  These  reports 
were  reviewed  with  DoD  acquisition  management 
and  additional  projections  were  quickly  made 
based  on  alternative  assumptions.  Some  of  the 
assumptions  we  Investigated  included: 

•  the  impact  of  various  levels 
of  government  financing 

•  program  cost  overruns 

•  settlement  of  claims 

•  tax  write-offs 

The  key  items  we  addressed  were  cash  flow  and 
the  amount  of  additional  borrowing  required. 
The  projections  not  only  indicated  how  much 
additional  borrowing  was  needed,  but  piovided 
an  annua)  repayment  schedule.  This  is 
erftical  to  lenders  since  the  tine  of  repay¬ 
ment  is  an  important  consideration  in  loan 
availability.  The  Immediate  access  to  audited 
financial  data  and  the  rapid  turn-around  of 
projections  lias  made  FINANDAS  an  effective 
tool  for  our  analysis  of  contractor  financing 
needs. 

IV.  IMPLEMENTATION  STATUS 

The  development  of  FINANDAS  by  LMI  is  complete 
and  a  user’s  manual  has  been  published,  lie 
are  currently  organizing  a  training  program 
to  be  conducted  by  the  Services  for  ihe  use  of 
personnel  involved  with  the  acquisition  of 
major  weapon  systems.  The  "Compustat"  data 
base  and  the  FINANDAS  computer  programs  arc- 
available  t-i  subscribers  ot  the  Mr  Force 
"Copper  Impact"  computer  network. 
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SPECI-M.  ITEMS 

o. 

0. 

0. 

0. 

0. 

-D.OX 

uTHci!  I NCOME/-EXP 

21  .5 

22.5 

23.7 

24.8 

26.  1 

5.0X3 

I JC sEFONH  TAX 

43.2 

46.2 

50.0 

54. 1 

53.5 

8.0X8 

INCOP-:  TAXES 

17,8 

19.  1 

20.6 

22.3 

24.2 

3.0XS 

minority  INTEREST  IS 

0.6 

0.6 

0.7 

0.  7 

0.8 

3.0XS 

INCOME  8EF3RE  EXTRAS 

?4.7 

24.5 

28.6 

31.0 

33.5 

3.0X8 

EXTPAOmiRARY  ITE'>S 

o. 

0. 

0. 

0. 

0. 

-D.OX 

.«ET  IrC.ME/-LOSS 

24.7 

26.5 

28.6 

31.0 

33.5 

8,0X5 

======= 

==“=-=- 

— 

RETAINED  EARNINGS 

a  EG  I  'RING  BALANCE 

121  .2 

141.1 

162.6 

186.3 

212.4 

I5.0XP 

restatement 

-0.0 

-0.0 

-0.0 

-0.0 

-0.0 

-O.OX 

AS  RESTATED 

121.2 

14'.l 

142.6 

1  36.  3 

212.4 

I5.0XP 

PLUS  NET  INC/ -LOSS 

24.7 

40.5 

23.6 

31.0 

33.5 

8.0XS 

LESS  DIVIDENDS 

4.9 

4.9 

4.9 

4.9 

4.9 

0.  XS 

uTHER  CHANGES 

0. 

0. 

0. 

0. 

0. 

-O.OX 

ENDING  3ALANCE 

141.1 

162.6 

186.3 

212.4 

24|  .0 

I4.3XD 

INCREASE/ -DECREASE 

scs:=:c 

19.8 

21.5 

23.7 

=  =  = 

26. 1 

23.6 

0.7XS 

DATA  SOURCE*  SFE  POIOR  ANALYZET  OUTPUT  FOR  THIS  COMPANY 
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TABLE  3 

USER  PROJECTED 

J!;X I "G  CAPITAL  OF  ROHR  INDUSTRIES 

s  %  A "X  EQUIP 

DATA 

PRINTED  IN* 

thousand: 

r 

IUL 

1078 

JUL 

1979 

JUL 

198^ 

JUL 

1981 

JUL 

1982 

trends 

3741. 

76R7. 

-932. 

449  0. 
8024. 
-1119. 

5731. 

8376. 

-1427. 

7291. 

»7  44 . 

-1  (5  1 7  . 

9268. 

9128. 

-2307. 

25.RYP 

4.4>',S 

-0.0% 

I04°p. 

1668. 

n. 

Q. 

n. 

11401. 

1742. 

0. 

0. 

0. 

12680. 

1313. 

0. 

0. 

0. 

14924. 

1898. 

0. 

0. 

0. 

16088. 
1931  . 

0. 

0. 

0. 

1 1 . 3V,R 
4,4^S 

-0.0% 

-0.0% 

-0.0% 

12167. 

1  3142. 

1 4498. 

16122. 

18069. 

10.5XP 

_n. 

9576. 

Q. 

13920. 

-0. 

10017. 

0. 

25029. 

-0. 

10457. 

0. 

30029. 

-0. 

10916. 

0. 

45029. 

0. 

-0. 

11395. 

0. 

-0. 

0. 

-0.0% 

4„4%S 

-0.0% 

4A.G%S 

-0.0% 

R. 

-5R0. 

0. 

-668. 

u » 
-956. 

-1325. 

-1794. 

-0.0% 

23021 . 

34378. 

39530. 

54620. 

9600. 

-108*5. 

-21236. 

-25032. 

-38498. 

8466. 

KB3= 

-0.0% 

55205. 

152. 

3803. 

-4R2. 

-4162. 

4  264. 
4003. 
230.  ' 

-7174. 

4447. 

4208. 

241. 

-5900. 
4701  . 
4418. 
253. 

-13182. 

4936. 

4638. 

266. 

-0.0% 

102.4% 

5.  !%S 
-0.0% 

58640. 

4340. 

1822. 

3472. 

-3342. 

-0.0% 

925. 

1  io  )l. 

-o. 

54ji 9. 
11«7. 

1921 . 

1  1104. 
-0. 
11269. 
1282. 

2016. 
5000. 
-0. 
18491 . 
1346. 

2117. 

15000. 

-0. 

23440. 

1413. 

2222. 

-45029. 

-0. 

29513. 

1483. 

20.3% 

-0.0% 

-0.0% 

-4.8% 

5.6% 

69574. 

-0. 

2*576. 

_A 

V*  0 

26353. 

-0. 

41970. 

0. 

-1)810. 

-0. 

-0.0% 

-0.0% 

-1C855. 

sssnars 

102m. 

-21236. 

tsssaso 

11113. 

-2503? 

12393. 

-38498. 

=*SC«* 

13936. 

8468. 

era  ::  see 
15800. 

-0.0% 

1 1 . 6%P 

VUMTH  FISCAL  YR  F.NOS 
FISCAL  Y.  AR 

SCIPOES 

I  l.’C'l-.'E  J-ruRii  EVTRAS 
TuT*L  DEPRECIATION 
OT-FK  J°:iS  SOURCES 

TOTAL  F  ?J.*  OP  NS 

sale  OF  plant,  etc. 

SALE  OF  STOCK 
NEW  LON".  TERN  DcoT 
OTHER  SOURCES 

TOTAL  SOURCES 

APPI.ICATI  INS 

D I VI  DEMOS 

CAPITAL  EXPENDITURES 
INVESTMENTS 3ACO 
DE3T  iATURITIES 
TREASURY  STOCK  °URCH 
uTHFR  APPLICATIONS 

TOTAL  APPLICATIONS 

NET  IIICRF.ASE/-OECP. 

SUMMARY  OF  CHANCES 

CASH  «.  EQUIVALENTS 
ACCOUNTS  RECE1VAULF 
INVENTORIES 
oTUPR  CURRENT  ASSETS 

CUR  ASSET  IMCR/-OECR 

ACCOUNTS  PAYABLE 
MATURING  H0TES40EBT 
ADDITIONAL  30PR0WING 
INCOME  TAXFS  PAYABLE 
OTHER  CURRENT  LIAB. 

CUR  LIAB.  INCR/-DECR 
DUE  TO  RESTATEMENT 

NET  I NCRHASE/-DECR 

CASH  FLOW 

DATA  SOURCE*  SEE  PRIOR  ANALYZE!  OUTPUT  FOR  THIS  COMPANY 


5Z9 


tztum. 


ante* 

1 

m 

i 

J'l 

H 

3t 

1 

W-  ? 

1 

E  : 

|  : 

£  1 

K  ;  ^ 

1  ! 

I  *. 

Jl 

¥ 
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TABLE  4 

£ 

USER  PROJECTED 

§ 

Ak|*"iAL  °ATI l!S  FOR  ANALYSIS  OF  BOEING  CO 

1  * 

|i 

W  ' 

INDUSTRY!  AIRCRAFT 

DATA 

printed  IN 

PERCENTS* 

9c 

I  1 

MONTH  FISCAL  YR  ENOS 

"EC 

DEO 

DEC 

DEC 

DFC 

1  : 

rlSCAL  YEAR 

1077 

1076 

1979 

10RO 

1 98 1 

TDENDS 

1  ' 

P  ERF  JR  •  '"'CE 

J? 

INCa,\=/Ar/G  EOUITY 

IQ. 3 

10.2 

10.1 

9.9 

9.8 

-Q.  |  s 

|  f 

I NCCV-'E/SALSJ 

P.8 

2.9 

3.0 

3.0 

3.  1 

0. 1  s 

g-  1 

INC  air/AVO  CAPITAL 

U.2 

14.  I 

14.0 

13.0 

13.7 

-o.  1  s 

i.  : 

INC  o!  T/ASSETS  7. 

8.7 

8.7 

8.7 

8.7 

9.  1 

o.o 

1? 

kET  EAIN/ASSETS  7. 

36.8 

39.5 

42.2 

44.7 

47.  1 

2.6  o 

SAleS/ASGET3  7 

208.1 

ROI.O 

198.5 

195. -8 

193.0 

-0.5  v 

: 

SAI.SS/AVU  EQUITY 

363.3 

350.6 

338.2 

326.2 

314. P 

-12.2  H 

il^ 

salssajorkiug  CAP. 

556.6 

c06.  2 

464.  1 

428.4 

393.7 

-40.4  N 

SALU'S/'IEI  PLANT 

1040,0 

1172.3 

1315.7 

1485.4 

1689.0 

150.1  0 

!  •’ 

ARPOu<.  P/I-  RATIu  R 

-Q.0 

-0.0 

-0.0 

-0.0 

-0.0 

-0.0 

in  . 

CAPITALIZATION 

,111  , 

L-T  OE-JT/EO'.JITY 

8.8 

7.0 

5.8 

4.  1 

3.8 

-1.3  p 

JSlBi;.:  1“ 

LIAS. /EQUITY 

71.7 

67.3 

63.4 

59.8 

56.5 

-3.8  o 

L-T  DEST/L-T  CAP  IT*  I. 

8.1 

6.5 

5.2 

4.0 

3.7 

-1  .1  0 

|-  I » 

oK  cQ'!ITT/raT  DEBT  A?. 

1 002.9 

1242.2 

1  855.4 

1994.3 

2636.5 

401.9  P 

LID"I')ITY 

f  * 

j  f 

CURRENT  RATIO 

210.2 

R2I.3 

232.3 

243.3 

258.5 

11.90 

S’ 

AC  in  TEST 

1  38. 9 

146.9 

158.0 

169.0 

183.  1 

11.7  o 

%  • 

DAYS  RECEIVABLES  1? 

28,3 

25.3 

25.3 

25.3 

25.3 

o.o 

1 1 

IIECFI  VA.SLES/KLiRK  CAP 

38.6 

35.  1 

32.2 

29.7 

27.3 

-2.8  N 

&  ! 

inventory  TURNS  r 

8.  1 

8. 1 

8.  1 

8.  1 

8. 1 

-0,0  S 

i ,  s 

INVENTOR I ES/WURK  C*P 

61.8 

56.  1 

51.4 

47.5 

43.6 

-4.5  0 

£■  ! 

DAYS  PAYABLES  R 

38.2 

38.2 

38.2 

38.2 

38.2 

-o.o  s 

1:  1 

WORKING  CAP/ASSETS  7. 

34.5 

30.7 

42.8 

45.7 

49.0 

3.  1  o 

aT. 

V-'  * 

L-T  DE6T/NURKING  CAP 

14.0 

10.5 

7.8 

5.6 

4.9 

-?.3  P 

il* 

CSH  FLO/TOT  LIAB 

23.7 

24.4 

25.0 

25.6 

26.2 

0.6  S 

COVFRAGF 

Pi 

INC  BIT/INTEREST 

1630.3 

2027. 1 

2469.5 

3054.9 

3881.4 

551.2  P 

^  t 

CSH  FLO/OBT  mAT+C.E. 

230.6 

251.2 

260.4 

270. 2 

331.3 

20.2  o 

j 

OVERALL  5T.REr.GTH 

%  i 

g  i 

Z-  SCORE  TOTAL  Z 

9.29 

10.78 

12.71 

15.38 

19.28 

2.5  o 

Sc  } 

U ! 

*  EXCEPT  WHERE  MARKED 

R(RATTO) 

OR  7-SCOHE 

TOTAL 

5.  ■ 

6. "  1 

7.  THGSF  ARE  THE  COMPONENTS  A  TOTALS  OF  THE 

Z  SCORE-SEE  MANUAL 

FUR  EXPLANATION 

g  I 

AZ  APPROXIMATION  TO  MARKET  EQUITY /TOT  DEBT- 

•-Z  SCORE 

TOTAL  ONLY 

APPROXIMATE 

=  1  1 

SEE  RELATIVE  INCOME  STATEMENT  AMO  RELATIVE 

3ALANCF  SH 

FET  FOR  OTHER  KEY  «ATins 

DATA  SOURCE i  SEE  PPIUI 

ANAI.YZF.T  OUTPUT  FOR 

THIS  COMPANY 

mm 


A 


JiliwpiJ 


i 


S' 


mi 


p 

I 

t  * 
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TABLE  5 

cC>iFCASTING  FACTORS  OF  F»C  C  JRP 


I  I  APR  78  PR 


WEIGHTED  AVERAGE-EXOQN: 
DATA  SOURCE i  INVESTORS 


NT  I  A!.  WEIGWTSCUPRF.NT  YEAR  AT  .5 
MANAGEMENT  SCIENCES  ,  INC.  FILE  DATED  FINAL 


INO"STRYs  CJilSTRUCTI  BN 

MACHINERY 

A  POP 

DATA  PRINTED  in  pfrcfnts 

••tJ'TH  FISCAL  YR  ENDS 

OFC 

nEC 

DEC 

dec 

DEC 

A’TD 

FISCAL  y!-:ar 

•072 

1073 

1  R7a 

1075 

1  976 

AVFOAGF 

TREND 

FOR“C \STED  VARIABLE 

"It. ATE  )  VA.-IAULF 

SAI.^S  G-'jYTH 

:F  SAL  Es 

10.65 

14.79 

20.64 

10.50 

-6.41 

1.68 

-1.84 

OiJrT  .IF  SALES 

Nr r  SALES 

75.13 

75.81 

78.14 

76.09 

73.62 

75.03 

-0.28 

SE!  LING, (JEN  i  AOMIN 

NET  SALES 

14.69 

1  4  .  1  *> 

13.40 

13.26 

14.01 

11.79 

-0.23 

DEPRECIATION  IS 

’  i 

PRIOR  GROSS  PLANT 

5.17 

6.29 

6.80 

5.86 

4.5-1 

5.29 

-0.16 

interest  expense 

AVG.  TOTAL  01:  oT 

5.81 

6.28 

8.05 

7.65 

7.94 

7 . 64 

0.56  ? 

uTHFR  I NC JVE/-EYP . 

:iHT  SALES 

0.«6 

1.18 

1.50 

0.81 

0.95 

0.  89 

-0.02 

INCOME  TAXES 

INC  WE  BEFORE  TAX 

32.61 

38.46 

19.50 

28.49 

37.70 

32.27 

1.04 

MINORITY  INTEREST  IS 

INCOME  AFTER  TAX 

0.77 

0.92 

1.04 

0.71 

0.49 

•0.65 

-0.08 

CASO 

ACCOUNTS  PAYA6LC 

IS.  13 

6.  90 

1.75 

37.93 

93.8? 

58.24 

18.83 

> 

ACCOUNTS  RECEIVABLE 

; 

NET  SALES 

17.10 

18.14 

14.70 

13.12 

13.81 

14.24 

-1.20  s 

INVENTORIES 

CS  +  OEPR  IS 

24.61 

24.50 

26.90 

23.40 

23.55 

24.06 

-0.32 

UTH=R  CURRENT  ASSETS 

- 

CS+SGA+CAP  EXP 

2.22 

2.83 

3.28 

2.56 

3.86 

3.30 

0.30 

ACCOUNTS  PAYABLE 

CS+SGA+CAP  EXP 

8.27 

0.17 

10.60 

13.26 

16.20 

1  1 . 83 

1.99  S 

INCOME  TAXES  PAYABLE 

INCOME  TAXES 

38,  *9 

104.44 

92.73 

110.74 

83.94 

90.21 

o.64 

1 

OTHER  CURRENT  LIAB. 

CS+SGA+CAP  EXP 

6.73 

6.07 

5.77 

6.96 

7.70 

7.12 

0.29 

PLT  SjLO&RETIHEO 

4 

P P I OR  GROSS  PLANT 

5.57 

2.66 

4.54 

2.34 

1  .90 

2.62 

-0.76 

- 

ACC  OEPR.  SJLU&RET. 

':j 

PLT  SOLD&RETIREO 

68.64 

75.02 

85.45 

74,00 

72.36 

74.34 

0.64 

■'ft 

DIVIDENDS 

4 

COM  +  PREF  STOCK 

18.12 

18.66 

19.60 

19.97 

21 ,0Q 

20.28 

0.73  S 

*3 

CAPITAL  EXPENDITURES 

PRIOR  GROSS  PLANT 

13.06 

12.26 

18.87 

U.R6 

8.45 

11.68 

-0.66 

% 

f- 

£ 
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-'3 
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TABLE  6 

PROJECTION  ARSII«DTIONS  PUS  1NTL  b"SINESS  MACHINES  CORP 


I  I  APS  7°  P 1 1 


I.n-'ar.IY:  OFFICE  COMPUTING  A  ACCTG  MCH 


Pi*>)iECTcD  VArflASLE  TYRE 


PROJECTION  METHOD 


lii:  f  SALFS  OFF » 

■JuST  F  SALES  DEFA 

oEL!  1  ‘ID,  JE-J. H AD  'IH.  DEFA 

L  HR  REG  I  *•  1 1 i  'S  DEFA 

INTEREST  EXJ-:'!C,:  OFF* 

SPECIAL  irt;'S  DhFA 

U'fMPS  r'CDME/-EVP.  DEFA 

ILO'p  TATES  DEFa 

'.rn.iirY  interest  ip  off* 

uXTRAJRDj  IA  If  [TIP'S  DEFA 

DIVIDENDS  OF.PA 

i/H .  SET.  EARNS .  C“GS .  OFF  A 

I  IT.A-J  «  CAS'-:  b  ALAMO"  OFF  a 

ACC'U  ITS  .{ECeIV  \:>Ll:  DEFA 

INVENT  DRIES  DEFA 

uTHF"  Cl'MHff  ASSETS  DEFA 

InVPSrMP'irs  DEFA 

UTAisG  IDLES  DEFa 

OT'I'L-:  ASSETS  DEFA’ 

AGCOU  ITS  PAYABLE  DEFA 

-LAP  Ik  I  MG  Ntj  fHS&DEST  DEFA 

I NCHft'E  TAXES  PAYadLP  DEFa 

OTHER  Cl  WENT  LIAS.  DEFA 

uTH=p  L-T  LlAb.  DEFa 

I'iORITY  INTEREST  US  DEFA 

PRErF 'RED  STOCK  DEFA1 

Cu-J-'O'I  STOCK  DEFA' 

CAPITAL  SURPLUS  DEFA 

TuTAL  DPPRECIATI JN  DEFa 

UTMFI?  OPNS.  SUURCES  DEFA 

PLT.  S  3LD  &  RFTlpFn  DEFA 

ACC . DEC  R . -SGLB&RET •  DEFA 

SAL1--  OF  PLANT,  ETC.  DEFA 

SALF  Or  STOCK  DEF* 

MEN  LONG-TERM  DEbT  DEFA 

OTHER  SOURCES  DEFA 

CAPITAL  EXPENDITURE’  DEFA 

INVESTMENTS  &  ACO.  DEFA 

DE3T  MATURITIES  DEFA 

TREASURY  STOCK  RURCH  DEFA 

OTHER  APPLICATIONS  DEFA 

PREFERRED  DIVIOcNDS  DEFA 


•LT 

•LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LI¬ 

LT 

LT 

LT 

LT 

LT 

I.T 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

LT 

ILT 

ILT 


YEAR 
<PPlO:< 
(PR I  I:. 

ip i 

(PPIu ( 


Y“AR) 
Y"AR  5 

y~j\j) 

Y“AR) 


GROWS  A  r  5.  W  FROM  LA1EST 
2.0.7  IH  OF  NET  SALES 
3R.50K  uF  MET  SALES 
I  2. *5%  UF  PR  10  a  GRU'S  ^L*NT 
O.OSX  u=  A VC.  TOTAl  DEbT 
SET  ru  AFRO 

2.7 0<  UF  NET  SALFS 
46.S(S“<  uF  IiiCOM.P  » Hr  OR  5  TAX 

*  *icr  PRO.!' C f FD-H I STuR  V  ZERO  OR  NOT  AVAIL. 
SET  TO  ZERO 

37.42%  OF  CuV.  +  PRcF.  STOCK 
SFT  ro  ZERO 

</90.6^<  UF  ACCOUNTS  paYAjI  .• 

IZ.oS*  OF  MET  SALES 
IS. 7PM  OF  COST  SALES  +  DEPP. 

3.31 X  OF  CS  +  SGA  +  C'P.  FXP. (WTO. A  VO. ) 
ROLLED  FOR'mari',  ADDING  INVESTMENTS  A  AC''. 

*  N.ir  PROJECTPD-'!IST..RY  ZERO  OR  NOT  AVAIL. 
SAME  AS  PRIOR  YEAR  OTHER  ASSETS 

11.78%  OF  CS  +  SGA  +  CAP.  EXP.  (WIO.  AVO. ) 
TAKEN  FROM  HISTORICAL  DATA 
A3.3R-<  uF  INCOME  TAXES  CnTD.AVG.  ) 

2.85%  OF  CS  +  SGA  +  CAP.  EXP.IPPIOR  Y^AP) 
SA’>F  AS  PRIOR  YEAR  CJl’HER  L-T  LIAo. 

*  NOT  PRO.IECTFD-H  I  STORY  ZERO  OR  NCT  AVAIL. 

*  Nor  0!KjJECTE()-H I ST«jRY  ZERO  OP  I«;T  AVAIL. 
SAME  AS  PRIOR  YEAR  COMMON  STOCK 

SA"E  AS  PRIOR  YEAR  CAPITAL  SURPLUS 


(t.TI'.AVG.  ) 
(y.'TD.AVG. ) 


(ill?..  A  VO.  ) 

(,/iU.AVO.  ) 
(ViTI'.AVO. ) 
(PRIOR  YnA*') 


ZERO 

Z.PRO 

ZPRO 


(PRIOR  YEAR) 
(VITP.AVO. ) 

OR  NOT  AVAIL. 
OR  NOT  AVAIL. 
OR  i, OT  AVAIL. 


11.25%  uF  PPIfP  GROSS  PLANT 
23 .  ‘50’>  OF  NET  INCOME 

*  NOT  PROJECTED-'-' I  ST  JR  Y 

*  Nar  prujectfd-hisidRy 

*  NOT  PROJECTFD-HISTuRY 
SET  TO  ZERO 

SF.T  TO  ZERO 
SFT  TO  ZERO 

|R.'*5%  OF  PRIOR  CROSS  PLANT  (WTD.AVO.) 
SET  I’O  ZERO 

TAKEN  FRUU  HISTORICAL  DAT'- 
SET  TO  ZERO 

CALC  -  3ALANCF  CHANGE  IN  L/T 

*  NOT  PROJECTPP-H ISTORY  ZERO 


ACCOUNTS 
OR  NOT  AVAIL. 


N0TP»  'THERE  TYPF  IS  'DEFAULT',  USER  GAVE  M3  ASSUMPTION 
THERSuY  ACCEPTING  THn  DEFAULT  >'F HOD 
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CENTRALIZED  V2RLUL  DECEN'i  RALXZE!) 
ITEM  MANAGEMENT  VITHlil  HQ,  ARRCOM 


Donald  L.  Bixby ,  Procurement  arid  Proauction  Policy  ond  Plans  Office 
HQ,  tj.S.  Amy  Armament  Materiel  Readiness  Command 


INTRODUCTION 


'Die  purpose  of  this  paper  is  to  present  a  syn¬ 
opsis  of  a  study  on  centralized  versus  decen¬ 
tralized  management  and  item  management  con¬ 
ducted  within  Headquarters,  ARRCOK  from  July 
197V  through  April  .197?.  Die  final  study 
report  etceeded  IiOO  pages,  inclusive  of  rather 
extensive  docunentation  and  reference  material 
ir.  the  Appendices.  The  full  report  will  be 
available  through  the  Deftuo':  Logistics 
Studies  Information  Exchange  for  these  oho  may 
wish  to  pursue  the  detail  and  back-up  material. 
Tills  synopsis  will  provide  highlights  and 
extracts  for  those  whose  principal  interest  is 
m  tile  general  concept  of  centralized  vernuG 
decentralized  management,  study  methodology 
employed,  lessons  learned,  and  possible 
application  to  a  similar  situation  within 
their  own  organizations. 


SUMMARY /ABSTRACT 


The  stuly  findings  indicate  that  neither 
extreme;! .e. ,  total  centralization  or  total 
lecontrulizntion,  is  practical  or  desirable. 

The  preferred  and  most  often  utilized  organi¬ 
zational  structure  appears  tf  be  a  combination 
cf  both  concepts.  In  that  respect,  the  current 
inventory  management  alignment  within  HQ, 

ARRCOM  is  a  combination  of  centralization  and 
decentralization,  and  it3  continuation  was 
highly  rated  in  the  study  analysis  and  conclu¬ 
sions.  A  high  potential  alternative  for  the 
longer  term  involves  a  partial  centralization; 
i.c.,  an  increase  in  centralization  over  that 
of  the  current  alignment  by  consolidating  the 
inventory  management  of  quality  assurance 
equipment  (E'ATE)  and  depot  ammunition  main¬ 
tenance  equipment  (APE)  into  the  existing  NICP 
organizational  elements,  while  leaving  indus¬ 
trial  production  material  outside  of  the  NICE 
management  unless  the  items  are  sold  or  Issued. 

The  study  also  found  that  not  only  is  tnerc  no 
clear  cut  "best"  answer  .n  the  question  of 
centralization  versus  decentralization,  there 
is  a  definite  lack  of  agreement  as  to  th : 
definition,  oppJication,  advantages,  and 
disadvantages  of  either  option.  This  general 
lack  of  agreement,  or  disparity,  in  definition 
ond  use  of  terms  was  al3o  found  to  appiy  to 
subject  related  terms  such  us:  item  Manager, 
Inventory  Manager,  and  Inventory  Management. 
Tnis  lack  of  common  terminology  wa3  found  not 
only  in  colloquial  usage,  but  surfaced  in  the 
research  of  regulations  and  academic  texts. 


The  stuiy  also  found  mat  the  locution  (cen¬ 
tralized  or  decentralizes)  of  personnel 
performing  inventory  management  was  not  as 
significant  as  the  establishment  of,  training 
i.i,  and  adherence  to  standardized  procedures, 
both  off-line  and  CCSS  automated. 


STUDY  SYNOPSIS'  EXTRACT), 


Subject  Matter:  Dte  study  researches  and 
analyzed  the  alternatives  of  centralization 
and  decentralization  of  organizations  for 
itea/inventory  management  vitnm  HQ,  ARRCOM. 
Emphasis  was  on  the  qualitative  aspects  of  the 
organizational  alignment  of  Item/Inventory 
Managers  for  the  performance  of  supply  (NICP) 
functions . 

Background :  A  pr:or  study  on  unbilled  ship¬ 
ments  of  material  identified  the  existing  de¬ 
centralized  alignment  of  item  managers  as  a 
possible  detrimental  factor  ir.  billing/system 
deficiencies.  Current  study  was  directed  cy 
If. ,  ARRCOM  to  be  performed  as  ar.  m-house  Task 
Force  effort,  study  began  July  1977  with  study 
completion  in  April  19Y8. 

i'uroose/Oft.iectlves :  The  study  was  to  Identify 
the  alternatives  of  centralized  and  decentral¬ 
ized  Item/Mater tel  management  within  HQ,  ARRCOM 
It  perform  an  objective  analysis  of  the  alter¬ 
natives,  and  moke  recommendations  as  to  the 
pr-f'-rred  alternative,  functional  alignments, 
and  other  actions  as  determined  by  the  study 
findings.  The  study  analysed  nnd  compared 
four  alternatives  for  organizational  alignment 
of  inventory  management.  Die  alternatives 
analysed  are:  Continuation  of  Current  Align¬ 
ment:  Further  Decentralization;  Partial 
Centralization;  and  Total  Centralization, 
font i nuot i on  of  current  alignment  was  consider¬ 
ed  to  be  t:.e  basic  sit  lotion  against  which  the 
other  three  alternatives  were  compared.  The 
current  alignment  ,  referred  to  u3  "Status 
Quo"  m  1  no  study  text,  was  defined  as  being 
subsequent  to  October  19’’7 ,  and  assumed 
implementation  of  several  "ir.-process"  changes; 
i.c.,  fully  operational  establishment  of 
DRSAR-DA.  as  the  NICP  for  Conventional  Ammuni- 
ti  -u  under  tnc  3M  concept ;  the  ALr  vr.tem  for 
assigning  KCN's  and  leading  DRJAR-Pl)  industrial 
components  into  the  NSNKDR;  full  implementation 
of  the  -ustomcr  Order  Control  Point  (COCF)  in 
DRFAR-CP;  and  full  implementation  of  all 
approved  recommendations  of  the  prior  study  on 
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"Delivcrcd-Unbilled  System  Deficiencies." 


METHODOLOGY 


The  study  was  conducted  by  a  Task  Force  com¬ 
posed  of  three  groups:  A  Study  Advisory  Group 
(SAG)  to  provide  advice  and  guidance;  a  Primary 
Working  Group  (PWG)  which  was  the  principal  con¬ 
ductor  of  the  study;  and  a  Technical  Support 
Group  (TSGJ  to  provide  technical  input  and 
information  on  functional  performance  of  item/ 
materiel  management.  The  study  was  conducted 
in  compliance  with  the  requirements  of  AR  S-S 
and  DARCCMR  10- 1  as  applicable.  The  following 
methodology  w.t.  employed  in  the  performance  of 
the  study: 

a.  Com.nct  literature  research.  This 
included  such  sources  as  prior  internal  staff 
studies,  TASS,  DLSIE,  DDC,  AMETA,  other  Readi¬ 
ness  Commands,  private  industry,  educational 
institutions  and  libraries.  (Reference  Biblio¬ 
graphy,  and  Appendices  B  and  H  of  the  full 
study  reports.) 

b.  Conduct  internal  (HQ,  ARRCOM)  survey 
through  a  questionnaire. 

c.  Compile  and  analyze  survey  results. 

d.  Contact  resident  experts  and  Army  con¬ 
sultants  as  appropriate. 

e.  Gather  data  from  ARRCOM  functional  areas 
through  discussion  meetings. 

f.  Categorize  and  analyze,  as  to  methods 
of  management,  the  items  which  are  and  those 
which  are  not  under  Item  Management. 

g.  Develop  list  of  potential  performance 
indicators  as  criteria  for  comparing  alterna¬ 
tives. 

h.  Analyze  data  gathered  from  functional 
areas  and  determine  significant  factors  which 
influence  performance. 

i.  Develop  and  analyze  alternatives  for 
item  management  alignments. 

j.  Compare  those  a’  matives.  (Reference 
Comparative  Analysis.) 

k.  Develop  impacts.  Quantify  cost  and 
personnel  impacts  as  much  as  practicable. 

l.  Develop  conclusions  and  recommendations. 
(Reference  Conclusions  and  Recommendations.) 

m.  Prepare  final  report. 

n.  Present  rosults  to  Command. 

The  basic  assumption  of  the  study  was  that  the 
recommendations,  if  implemented,  would  not 


require  a  major  organizational  realignment 
within  HQ,  ARRCOM  (i.e. --recommendations  woild 
involve  inventory  management  only,  and  not 
overall  ARRCOM). 


FACTORS  BEARING  ON  STUDY 


The  facts  and  factors  bearing  on  the  study 
were  primarily  of  two  categories:  administra¬ 
tive,  or  those  which  impacted  the  actual  con¬ 
duct  of  the  study;  and,  subjective,  or  those 
integral  to  or  impacting  the  performance  of 
materiel  management  within  HQ,  ARRCOM. 

a.  The  Administrative  factors  included: 

(1)  The  study  was  conducted  within 
the  limits  of  available  regular  hours,  with  no 
overtime. 

(2)  The  study  objectivity  and  impar¬ 
tiality  was  to  be  maintained.  This  was  accom¬ 
plished  by  forming  the  Primary  Working  Group  of 
members  from  organizations  not  directly  per¬ 
forming  item  managemen-  functions.  This  then 
necessitated  a  certain  amount  of  "education" 
of  the  PWG. 

(3)  Somewhat  parochial  orientations 
and  understandable  bias  of  the  various  func¬ 
tional  organizations  representatives  made 
definitive  data  gathering  difficult. 

(4)  Research  tine,  both  in  the  loca¬ 
tion  and  acquisition  of  applicable  source  data 
and  in  the  physical  review  of  that  data  proved 
to  be  much  greater  than  initially  anticipated. 

(5)  The  scope  of  the  study  was  much 
broader  (e.g.,  all  six  elements  of  inventory 
management)  than  indicated  by  the  prior  study, 
which  was  keyed  to  "Delivered/UnbilloJ  Shipments 
Deficiencies." 

(6)  External  limitations,  workloads 
and  organizational  priorities  resulted  in  severe 
restrictions  on  availability  both  of  team  mem¬ 
bers  and  of  administrative  support. 

(7)  Personnel  involved  in  this  study 
and/or  contacted  during  its  conduct  evidenced 
competence  in  their  assigned  materiel  manage¬ 
ment  responsibilities,  displayed  a  conscientious 
attitude,  and  except  as  noted  above,  were  higlilv 
cooperative. 

b.  The  Subjective  factors  included: 

(1)  Current  SM  implementations  and  ic- 
organizations  including  the  further  decentrali¬ 
zation  of  HQ,  ARP.COM  inventory  management  through 
the  formation  of  DRSAJJ-DA. 

(2)  Current  development  of  the  new  "ABC 
System"  for  integrating  ammunition  component 
reporting  and  loading  those  items  in  the  ','SNMDR 
through  the  PMDR  to  allow  CCSS  pro  ■'S>;ing. 
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(3)  Basic  requirements  to  comply  with 
ASPR  and  other  regulations. 

(4)  Implementation  of  the  various  recom¬ 
mendations  from  the  prior  study  on  "Delivered/ 
Unbilled  Shipments  of  Deficiencies,"  some  of 
which  are  in  process  and  the  others  assumed  to 
be  effected  in  the  near  future. 

(5)  Basic  differences  in  the  missions  and 
functions  of  the  various  organizational  ele¬ 
ments  of  HQ,  ARRCOM. 

(6)  'flic  scope  of  the  overall  ARRCOM  missions 
and  the  diversity  of  items  result  in  extremely 
complex  organizational  interfaces. 

(7)  Hie  evolution  and  develo|imcnt  of  many 
independent  procedures  unique  to  an  organiza¬ 
tional  elez  nt  and  geared  to  the  management  of 
its  assigned  items  and  missions,  including  the 
utilization  and  development  of  ADD  processes/ 
systems  other  than  CCSS  (e.g.,  — the  current 
DRSAR-MA  development  of  a  stand-alone  process 
for  APE) . 

(8)  The  magnitude  and  comple:.itv  of  the 
CCSS  itself,  and  the  attendant  difficulty  in 
achieving  universal  integrated  unde-standing  or 
utilization  of  the  full  system  and  processes 
throughout  UR,  ARRCOM. 


DISCUSSION 


a.  Tlic  complexity  of  the  study  subject  was 
recognized  at  the  outset.  There  was  also  a 
strong  suspicion  that  considerable  ambiguity 
and  misunderstanding  existed  among  the  various 
HQ,  ARRCOM  organizational  elements  in  reference 
to  usage  of  terns,  delineation  and  separation 
of  responsibilities  for  the  different  missions 
and  functions,  and  the  utilization  and  adher¬ 
ence  to  available  standard  systems  and  processes. 
These  suspicions  were  all  supported  as  the  study 
progressed. 

b.  The  preliminary  survey  questionnaire 
served  several  purposes.  Primarily,  it  gath¬ 
ered  data  for  later  comparison  and  analysis, 
covering  such  areas  a.->  items  managed,  who  man¬ 
ages  the  items  and  how,  and  differences  in  pro¬ 
cedures  and  definitions  of  terns.  Results  of 
the  survey  indicated  considerable  disparity  in 
the  understanding  and  use  of  terns.  A  set  of 
clear  definitions,  as  applied  to  tne  study, 
therefore  became  a  crucial  early  effort  of  the 
Primary  Working  Group  (PNG) .  The  survey  also 
served  as  an  "educational"  device  for  the  PWG, 
providing  a  good  cross-section  of  information 
on  materiel  management  activities  within  HQ , 
ARRCOM.  The  survey  responses  also  served  as  a 
guide  to  the  PNG  as  to  what  additional  areas 
and  questions  needed  to  be  covered  in  subsequent 
research  and  discussion  meetings  (Reference 
Final  Report,  Appendix  F)  with  representatives 
of  the  key  functional  organizations.  The  most 


crucial  terms  requiring  definition  wero  those 
related  to  materiel  management  (o.g.  Ttom  Man¬ 
ager,  Inventory  Manager,  Materiel  Management, 
etc.)  and  clarification  of  Centralization  and 
Decentralization.  Considerable  effort  was 
expended  in  this  area,  and  the  backup  material 
can  bo  found  in  the  complete  report.  Basically, 
Materiel  Management  is  a  broad  term  covering 
all  aspects  of  the  management  of  items  and 
material.  Item  Management  is  roughly  synonomous 
with  Materiel  Management,  and  should  be  con¬ 
sidered  a  broad  or  generic  term.  Unfortunately, 
colloquial  usage  varies  and  there  are  numerous 
and  simultaneous  applications  of  the  term  Item 
Manager  to  those  performing  various  functions  of 
Materiel  Management.  Inese  varying  functions 
should  be  more  accurate!-’  described  by  terms 
denoting  the  specific  a-e.is  of  materiel  manage¬ 
ment  involved.  For  example,  the  materiel  i,.an- 
ugenent  functions  performed  by  DRSAR-MM  and 
PRSAR-DA  are  actually  inventory  management,  and 
the  official  (job  description.  Series  2010;  title 
for  the  people  performing  these  functions  is 
'Inventory  Management  Special i  t."  But  these 
people  are  frequently  referred  to  as  Item  Man¬ 
agers.  Similarly,  the  people  from  DRSAR-PD, 
though  also  often  referred  to  as  Item  Managers, 
are  actually  Production  Management  Specialists 
or  "Production  Managers"  (generally  engineers 
and  industrial  specialists).  Tne  people  from 
DRSAR-IL  are  actually  "Case  Managers"  and 
should  really  be  performing  very  little  of  the 
inventory  management  functions. 

c.  A  more  difficult  area  to  resolve  is  that 
of  the  terms  Centralization  and  Decentralization. 
Though  singular  definitions  may  be  developed  for 
each,  in  application  any  condition  identified  as 
"centralized"  in  one  frame  of  reference  may 
paradoxically  be  identified  as  "decentralized" 
at  another  level  or  in  another  frame  of  reference 
(e.g.,  the  "centralization"  of  all  conventional 
ammunition  inventory  management  functions  in  one 
organizational  element  may  be  cons,dered  a  "de¬ 
centralization"  of  both  materiel  and  overall 
materiel  management  functions;  with  corollaries 
ad  infinitum).  The  Ph'O  found  no  singular  answer 
to  the  definition  of  centralization.  The  only 
resolution  to  the  problem  appeared  to  be 
arbitrarily  establishing  an  ad  hoc  definition 
of  centralization  as  it  pertains  to  this  study 
and  in  reference  to  the  performance  of  the  six 
elements  of  inventory  management  (i.e.,  Catalog¬ 
ing,  Requirements  Determination,  Procurement/ 
Production  Direction,  Distribution  Direction, 
Maintenance  Direction,  Utilization  and  Disposal 
Direction).  Backup  material  and  discussion  on 
this  car.  be  found  in  the  report.  Briefly, 
centralization  is  the  grouping  of  all  similar 
management  functions  within  a  single  organiza¬ 
tional  clement.  In  this  context,  current  inven¬ 
tory  management  is  basically  "decentralized." 

For  the  purposes  of  this  study,  the  following 
definitions  of  centralization  and  decentraliza¬ 
tion  apply- 

(1)  Centralization.  Item/Inventory 
management  under  one  control;  i.e.,  all  item/ 
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inventory  managers  and  their  functions  arc 
located  in  and  work  for  one  diiectoratc. 

(2)  Decentralization.  Responsibility 
for  the  functions  of  inventory  managenent  and 
items  managed  are  spread  among  several  direc¬ 
torates.  Directorates  perform  all  or  most  of 
the  functions  of  inventory  management  for  items 
in  their  functional  area,  item/inventory  man¬ 
agers  are  located  in  two  or  more  directorates. 

d.  Another  problem  encountered  by  the  Ph'C 
was  in  the  complexity,  variations,  and  magnitude 
ol  materiel  management  within  HQ,  AURCOM.  The 
variations  ir  both  items  managed  and  uniquely 
applicable  procedures  for  their  management,  as 
well  as  basic  differences  in  the  missions  and 
fund  ions  of  the  organizational  element  in¬ 
volved,  made  Quantitative  comparisons  and 
analysis  d,  'fiz.Jr  if  not  impossible.  Though 
the  PKG  expend'd  considerable  time  and  effort 

in  trying  to  develop  useful  quantitative  data, 
sufficient  comparable  data  was  not  available 
for  meaningful  quantitative  analysis.  The 
stud>  emphasis,  by  the  dictates  of  the  subject 
natter,  was  primarily  centered  upon  the  qualita¬ 
tive  aspects.  Even  in  this  regard  the  complex¬ 
ity  and  organizational  interfaces  posed  a  prob¬ 
lem  for  the  PKG.  If  each  variation  in  proce¬ 
dures,  item  assignments,  and  organizational 
alignment  were  to  be  considered  as  a  study 
"alternative,"  the  list  of  alternatives  would 
become  so  long  as  to  preclude  analysis.  The 
PKG  resolved  this  pn  Liras  by  reducing  the  poten¬ 
tial  alternatives  to  the  minimum  -  i.c.,  status 
quo,  further  deco  .teal iz-llion,  further  centraliza¬ 
tion,  and  tota.  centralization.  All  variations 
in  item  assignments,  procedural  changes,  etc., 
could  then  be  treated  as  options,  or  conditions 
of  the  basic  alternatives.  This  development  is 
shown  in  compete  report. 

e.  Assuming  status  quo  to  be  the  condition 
from  which  cither  centralization  or  further 
decentralization  might  evolve,  it  was  necessary 
to  delineate  that  condition.  Considering  the 
dynamic  nature  of  110,  ARRCOM,  the  implementation 
of  SM  responsibilities  including  the  establish¬ 
ment  of  the  new  OKSAR-DA  Directorate  for  con¬ 
ventional  ammuni tion,  the  assumption  that  the 
recommendations  from  the  study  on  "Delivered/ 
Unbilled  Shipments  Deficiencies"  would  be  fully 
implemented,  the  constant  orocedural  changes 
such  as  the  development  -  the  new  "aBC  System" 
for  loading  ammunition  exponents  into  the  PMDR/ 
NSNMDR,  even  status  quo  is  a  non-static  condi¬ 
tion.  Tlie  final  report  (Chapter  2)  provides  a 
statement  of  the  development  of  status  quo  from 
prior  to  March  1977  to  current  condition  subse¬ 
quent  to  the  above  actions,  or  effcctivelv  sub¬ 
sequent  to  October  1977. 

f.  The  four  alternatives,  including  status 
quo,  are  then  analysed  in  Chapters  3  and  4. 

This  was  dene  by  analyzing,  In  Chapter  3,  status 
quo  as  the  basic  c..ndition/nlignmont .  Tho 
rcn.iiniig  options  wcic  then  analyzed,  in  Chapter 
4,  a?  alternatives  to  status  quo.  The  analyses 


address  aspects  of  mission,  organization,  con¬ 
trol,  regulations,  procedures,  personnel, 
materiel  (items),  costs  and  other  factors 
impacting  item/materiel  management.  The  com¬ 
parative  analysis  of  status  quo  and  the  alter¬ 
natives  are  presented  in  Chapter  S,  with  tho 
summary  and  conclusions  of  the  findings  and  the 
study  recommendations  given  in  Chapter  6. 

g.  Though  direct  references  are  noi  always 
cited  in  tho  body  of  this  report,  the  data  and 
information  available  in  the  appendices  served 
as  the  basis  for  the  analysis,  conclusions  and 
recommendations  presented  herein.  The  informa¬ 
tion  relative  to  "centrallzation/dccentraliza- 
<ion"  and  to  the  definition  of  terms  came  mainly 
from  the  PKG's  research  into  available  litera¬ 
ture,  prior  studies,  regulations  and  other 
documentary  sources.  The  information  relative 
to  missions,  functions,  procedures,  "systems" 
utilized,  personnel  an!  item  assignment.-,,  and 
problem  areas  came  mainly  from  the  inputs  of 
the  various  TSG  representatives  (primarily  those 
from  the  key  functional  directorates  involved  in 
or  directly  interfacing  with  inventory  manage¬ 
ment)  . 


COMPARATIVE  ANALYSIS 


Centralized  vs  Decentralized. 

a.  Organizational  centralization,  in  the 
pure  sense,  is  the  location  of  all  functions  in 
a  single  element  with  a  single,  vertical  line 
of  authority,  direction  and  control.  It  is 
rarely  applied  and  generally  impractical.  Any 
deviation  must  be  considered  to  be  some  form  of 
decentralization,  although  it  may  be  closer  to 
centralization  than  it  is  to  total  decentral  i ra¬ 
tion.  Total  decentralization  is  equally  rare 
and  impractical. 

i' ,  Organizational  decentralization  can 
occur  in  varying  degrees  and  in  several  differ¬ 
ent  contexts: 

(1)  Large  organizations  may  require 
decentralization  merely  for  the  sake  of  dii iding 
the  organization  into  manageable  parts  or  divi¬ 
sions;  e.g.,  most  largo  corporations  arc  orga¬ 
nized  into  major  divisions.  Each  division  can 
function  independently  of  the  others  since  all 
services  and  functional  specialties  are  dup¬ 
licated  in  each  division.  This  type  of  decen¬ 
tralization  allows  for  management  authority  and 
responsibility  to  be  delegated  to  lower  levels 
and,  :hus,  shorten  lines  of  communications  and 
help  eliminate  bottlenecks.  Hewcvoi ,  if  an 
organization  has  coo  many  divisions,  management 
control  will  be  degraded,  and  inefficiency 
results  because  of  duplication  of  effort,  etc. 
When  carried  to  cither  e/tre,.-  of  cntrali zntion 
or  decentralization,  the  disudv.wt...  outweigh 
the  advantages;  therefore,  there  is  an  optimum 
number  of  major  divisions  for  any  given  organiza¬ 
tion.  Tills  optimum  point  depends  upon  the  size 
and  function  of  rhe  organization. 
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(2)  Organ i rations  may  bo  decentralized 
to  provide  physical  dispersion  of  facilities 
and/or  services  into  different  geographical  or 
functional  areas.  Decentralization  through 
dispersion  of  facilities  and/or  personnel  may 
provide  the  same  advantages  and  disadvantages 
discussed  in  lb(l)  above.  Additionally,  this 
type  of  decentralization  can  shorten  supply 
and/or  communication  lines  to  the  customers. 

(3)  Organizational  decentralization 
may  divide  the  organization  into  functional 
elements.  This  type  of  decentralization  pro¬ 
vides  the  same  advantages  and  disadvantages 
discussed  in  paragraph  lb(l)  above.  Addition¬ 
al  1,,  since  all  like  functions  would  be  per¬ 
formed  in  one  element,  division  or  directorate, 
a  high  degree  of  specialization  can  develop  in 
the  functional  areas  or  in  the  expertise  related 
to  items/products. 

c.  A  "mix"  or  combination  of  centralization 
and  decentralization  is  conceded  to  be  the  most 
practical  and  generally  preferred  alignment. 


production  purposes,  but  production  assets  will 
not  be  recorded  in  Sectors  S,  6,  or  8.  If  the 
NICP's  receive  a  demand  (MTPR,  FMS,  or  POR)  for 
industrial  _  imponents ,  L'RSAR-PD  will  provide 
the  necessary  documentation  to  transfer  the 
stock  into  the  NICP  account,  and  process  the 
customer  demand  through  the  CCSS.  If  the 
industrial  component  is  not  recorded  in  the 
NSNMDR,  and  the  command  elects  to  supply  the 
items,  DRSAR-P1)  will  add  the  items  to  the  NSNMDR 
and  process  as  above. 

c.  The  organization  of  11Q,  ARRCOM  for  item 
management  is  basically  decentralized  through 
all  the  types  of  decentralization  discussed  in 
paragraph  l  above. 

(1)  The  format. on  cf  two  NICP's,  one 
for  ammunition  and  one  for  weapons  and  secondary 
items,  is  the  type  of  decentralization  discussed 
in  paragraph  lb(l)  above.  This  deviation,  i.e., 
establishing  two  NICP's  in  or.c  Commodity  Com¬ 
mand,  was  approved  by  the  Department  of  the 
Army. 


HQ,  ARRCOM  Organization. 

a.  Current  inventory  management  of  all 
items  normally  referred  to  as  standard  items  is 
decentralized,  and  is  performed  in  two  separate 
NICP's,  uRSAR-DA  (Conventional  Ammunition!  and 
DRSAR-MM  (Weapons).  This  decentralization, 
which  is  a  deviation  from  required  centralized 
integrated  inventory  management  (Alt  710-1),  was 
authorized  by  Tnc  Department  of  the  Army. 
Basically  this  was  required  because  the  Commod¬ 
ity  Command  was  directed  by  DOI)  to  provide 
Single  Management,  for  most  classes  of  conven¬ 
tional  ammunition,  for  all  armed  services  (c.g.. 
Army,  Air  force,  Navy,  and  Marine  Corp) .  This 
requires  a  different  type  of  inventory  manage¬ 
ment  than  Centralized  Integrated  Inventory  Man¬ 
agement  directed  by  AR  ~10-l  for  the  Commodity 
Commands.  Inventory  Mrnagemcnt  of  DRSAR-MA  (APE) 
and  DRSAR-QA  (PATE)  items,  normally  referred  to 
as  non-standard  items  (yet  they  are  procured, 
stocked,  stored  and  issued),  is  not  only  decen¬ 
tralized  but  is  manually  managed  outside  of  the 
NICP's  and  CCSS.  This  was  authorized  by  ARMCOM 
Supplement  1,  dated  16  October  1975,  to  AMC 
Regulation  702-2,  dated  27  May  1906,  Subject: 
Quality  Assurance  Inspection  Equipment  Design, 
Supply,  and  Maintenance.  This  is  in  direct 
conflict  with  AR  710-1,  dated  29  August  1975, 
Subject:  Centralized  Inventory  Management  of 
The  Array  Supply  System.  Also,  it  was  a  command 
decision  that  DRSAR-PD  will  inventory  manage 
industrial  components  that  arc  not  end-items 
within  themselves  and/or  already  inventory  man¬ 
aged  by  the  NICP's.  DRSAR-PD  is  now  in  the  pro¬ 
cess  of  loading  these  items  to  the  PMDR  and  the 
NStttDR. 

h.  The  connand  also  has  a  unique  situation 
in  supplying  industrial  components  through  the 
field  service  account  (NICP's).  These  items  arc 
production  managed  and  controlled  by  DRSAR-PD. 
They  have  also  been  recorded  in  the  NSfWDR  for 


(2)  Tile  physical  dispersion  of  item 
managers  into  DRSAR-MA  and  DRSAR-QA  is  the  type 
of  decentralization  discussed  in  paragraph 
lb (2)  above. 


(3)  Tlie  basic  structure  of  the  head¬ 
quarters  is  the  type  of  functional  decentrali¬ 
zation  discussed  in  paragraph  lb(3)  above. 

Attribute  Analysis. 

a.  An  attribute  analysis  was  performed  to 
compare  the  present  IIQ,  ARRCOM  organization  for 
inventory  management  and  the  alternatives  dis¬ 
cussed  in  Chapter  -1.  The  results  of  this 
analysis  are  summarized  below. 


Alt-  rnative 
Status  Quo 

A.  Further  Decenlrali 
B-l.  Complete  Central 
B-2.  Partial  Centra li 


Weighted  Score 


♦24 

zation 

-28 

ization 

♦  18 

zation 

♦23 

b.  An  attribute  analysis  is  highly  subjec¬ 
tive  and  especially  so  if  an  attempt  is  made 

to  quantify  the  analysis  in  seeking  to  rate  or 
comparatively  rank  the  alternatives.  The  attri¬ 
butes  and  performance  factors  utilized,  the 
weighting  given  to  each,  and  the  rating  of  the 
alternatives  against  these  attributes  are  all 
subject  to  persona!  interpretations.  So  much 
so,  in  fact,  that  individual  interpretations 
could  not  only  alter,  but  indeed  completely 
reverse  the  comparative  rankings  and  results  of 
the  analysis.  The  attribute  analysis  performed 
in  this  study  represents  the  consensus  of  the 
Primary  Working  Group.  The  full  listing  of 
attributes  and  rating  value  arc  provided  in 
Exhibit  1,  Attribute  Alternative  Analysis. 

c.  Though  an  attribute  analysis  is  only 
appropriate  as  an  indicator  of  relative  strength 
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of  alternatives  and  not  as  the  prime  or  singular 
basis  for  a  decision,  results  of  the  analysis 
strongly  suggest  that: 

(1)  Further  decentralization  has  such 
a  low  score  that  further  consideration  of  the 
alternative  is  unwarranted, 

(2)  Partial  centralization  and  total 
centralization  have  very  similar  advantages/ 
disadvantages  and  strengths/weaknesses.  However, 
the  relative  strengths  or  weaknesses  of  the 
advantages  and  disadvantages  depend  upon  the 
degree  of  centralization  and  upon  the  size,  type, 
and  mission  of  the  organization.  In  this  regard 
the  analysis  indicates  that  partial  centraliza¬ 
tion  ts  significantly  preferable  to  total  cen¬ 
tral  i .ation. 

(3)  Status  quo  is  the  most  desirable 
alternative,  with  partial  centralization  being 
nearly  as  desirable  as  status  quo. 

Rationale. 

a.  Tables  1  through  4  of  Exhibit  2  provide 
a  summary  of  the  major  conditions,  advantages, 
and  disadvantages,  of  status  quo  and  each  of 
the  alternatives  as  discussed  in  Chapters  3  and 
4. 

b.  Status  quo  after  total  implementation 
(of  SM,  COCP,  the  ABC  system,  and  of  the  recom¬ 
mendations  of  the  "Dclivered-Unbillcd"  Task 
Force)  would  provide  us  with  approximately  9S\ 
of  customer  demand  fil 1-and-bill  through  the 
CCSS.  Although  we  could  fill  demands  and  bill 
through  the  CCSS,  status  quo  would  not  provide 
total  integrated  centralized  inventory  manage¬ 
ment  nr  a  centralized  data  base  of  all  assigned 
commodities.  Status  quo  was  obviously  the  most 
expeditious  < cans  of  generating  customer  billing 
through  the  CCSS  without  affecting  the  existing 
organizational  structure,  and/or  resolving  the 
disagreement  and  interpretations  of  the  regula¬ 
tory  requirements  of  Centralized  Integrated 
Inventory  Management.  Although  current  inven¬ 
tory  management  of  all  standard  supply  items  is 
decentralized  (in  DRSAR-MM  and  DRSAR-DA] I,  the 
organizational  alignment  allows  for  a  high  degree 
of  inventory  management  special i-iation  in  these 
functional  areas.  Inventory  management  of  non- 
standard  items  is  Jecen'  lized  in  other  dir¬ 
ectorates.  However,  t*  -e  items  are  generally 
peculiar  to  a  particular  organization  or  func¬ 
tion  and  :•  re  not  normally  issued  through  the 
standard  supply  system.  Instead,  these  items 
(APE,  P/.T2,  and  industrial  items  and  components 
of  production)  are  managed  on  an  internal  basis 
by  the  directorate  to  which  the  items  are  pecu¬ 
liar.  That  is,  inventory  management  in  DRSAR-PD. 
DRSAR-MA,  and  DRSAR-QA  is  primarily  an  intcr- 
dlvlsionnl  service  within  theso  directorates  and, 
in  the  case  of  DRSAR-PD,  not  n  separately  iden¬ 
tifiable  function  which  could  be  easily  separated 
our.  Inventory  management  in  DRSAR-QA  and  MA  is 
a  distinct  function,  however.  Having  inventory 
management  internal  to  these  directorates 


(DRSAR-PD,  QA  and  MA)  keeps  lines  of  common  ca¬ 
tion  between  the  inventory  managers  and  other 
personnel  in  the  directorates  as  short  as  pos¬ 
sible.  External  demands  or  interfaces  with 
these  inventory  managers  is  the  exception 
rather  than  the  rule. 

c.  Increased  decentralization  is  not  con¬ 
sidered  to  be  a  reasonable  alternative  because 
this  would  cause  unnecessary  duplications  and 
increase  overall  complexity  of  operations, 
interfaces,  and  lines  of  communications.  Also, 
decentralization  of  responsibility  for  item 
management  was  cited  as  a  possible  root  problem 
addressed  by  the  study  on  Delivered-Unbi 1  led 
Shipment  Deficiencies.  Thus,  to  advocate 
further  dec,.  tralization  is  akin  to  advocating 
exacerbation  of  a  basic  problem,  and  further 
deviation  of  regulatory  requirements  (AR  710-1). 


d.  Total  centralization  would  cause  num¬ 
erous  conflicting  problems  in  operating  a  Com¬ 
modity  Command  NICP  under  Centralized  Integra' cd 
Inventor}-  Management  as  directed  by  AR  710-1, 
and  operating  the  Conventional  Ammunition  Single 
Manager  (NICP)  Concept  as  directed  by  001) 
Directive  S160.65. 

Total  centralization  is  not  practical  due 
to  the  difference  in  Centralized  Inventory 
Management  under  the  Commodity  Command  Concept, 
and  Conventional  Ammunition  Single  Manager  DOD 
concept . 

The  disadvantages  of  total  centralization 
(sec  Chapter  4)  outweigh  the  advantages,  and 
the  alternative  is  not  preferred. 

e.  Partial  centralization  as  described  in 
paragraph  3b(l)(c),  Chapter  4,  would  provide 
centralized  inventory  management  in  accordance 
with  AR  710-1  .ir.u  approved  deviations,  while 
providing  a  standard  centralized  accountable 
system  that  would  provide  the  command  with  a 
tool  to  view  all  materials  to  perform  the  com¬ 
mand's  mission.  However,  this  would  be  diffi¬ 
cult  to  achieve  in  the  near  term  time  frame, 
because  we  do  not  now  have  a  centralized  or  total 
data  base  of  all  items  assigned  to  and/or  man¬ 
aged  by  this  command. 

Partial  centralization  as  described  in  para¬ 
graph  3b  of  Chapter  4  should  provide  improved 
item  management  of  FATE  and  APE  items  because 
this  would  place  inventory  management  respon¬ 
sibility  for  these  items  in  the  areas  with  the 
greatest  materiel  management  expertise.  How¬ 
ever,  there  would  be  some  inconvenience  in 
DRSAR-MA  and  DRSAR-QA  because  of  the  physical 
separation  of  the  inventory  management  functions 
from  the  primary  functional  responsibilities 
Pirtinl  centralization  Kis  considerable  merit  and 
the  advantages  appear  to  oulweig  rhr  disadvan¬ 
tages.  The  overall  advantage  of  *'  alternative 
would  depend  upon: 
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EXHIBIT  1 

ATTRIBUTE  ALTERNATIVE  ANALYSIS 
QUANTIFICATION  C0HPAR1S0U 


Attribute 

Description 

Attribute 

Height 

Furthe~ 
Decentral . 

Status  Quo 
(Current) 

Further 
Central . 

Total 
Central . 

1.2,  or  3 

P.ani 

:/Vt  lue 

Ran* 

/Value 

Rank/Value 

Rank/Value 

1.  Management 
Control 

3 

-1 

-3 

1 

3 

1 

3 

2 

6 

2.  Item 

Control 

3 

-1 

-3 

0 

0 

1 

3  . 

2 

6 

3.  Standard 
Procedures 

3 

-2 

-6 

1 

3 

!  1 

3 

2 

6 

4.  Inventory 
Management 

2 

o 

-c 

-6 

0 

0 

1 

2 

2 

4 

5.  Cost 

2 

-1 

-2 

2 

4 

1 

2 

-2 

-4 

6.  Reorgani¬ 
zation 

2 

-1 

-2 

2 

4 

1 

2 

-2 

-4 

7.  Personnel 

2 

-1 

-2 

1 

2 

1 

2 

1 

2 

8.  Expertise 

2 

2 

4 

1 

2 

0 

0 

-1 

-2 

9.  Turmoil 

2 

-1 

-2 

2 

4 

1 

2 

-2 

-4 

10.  Training 

2 

-1 

-2 

1 

2 

1 

2 

2 

4 

11.  Coordination 

1 

-2 

-2 

0 

0 

1 

1 

2 

2 

12.  Duplications 

1 

-2 

-2 

0 

0 

1 

1 

2 

2 

TOTAL  VALUE 

25 

-28 

<24 

+23 

-+18 

HEIGHT  SCALE 
^'Critical 
2'Important 
l=Pesirable 
0=Hot  Important 


RANXlilG  SCALE 


TOTAL  VALUE  RANGE 


+2=fnhanccs  to  High  Pogrec  {2 WJJ  x  ( *2R) -  +5G  Max. 


+1  ^Enhances  Attribute 
0=Neutral  or  Does  Not 
Possess  Attribute 
-l'Hindcrs  Attribute 
-2=Hinders  to  High  Degree 


(25‘.;)  x  (~2R)  =  -50  Min. 
“Value"  Range'  100 

Points 
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(11  How  cuch  improvement  in  item  man¬ 
agement  of  FATE  and  APE  items  could  be  obtained 
hv  centralization  into  the  NICP.  This  in  turn 
would  depend  upon  the  efficiency  of  the  stan¬ 
dard  NICP  iter  management  procedures/systems 
applied  to  the  items.  Simply  transferring  the 
functions  and/or  personnel  with  no  change  in 
current  procedures,  clearly,  would  provide 
little  improvement  or  advantage. 

(2)  How  much  DRSAR-MA  and  DRSAR-QA 
would  be  inconvenienced  by  the  physical  separa¬ 
tion  of  their  inventory  managers.  This  would 
depend  upon  how  much  coordination  with  the  NICP 
personnel  would  be  required,  etc. 

(31  How  much  cost  would  be  involved  in 
entering  these  low-demand  items  in  the  NSNMDR 
and  carrying  th;-'-  in  the  "inventory." 

f.  Regardless  of  the  comparative  advantages 
;nd  disadvantages  of  centralization  as  discussed 
in  this  study,  consideration  must  be  given  to 
the  Department  of  Army  decision  that  Commodity 
Commands  would  organize  and  manage  assigned  com¬ 
modities  within  an  NICP  structure  and  utilizing 
centralized  integrated  inventory  management 
(AR  710-1).  The  following  must  also  be  con¬ 
sidered: 

(1)  ARRCOM  Supplement  1  (dated 
16  October  197S)  to  DARCOMH  702-2  (dated 
27  May  1966),  Inspection  Equipment  Design, 

Supply  and  Maintenance;  which  provides  for 
DRSAR-QA  and  PRSAIi-MA  inventory  management  of 

I  ATE.  and  APF.  items  external  to  the  NICP.  This 
appears  to  conflict  with  requirements  of  A°. 

710-1  fdated  29  August  1975),  Centralized 
Integrated  Inventory  Management. 

(2)  The  implementation  of  DOD  Directive 
7)160.65,  Single  .Manager  for  Conventional  Anmuni- 
tius-.  which  established  DRSAR-OA  as  a  second 
NICP  HQ,  ARRCOM;  i.e.,  separate  from  the 
existing  DRSAR-SSI  NICP. 

Summary. 

a.  The  advantages  and  disadvantages  of 
centralization  versus  decentralization  depend 
upon  the  size  and  function  of  an  organization 
and  how  it  is  to  be  centralized  or  decentralized 
(c.g.,  by  function,  by  it  /product  line,  by 
geographic  or  physical  .it ion,  by  customer 
served,  etc.). 

b.  Neither  extreme,  further  decentraliza¬ 
tion  nor  total  centralization,  is  practical. 

e.  The  present  (Status  Quo)  organizational 
structure  of  HQ,  ARRCCM  provides  many  advantages 
over  the  two  extreme  alternatives  (A  and  B-l) 
considered,  and  apparently  works  well  the 
majority  oi  the  tine.  Status  quo  assumes  full 
implementation  nf-SM,  of  the  COCP  and  ABS  system, 
and  of  "he  "Delivcrcd-Hnbilled"  study  recoemenda¬ 
tions;  and  rates  highest  for  the  near  term. 


d.  Partial  centralization  (Alternative 
B-2)  involving  FATE,  APE,  and  those  industrial 
components  of  production  which  are  supplied  to 
customers,  would  satisfy  regulatory  requirements 
(AR  710-1)  for  Centralized  Inventory  Managesc-r 
This  alternative  compares  favorably  with  status 
quo,  and  rates  highest  as  a  potential  goal  for 
the  longer  term. 
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EXHIBIT  2 

SUMMARY  OP  ALTERNATIVES 


TABLE  lb 


SUMMARY  Or  "STATUS  QUO” 

ADVANTAGES 

-  CCSS  for  oulk  of  issue  items,  and  standard 
U  components.  (NSNMDR  Items) 

-  Promotes  individual  item  expertise. 

-  Responsibility  keyed  to  specialization  by 
functional  use  and  items. 

-  Minimal  retraining  required  in  NICP's. 

-  Minimum  personnel  turbulence. 

-  Minimum  reoi’ganization. 

-  Minimum  procedural  revisions. 

-  Minimum  cost  impacts. 

-  Balance  of  internal  and  external  lines  of 
communications. 

DISADVANTAGES 

-  IL  performing  sore  "IM's"  functions. 

-  PD  performing  so:i .e  "IM's"  functions. 

-  Coni roi  r -'obleras : 

■interna*  coordinations. 

■  Non-standard  accountability . 

■  System-reject  distribution. 

-  Training  required  for  CCSS  users  outside  of 
iiicr's. 

-  Multi  off-line  procedures. 

-  Retains  some  duplication. 


TABLE  2b 

SUMMARY  OF  "FURTHER  DECENTRALIZATION" 
ADVANTAGES 

-  Maximum  functional  specialization  by  category 
of  items  (micro  efficiency). 

-  Less  levels  of  management. 

-  Procedures  customized  to  missions. 

-  Individual  responsibilities  most  identifiable. 

-  Shortest  external  lives  of  communication 
(with  customers). 

DISADVANTAGES 

-  Maximum  continuing  training  requirement. 

-  Most  complex  internal  communications 
(within  HQ  organization). 

-  Potential  increase  in  duplication  (admin¬ 
istration  4  supei-vision;  MCN/NSN  item 
assignments ) . 

-  Management  control  reduced. 

-  Reduces  uniformity  of  policies. 

-  Multi  off-line  procedures. 

-  Minimum  standardisation  iof  procedures, 
syst.-m,  etc.). 

-  Contrary  t ■»  regulations  on  integrated 
commodity  management. 

-  Control  problems: 

•Non-standard  accountability. 

■System-reject  distribution. 

-  IM  functions  in  many  Directorates. 


-  Minimum  automated  item  control. 

-  Possible  increase  in  personnel  requirements. 


TABLE  3b 


SU121ARY  OF  "TOTAL  CENTRALIZATION" 
ADVANTAGES 

-  Maximum  utilization  of  CCSS/ADP. 

-  Consistency  of  procedures. 

-  Unity  of  control/pollcies. 

-  Eiiat nation  of  duplication. 

-  Maximum  cross-fertilization  for  IM's. 

-  Shortest  internal  lines  of  communications. 

-  Least  overall  training  required. 

-  Improves  regulatory  compliance  for  integ' ated 
inventory  management. 

DISADVANTAGES 

-  Maximum  t ■>'•-■' il  (personnel). 

-  Maximum  leorgonization. 

-  Maximum  cost  to  implement. 

-  Maximum  retraining  (NICP’s). 

-  Contrary  to  SM  concept  with  establishment 
of  DRSAR-DA). 

-  Reduces  "specialization"  (re:items). 

-  Magnitude  unvieldly,  blocks  control. 

-  Management  "Layering"/Increase . 

-  Longest  external  lines  oi  communication. 

-  Possible  increase  in  personnel  requirements. 


TABLE  Lb 


SUMMARY  OF  "PARTIAL  CENTRALIZATION" 
ADVANTAGES 

-  Reduce  duplication. 

-  More  standardization  of  procedures. 

-  Le3S  fragmentation  of  IM’s. 

-  Reduce  CCSS  training. 

-  Reduce  overall  (internal/external)  lines  of 
communications . 

-  Increase  utilization  of  CCSS/ALr. 

-  Improve  unity  of  control/procedures . 

-  Minimal  reorganization. 

-  Minimal  cost  impacts. 

-  Minimal  personnel  turbulence. 

DISADVANTAGES 

-  Reduce  specia.lize.tlon  (Re: items). 

-  PD  performing  some  "IM’s"  functions. 

-  Some  CCSS/IM  training  required  outside  of 
NICP’s. 

-  Possible  increase  in  personnel  requirements. 

-  Retains  some  duplication. 

-  Control  problem:  System-reject  distribution. 
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CONCLUSIONS  AND  RECOMMENDATIONS 


I )j scussicn  of  Conclusions. 

a .  General. 

( 1 )  Centralization  (e.g..  of  inventory 
maniiri>'>ient  functions,  and  the  performing  per¬ 
sonnel  )  ot—vides  the  opportunity  to  standard¬ 
ize  procedures,  to  improve  efficiency  by  in¬ 
creased  use  of  ADP  systems,  to  maintain 
central  control,  and  to  provide  management 
with  a  centralized  asset  and  requirement  pos- 
;ure  within  an  acceptable  time  frame. 

(21  Some  degree  of  centralization  is  re¬ 
quired;  e.g. ,  for  inventories  to  be  controlled 
at  the  national  (NICP)  level. 

(3)  Decentralization  by  delegation  of 
authority  to  lower  levels  allows  procedures  and 
/or  systems  to  be  customized  to  the  needs  of 
each  organizational  element  and  may  shorten 
supply  and/or  communication  lines  for  day-to- 
lay  operations,  3ince  management  decisions 
would  be  made  at  lower  levels.  Decentraliza¬ 
tion  also  fosters  the  maintenance  of  organiza¬ 
tionally  unique,  local  Inventory  records  wit!. in 
each  organization  for  maximum  accessabillty  at 
the  lower  levels. 

(i|)  Some  degree  of  decentralization  may  be 
required  to  prevent  organizations  from  becoming 
too  largo  to  be  managed  effectively. 

(5)  Neither  total  centralization  nor  total 
decentralization  is  workable  except  in  rare 
situations.  A  "mix"  is  usually  best. 

b.  In  Terms  of  HQ,  ARRCOH  Structure. 

(1)  The  current  structure  of  HQ,  ARRCOM 
for  inventory  management  i3  a  combination  of 
centralized  and  decentralized  organization. 

(a)  Weapons,  secondary  items  and  related 
packaging  materiels  are  managed  (centralized) 
in  DRSAR-MM,  an  NICE,  under  formal  integrated 
inventory  management  procedures. 

(b)  Ammunition  end  items  and  related  pack¬ 
aging  materiels  are  managed  centralized)  in 
DRSAR-DA,  an  NICP,  under  f>  mal  integrated  in¬ 
ventory  management  procedures. 

(c)  APE  ltem3  are  managed  (centralized)  in 
DRSAR-MA  by  a  stand-alone  system  outside  of  the 
NICP'o;  but  under  Status  Quo  (fully  Implemented) 
DRSAR-MA  will  formally  inventory  manage  those 
items  for  which  customer  demands  are  received, 
and  process  the  demands  through  the  CCSS. 

(d)  FATE  items  are  managed  (centralized) 
in  DRSAR-QA  by  another  stand-alone  system  out 

'of  the  NICP’s;  but  under  Status  Quo  (fully 
implemented)  DRSAR-QA  will  formally  inventor*, 
manage  those  iten.3  for  which  customer  demands 


are  received,  and  process  the  demands  through 
the  CCSS. 

(e)  Industrial  materials  and  components 
for  production  are  managed  (centralized)  tn 
DRSAR-PD  outside  of  the  NICP’ 3.  This  is  pro¬ 
duction  management,  and  nut  Integrated  irven- 
fory  manage most  per  so. 

(f)  Tne  composite  is  decentralization 

(2)  If  assigned  commodities  are  inventory 
managed  outside  of  the  NICP,  or  a  commodity 
'•iramand  has  more  than  one  NICP,  integrated 
materiel  inventory  management,  per  se,  is  de- 
centi.iliz-’rt.  (This  is  not  to  be  confused  with 
centralized  versus  decentralized  methods  of  In¬ 
tegrated  Inventory  Management  to  be  employed  by 
the  NICP’s  for  each  individual  item  of  assigned 
commodities,  i.e.,  the  option  of  authoring 
local  procurements  on  NICP  item3.) 

(3)  In  !!Q ,  ARRCOM  only  DRSAR-MM,  DA,  QA, 
ar.d  MA  have  assigned  personnel  performing  for¬ 
mal  Integrated  inventory  management  as  their 
primary  job.  All  others  have  other  primary 
missions/functions ,  and  any  functions  performed 
which  zre  related  or  similar  to  integrated  in¬ 
ventory  management  (NICP)  functions  are  only 
secondary  and  in  support  of  accomplishment  of 
their  primary  responsibilities. 

(a)  APE  and  FATE  items  are  procured, 
stocked,  stored  and  issued,  through  the  logis¬ 
tics  supply  system,  to  Proving  Grounds,  Indus¬ 
trial  Plants  (GCGO,  COCO,  and  Commercial), 

Depots,  FMS  and  MIPR’s;  though  not  in  accord¬ 
ance  with  Integrated  Inventory  Management/ CCSS 
procedures. 

(b)  Under  Status  Quo,  DESAR-Il.  might  also 
continue  to  "inventory  manage"  some  items  and 
process  them  through  the  CCSS.  Normally,  these 
are  items  that  DFSAR-IL  had  agreed  to  supply  on 
FMS  cases,  but  for  which  an  existing  inventory 
manager  could  not  be  located  elsewhere  in  the 
Command.  Under  some  conditions  the  Command  has 
been  directed  by  higher  headquarters  to  supply 
FMS  case  Items  not  managed  by  this  Command. 

(c)  Industrial  material  and  components  are 
production  managed  by  DRSAR-PD  and,  to  some 
degree,  some  of  the  elements  of  Integrated  in¬ 
ventory  management  are  applied.  DRSAR-PD  has 
recorded  in  the  NSNM.DP  approximately  1,000  of 
the  approximately  10,000  industrial  components 
and  materials  utilized  in  the  production  of 
commodities  (ammunition  and  weapons)  assigned 
to  this  Command.  These  item3  are  not  normally 
issuable  items  or  assigned  an  MSN  or  MCN,  and 
are  managed  through  production.  The  assets  are 
not  picked  up  in  the  Niffs  accounts.  These 
items  are  not  to  be  oonfusod  with  weapons  re¬ 
pair  parts,  ammunition  maintenance  i'  ms  or 
ammunition  industrial  components  that  ....  re! 
items  within  themself  (l.e.,  fuzes).  These 
later  items  are  managed  by  the  NICP‘3.  The 
Industrial  conporents  now  being  loaded  In  the 


N.'THl  I  by  IRSAI-PD  arc  not  be.ng  loaded  lor  in¬ 
ti  ntory  I’lirpt  ses,  but  are  requited  to  properly 
generate  PWD's  from  the  CCSS  lr.  support  of  the 
production  management  cycle.  Also,  under 
status  >iuo.  DRSAR-PD  will  inventory  manage 
those  industrial  components  for  which  customer 
demand,  are  received,  and  process  the  demands 
through  tbe  CCSS. 

(il)  Such  drastic  measures  as  abolishing 
directorates  and  creating  new  ones  is  neither 
necessary  nor  desirable.  The  positive  effects 
(advantages)  cf  total  centralization  could  be 
approximated  simply  by  moving  all  formal 
inventory  management  functions  to  DRSAfi-MM  and 
DFSAR-DA.  Total  centralization  (i.e.,  merging 
all  inventory  management  into  a  single  NICP)  is 
impractical  due  to  differences  in  accounting 
end  processing  for  centralized  inventory  man¬ 
agement  under  the  commodity  command  concept 
(AR  710-1),  and  for  Single  Manager  conventional 
ammunition  under  the  DOD  concept  (DOD  Dir. 
5160.65).  DRSAR-DA  need  not  be  re-merged  with 
DRSAR-MM,  and  the  continued  separation  provides 
a  means  of  effectively  implementing  DOD  Dir. 
5160.65  (SH).  Also,  although  DRSAR-PD  has 
"Production  Managers",  they  are  pei  forming  only 
a  portion  of  the  inventory  management  functions 
on  a  part-time  basis,  in  support  of  the  pro¬ 
duction  mission,  and  integral  to  their  other 
responsibilities.  These  personnel  should  not 
transfer  to  the  NICP's,  and  production  indus¬ 
trial  materials  should  not  be  managed  in  the 
NICP  unless  the  item  is  sold  or  supply  issued. 

(5)  Movement  of  item  management  functions 
from  DRSAR-PD  to  an  NICP  organization  would 
provide  no  significant  benefit  because  other 
organizations  generally  do  not  require  access 
to  their  production  inventory  management  data, 
and  the  production  components  and  materials 
arc  not  normally  sold  outside  the  command. 
Additionally,  this  would  physically  separate 
the  production  inventory  data  from  the  people 
who  are  normally  the  only  or.c-s  who  need  access 
to  it,  and  would  increase  tho  workload  in  the 
NICP  organizations.  Industrial  components  are 
not  procured,  stocked  and  stored  for  issue 
through  the  logistical  supply  system,  although 
DRSAPi-PD  does  procure  and  Issue  for  FMS  and 
MIPR's  on  request.  Industrial  components  are 
normally  procured  for  the  production  of  end 
items,  and  are  picked-up  or  the  Production  In¬ 
dustrial  Accounting  System  and  not  stocked  for 
issues  through  the  logistical  supply  system. 

(6)  DRSAR-PD  manages  tho  procurement 
execution  and  production  of  end  items;  and  this 
involves  components  breakout  (requirements  de¬ 
termination  for  production),  procurement  execu¬ 
tion/production  direction  for  components  and 
industrial  supplies,  and  some  form  of  stock 
control  or  scheduling  to  insure  that  these 
components  and  supplies  are  available  at  the 
right  place,  at  the  right  time,  and  in  the 
right  quantities  for  UP  or  final  assembly. 
However,  this  is  not  "inventory  management"  in 
the  same  sense  a3  Inventory  management  i3  per¬ 


formed  in  an  NICP.  Formal  Inventory  manage¬ 
ment  in  an  NICP  involves  full  performance  of 
the  six  elements  of  integrated  Inventory 
management  within  regulatory  requirements,  ar.d 
includes  worldwide  assets  knowledge  and 
accountability  of  field-issuable  items  from 
the  field  issue  account.  Production  inventory 
management  or  stock  control  in  DRSAR-PD,  cn 
the  other  hand,  involves  ptocuremcnt  execution 
to  provide  Industrial  materials  and  components 
needed  to  meet  authorized  production  sched¬ 
ules.  The  inventory  accountability  of  produc¬ 
tion  stocks  is  '  ‘  and  by  the  production  facu¬ 
lty.  Tli at  is,  DRSAR-PD  primarily  provides  a 
production/procurement  execution  function, 
not  a  stock,  store  and  supply  operation. 

Once  items  aro  assembled  and  accepted  into  the 
field  service  inventory,  then  an  NICP  inventory 
manager  becomes  responsible,  and  PRSAR-PD  is 
no  longer  directly  Involved.  Thus,  moving  the 
inventory  management  of  industrial  components 
and  supplies  to  an  NICP  would  serve  no  useful 
purpose  and,  In  fact,  would  be  a  hlnderance. 

(7)  Under  either  Status  Quo  or  Partial 
Centralization,  if  the  Command  makes  a  deci¬ 
sion  to  supply  industrial  components  to  cus¬ 
tomers  (through  the  NICP's),  it  should  be  the 
responsibility  or  the  NICP  to  Inventory  manage 
the  item  in  the  NICP  account,  including  cata¬ 
loging  and  recording  the  item  in  the  HSNMDR  if 
it  has  not  been  previously  recorded.  If  it 
has  been  recorded,  it  should  be  tho  NIPC's 
responsibility  for  recording  the  proper  NICP 
Inventory  manager  in  the  NSNMDR  analyst  code 
(ANAL-CD)  sector. 

(8)  To  differentiate  between  normal 
supply  items  and  industrial  components  in  the 
NSNKDR/CCSS,  there  shculd  be  a  method/pro¬ 
cedure  provided  to  identify  industrial  com¬ 
ponents;  and  whether  it  is  production  managed 
only  or  if  it  is  also  being  inventory  managed 
by  the  NICP's.  This  could  be  accomplished  by 
utilizing  a  one  (1)  position  code  in  the  ALFU 
portion  (la3t  5  positions)  of  Sector-00  of  the 
NSNMDR . 

(9)  Orders  for  non -standard,  r.on-NICP 
items  through  FMS  3nd  MIPR  are  not  efficently 
processed.  The  cause  of  this  problem  is 
basically: 

(a)  These  items  are  not  recorded  in  the 
NSNMDR  and  therefore  will  not  process  through 
the  CCSS.  Thus,  they  must  first  be  loaded  to 
the  data  base  with  an  MCN  (causing  a  delay  of 
up  to  two  weeks),  or  processed  off-line. 

(b)  There  is  a  general  lack  of  training, 
experience,  and  SOP's  for  sales  of  non-stand¬ 
ard  items.  Also,  there  is  a  general  lack  of 
knowledge  in  Interface  areas;  e. g. ,  CCSS, 
cataloging,  etc.. 
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Summary  of  Conclusions. 


Impacts. 


a.  Further  decentralization  is  not  a  via¬ 
ble  alternative  because  it  would  result  in 
increased  personnel  costs  and  reduced  controls. 
Also,  decentralization  of  responsibility  was  a 
root  nvoh i om  syJdrvsscd  by  the  "Delivered- 
Unbilled"  Task  Force  study.  Thus,  to  advocate 
for  the  decentralization  is  akin  to  advocating 
exacerbation  of  the  basic  problem,  and  con¬ 
flicts  with  regulatory  requirements  for  inte¬ 
grated  inventory  management  of  logistics  supply 
items  (Alt  710-1). 

b.  Full  centralization  would  result  in 
maximum  turmoil  in  organization,  personnel  and 
cost,  and  la  contrary  t.o  current  DOD  concepts 
w.iich  resulted  m  establishment  of  DRSAR-DA  to 
„u| purl  SM  1 equirements.  Total  Centralization  la 
not  corsiderti  to  be  a  viable  alternative. 

c.  It  appears  that  the  present  organiza¬ 
tion  benefits  from  both  centralized  inventory 
management  of  thoae  standard  items  which  re¬ 
quire  central  NJCP  control  and  from  the  decen¬ 
tralization  (physical  dispersion  into  function¬ 
al  areas)  of  some  personnel  performing  some 
inventory  management  functions  for  the  manage¬ 
ment  of  Industrial  irateriels,  tools-of-the- 
tradc  used  in  production,  and  related  support 
items . 

d.  As  Indicated  in  Chapter  5,  continua¬ 
tion  of  the  current  (Status  Quo)  ARRCOM  organ¬ 
ization  for  Inventory  management  is  the  most 
viable  near-term  alternative.  It  Is  noted 
that  the  concept  of  this  alternative  assumes 
total  implementation  of  the  approved  recommen¬ 
dations  of  the  "Delivered-Unbilleri  Shipments 
Deficiencies"  study.  This  has  not  occurred  as 
yet.  The  concept  also  assumes  full  implemen¬ 
ts'  iou  c>  COCP,  the  ADC  system,  and  SM 
(DPSAR-PA) .  When  fully  Implemented,  the  cur¬ 
rent  alignment  will  provide  an  estimated  951 
of  oem.ind  f  111-and-bill  through  the  CCSS.  It 
wi’l  not  provide  for  centralized  accountabil¬ 
ity  or  a  centralized  data  base  of  all  Items 
assigned  this  Command  to  inventory  manage 
through  the  IIICP's. 

e.  Partial  Centralized  Inventory  Manage¬ 
ment,  as  described  in  Chapter  4  paragraph  3b 
(l)(e)  and  required  >  AR  710-1  (with  approved 
deviations),  has  hi,  potential  for  the  long 
term.  Although  Partial  Centralization  might 
be  our  goal,  we  3hould  continue  under  the  cur¬ 
rent  alignment  until  inventory  managers  could 
be  properly  trained  or  replaced  to  perform  'he 
requirements.  At  the  present  there  should  be 
a  continuous  exerted  effort  to  get  all  "de¬ 
mand"  items  assigned  an  MCN  and  recorded  in 
the  NSUMDR.  This  would  minimize  subsequent 
transition  efforts  for  moving  all  supply/issu¬ 
ance  Items  urder  the  control  of  the  NICP's. 


a.  Facilities  requirements  wi 11  not  sign; i 
cantly  change  under  any  alternative  and,  then  - 
Fore,  are  not  an  impact  factor. 

b.  Overaii  Hv,  ahixuii  personnel  requir  - 
ments  and  average  grade  will  not  signlfiean  , 
change  ns  a  result  of  any  alternative. 

c.  Personnel  actions  (transfers)  asr ecla¬ 
ted  with  either  of  the  preferred  alternative^, 
i.e.,  continuation  of  current  alignment  or  par¬ 
tial  centralization,  are  not  significant  (esti¬ 
mated  at  approximately  5  spaces). 

d.  Trainlr.g  requirements  associated  wiU 
either  of  the  oreferrea  alternatives  (l.o., 
Current  Alignment  and  Far  Mai  Centralization! 
are  commensurate  with  those  renuired  under  *n- 
plementatlon  of  the  recommendations  of  the 
"Delivered-Unbilled"  Task  Force. 

e.  Although  cost  impacts  were  Indetermin¬ 
ate,  the  two  preferred  alternatives  should  be 
approximately  equal  to  each  other  nr.d  signifi¬ 
cantly  less  than  either  of  the  extremes  (i.e., 
Total  Centralization  or  Total  Decentraliza¬ 
tion).  Loading  and  maintaining  additloia) 
items  in  the  NSHMDR,  and  training  in  C(  ■ 
oedures  will  be  the  two  most  significant  cost 
Impacts. 

Recommendations,  a.  Retain  present  HO, 

ARRCOM  organizational  structure  overall,  spec¬ 
ifically  continuing  current  alignment  for  mat¬ 
erial  management. 

b.  Transfer  DRSAR-PD  industrial  compon¬ 
ents  to  DRSAR-MM  and  DRSAR-DA,  as  appropriate, 
only  for  management  of  sales/demands  or  a;  re¬ 
quired  for  Renovation. 

c.  Retain  management  of  DRSAR-PD  indus¬ 
trial  components  in  DRSAR-PD  for  all  "Produc¬ 
tion"  inventories. 

d.  Assign  NICP  inventory  managers  to 
manage  any  FATE  or  APE  items  and  Industrial 
components  supplied  through  the  NICP's. 

e.  Record,  with  MCN/NSN,  all  FATF.  and  APb 
items  Into  the  NSUMDR,  including  appropriate 
storage  locations  data,  as  "demands"  are  re¬ 
ceived. 

(1)  Initiate  action  to  correct,  with  the 
assigned  MCN/NSN,  any  records  outside  of  the 
Command,  (e.g.,  TM's,  suppAy  bulletins,  etc.). 

(2)  Establish  regulatory  loan  procedures 
for  FATE  and  APE  ltem3  or.  loan  and  returnab’- 
with  accountability  through  CCSS. 
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f.  DRSAR-IL  should  under  no  circumstances 
he  recorded  or  act  as  Inventory  Manager  for  any 
item  (no  MCN/NSN  actions  by  DRSAR-IL). 


(1)  DRSAR-II.  should  "clear"  themselves 
of  all  previously  "loaded"  (approximately  300) 
item  responsibility,  transferring  all  items  to 
DRSAR-MM  and  DRSAR-DA  as  appropriate. 


(2)  DRSAR-IL  should  henceforth  offer/ 
accept  and  handle,  in  cases,  only  items  assigned 
to  this  command,  unless  specifically  directed  by 
higher  headquarters,  and  then  process  these 
"non-ARRCOM-assigned"  items  manually  off-line. 


g.  Standard  procedures  should  be  developed 
for  all  item  managers  regardless  of  location 
throughout  the  Command. 


(1)  CCSS  procedures,  when  applicable, 
must  be  adhered  to. 


(2)  Very  specific  standard  procedures 
should  be  developed  for  non-standard  items, 
especially  those  which  do  not  have  NSN's  or 
MCN's,  which  are  being  sold  through  DRSAR-II. 
and  MIPR's. 


(3)  Establish  and  enforce  standard  pro¬ 
cedures  for  all  "off-line"  (manual  and  non-CCSS) 
transactions. 


(4)  Process  all  "non-standard  items 
off-line  unless  the  item  has  been  assigned  an 
MCN/NSN  and  properly  loaded  to  the  NSNMOR. 


(S)  Provide  guidance,  procedures,  and 
training  of  all  item  managers  for  processing 
sales  transactions,  especially  for  managers  of 
non-standard  items. 


(6)  All  formal  item  cataloging  should 
be  accomplished  by  either  DRSAR-MM  or  DRSAR-DA, 
as  appropriate,  in  coordination  with  DRSAR-MA 
(for  initiation  and  approval  of  DRSAR  form  19 's 
when  required) . 


(7)  All  MCN  assignments  should  be  clear¬ 
ed  through,  and  all  new  NSN's  should  be  requested 
by,  DRSAR-MM  in  coordination  with  DRSAR-MA. 


h.  No  customer  demand  (Army  external) 
orders  will  be  processed  for  any  item  for  which 
ARRCOM  is  not  or  cannot  be  assigned  as  PICA,  or 
unless  ARRCOM  is  the  SICA  and  has  received  for¬ 
mal  procuring  authority  for  the  item. 


(1)  Cease  customer  order  acceptance, 
procurement,  and  sales  of  items  not  assigned  to 
ARRCOM,  unless  specifically  directed  by  higher 
authority;  and  then  process  these  items  manually 
off-line  when  acceptance  is  directed.  Specifical¬ 
ly  cease  all  salos/management  of  other  PICA's 
items. 


(2)  A  thorough  screening  through  DLSC 
should  be  accomplished  on  all  items  for  FMS 


cases  and  MIPR's  to  insure  that  this  Cc.nmand 
is  not  buying,  for  resale,  items  which  are 
managed  (as  PICA)  by  another  Command. 


i.  Clarification  of  AR  710-1  should  be 
obtained  in  the  question  of  the  application 
of  formal  Integrated  Inventory  Management 
(NICP)  to  "industrial"  items. 


j.  Fully  implement  the  approved  recommen¬ 
dations  of  the  study  on  "Delivered-Unbillcd 
Shipments  Deficiencies,"  including  full  imple¬ 
mentation  of  the  COCP. 


k.  Partial  centralization,  as  described  in 
paragraph  3b(l)(e),  Chapter  4,  should  be  con¬ 
sidered  for  separate  future  study  subsequent  to 
"fully  implemented"  actions  under  current  align¬ 
ment.  This  future  study,  if  performed,  should 
specifically  address: 


(1)  Transfer  of  personnel  and  items 
into  the  appropriate  NICP  to  bring  all  formal 
inventory  management  into  the  CCSS  and  NICP 
Centralized  Inventory  Management  environment. 


(a)  Transfer  DRSAR-MA’s  APE 
Inventory  Management  (items  and  personnel)  to 
DRSAR-DA. 


(b)  Transfer  DRSAR-QA's  FATE 
Inventory  Management  (items  and  personnel)  to 
DRSAR-MM  and  DRSAR-DA  as  appropriate. 


(2)  Definitive  evaluation  of  staffing 
requirements  for  DRSAR-MM  and  DRSAR-DA. 
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EXHIBIT  3 


SUMMARY  OP  LITERATURE  REVIEW 


Summary  of  Literary  Review  Conducted  Concerning 
the  Relative  Advantages  and  Disadvantages  of 
Centralization  and  Deccntralization(l) . 

PROBLEM:  lo  determine  the  relative  advantages 
and  disadvantages  of  centralization  and  decen¬ 
tralization  in  organizations  similar  to  HQ, 
AI’.RCOM. 

DISCUSSION: 

1.  'Hie  literature  listed  at  TAB  A  was 
reviewed  for  discussion  of  the  above  subject. 

2.  Hie  overall  management  organization  for 
industry  was  basically  divided  into  three 
categories: 

(a)  Line-organization  or  centralized. 

In  this  organization  the  line  of  authority 
passes  directly  from  the  boss  to  the  -arious 
subordinate  executives  of  various  activities 
to  the  lowest  level.  The  flow  of  the  instruc¬ 
tion  or  authority  can  be  traced,  unbroken,  from 
the  lowest  level  to  the  boss.  This  is  used  in 
small  businesses. 

(b)  Functional  organization  or  decen¬ 
tralized.  Managerial  activities  are  divided  so 
that  each  head,  from  the  assistant  superinten¬ 
dent  on  down,  has  as  few  functions  as  possible 
and  is  able  to  become  a  specialist  in  these. 
Authority  from  top  on  down  is  delegated  accord¬ 
ing  to  functions.  'Pie  worker  level  takos  orders 
from  several  supervisors  in  regard  to  the  par¬ 
ticular  function  over  which  the  supervisor  has 
control . 

(c)  Line-staff  organization  or  partial 
decentralization.  Functional  staff  departments 
are  established  to  advise,  servo,  and  work 
through  line  foremen  as  well  as  the  organiza¬ 
tion.  Ihe  line  of  authority  flows  through  the 
staff  from  top  to  bottom;  however,  this  is  clear 
cut  and  undivided  delegation  of  authority.  This 
is  the  overall  organization  of  HQ,  ARRCOM. 

3.  'Pie  organization  '  the  staff  section  is 
further  classified  as  ci  tralized  and  decen¬ 
tralized  by  function. 

4.  In  the  simplest  sense  of  centralization, 
only  one  staff  will  perform  a  given  function 
such  as  research,  inventory,  «.c..  This  staff 
may  he  subdivided  by  project  oi  speciality  field; 
however,  all  these  functions  for  the  organization 
will  be  in  one  staff  agency. 

5.  In  the  simplest  form  of  decentralization, 
ouch  staff  agency  will  perforin  all  functions  us 
thev  pertain  to  the  overall  activity  of  that 
staff  agency.  This  more  closely  fits  the  current 


organization  of  this  headquarters,  i.e.,  func¬ 
tional  directorates . 

6.  There  exists  a  disparity  on  terms  unorg 
the  texts  on  the  terms  centralization/dece itra- 
lization  in  that  centralization  of  functions  is 
decentralization  of  management  and  decentraliza¬ 
tion  of  functions  can  be  centralization  of 
activities.  This  was  resolved  in  context  of 
the  study.  The  study  group  charter  dealt  with 
ce^rralization/decentralization  of  item/inven¬ 
tory  management  or  functions,  thus  only  those 
items  relative  to  centralization  or  decentrali¬ 
zation  of  functions  were  considered.  The 
delegated  authority  to  accomplish  the  function 
is  considered  inherent  with  the  function. 

7.  The  degree  of  centralization  can  and 
usually  does  vary  within  industry  depending 
upon  objectives  of  the  company,  its  size,  etc. 

An  example  often  cited  was  the  accounting  sec¬ 
tion,  which  is  usually  centralized  regardless 
of  the  decentralization  of  the  rest  of  the 
functions . 

8.  Most  authors  dismissed  the  extremes  of 
centralization/decentralization  summarily  as 
unworkable  in  all  but  rare  cases.  The  exception 
being  total  centralization  of  functions  within 
small  businesses. 

9.  The  basic  advantages  listed  for  cen¬ 
tralization  were  as  follows: 

..  Duplication  of  functions  is  minimized 
or  eliminated,  since  all  like-type  functions  <u 
centralized,  and  generally  on’y  one  agency  or 
staff  section  performs  a  given  function. 

b.  Performance  or  non-performance  of 
duties  is  easily  traced.  Only  one  section  per¬ 
forms  a  function,  thus  the  results  are  readily 
identified. 

c.  System  discipline  (ADP  or  manual ) 
is  easily  maintained.  One  supervisor  insures 
consistency  of  operation. 

d.  'Piero  is  unity  of  control  over  a 
function.  There  arc  no  overlapping  responsi¬ 
bilities. 

c.  Fastest  overall  reaction  to  a  given 
problem.  Since  only  one  staff  agency  has  to 
react  tc  a  functional  area,  the  time  lost  in 
coordination  is  eliminated.  The  priority  of  a 
project  is  consistent  in  the  staff. 

f.  Most  efficient  use  o(  'ur  capability 
llie  computer  summarizes  and  work-.  . ->g  i  batches 
of  data  and  preparos  fewer  reports.  Less  inter¬ 
nal  routing  and  less  print  time. 


548 


g.  The  volume  justifies  hiring  spe¬ 
cialists  at  the  higher  level  of  staff  functions, 
but  allows  the  hiring  of  less  specialized  per¬ 
sonnel  at  lower  levels  as  they  have  the  guidance 
and  constant  supervision  of  a  specialist. 


h.  More  talented  personnel  are  easily 
identified  as  neir  contribution  to  the  overall 
effort  is  easily  identified. 


10.  The  disadvantages  to  centralization 
were  as  follows: 


a.  There  is  a  lack  of  specialization 
at  the  lower  levels  as  each  staff  element  must 
perform  the  same  function  on  a  wide  variety  of 
conditions. 


b.  It  is  difficult  to  place  equal 
emphasis  on  several  projects.  There  is  a  ten¬ 
dency  to  rank  projects  within  a  single  agency. 


c.  Managers  are  overladen  with  matters 
that  require  their  personal  attention.  All 
inquiries  come  to  a  single  agency  and  must  be 
reacted  to  individually. 


d.  Managerial  ability  is  not  as  well 
developed  at  lower  levels.  Since  direction  is 
unified  in  a  staff  section,  the  capability  of 
lower  managers  is  overshadowed  by  that  of  the 
staff  chief. 


e.  Limited  depth  of  operation.  The 
loss  or  absence  of  an  individual  can  have  a 
broader  effect  in  the  organization. 


f.  Greater  development  of  bureaucracy. 
A  centralized  staff  tends  to  develop  layers  of 
managers  due  to  its  sheer  size. 


g.  Docs  not  fully  utilize  the  capabil¬ 
ities  of  ADP  equipment.  Computers  are  capable 
of  sorting  and  manipulating  data  into  small 
specialized  areas.  This  capability  is  not  nor¬ 
mally  utilized  in  centralized  staff  agencies. 


11.  The  basic  advantages  listed  of  decen¬ 
tralization  were  as  follows: 


a.  Allows  for  more  specialization  at 
the  lower  levels.  Since  each  staff  section 
porforms  a  function  as  it  relates  to  their  area 
of  responsibility,  specialization  can  develop. 


b.  Managers  develop  broader  abilities 
as  they  manage  several  functions. 


projects. 


c.  Equal  priority  can  be  given  multiple 


d.  Managers  have  more  first-hand  know¬ 
ledge  of  problems.  Minor  problems  are  easier 
to  identify  as  the  staff  agency  has  a  function 
only  as  it  applies  to  the, a. 


e.  Greater  probability  of  innovation  pro¬ 
cedure  being  developed.  There  procedures  can 


be  dovelopeu  and  debugged  in  one  staff  agency 
prior  to  full  implementation  agency  wide. 


f.  The  organization  is  better  able  to 
adapt  to  the  absence  of  an  individual. 


g.  Decisions  are  placed  at  a  lower 
level  closer  to  the  situation. 


h.  Problems  can  be  identified  by  pro¬ 
duct  and  aro  less  apt  to  affect  the  total  orga¬ 
nization. 


12.  The  disadvantages  listed  for  decen¬ 
tralization  were  as  follows: 


cipline. 


Difficult  to  enforce  system  dis- 


b.  Overlapping  managerial  responsi 
bilities  can  devolop  into  internal  problem  with 
adverse  effect  at  the  production  level  (or  too 
manv  bosses) . 


functions  arc  duplicated  in  each 


d.  Coordination  of  the  overall  effort 
can  be  difficult  at  the  top  level  due  to  the 
number  of  staff  agencies  that  must  be  dealt  with. 


e.  It  is  difficult  to  fix  responsibil¬ 
ity  for  poor  performance  at  the  functional  lcvol 
because  many  people  may  be  performing  identical 
functions. 


f.  Not  as  responsive  to  general  func¬ 
tional  problems. 


g.  Management  not  as  consistent  as 
centralized  procedures. 


13.  The  overall  conclusion  of  most  texts 
was  that  decentralized  operations  were  the 
most  effective  and  efficient.  ADP  becomes  es¬ 
sentia)  in  c.  decentralized  operation  to  allow 
timely  responses  to  a  condition  or,  as  stated 
in  Murdick  and  Ross  in  reference  to  computerized 
system,  "It  is  this  centralized  control  that 
permits  decentralized  operations. "(8) 


REFERENCES 


Periodicals: 


Itooks: 

(1)  Car ut h,  D.  L.  and  P.  M.  Rachel, 

Business  Systens,  San  Francisco,  California, 
Canfield  Press," 1972 . 

(2)  Bethel,  i.  L.,  S.  F.  Atwater, 

C.  11.  E.  Smith,  and  11.  A.  Stackman,  Industrial 
Organization  and  Management,  New  York,  McGraw- 
Hill-  Book  Co.,  Inc.,  1950. 

(3)  Defense  Management -Joint  Course, 
Organization  Planning,  Course  Book,  Rock  Island, 
Illinois,  US  Army  Management  Engineering  Train¬ 
ing  'ct'vjty  (AMETA),  undated. 

14)  Gore,  W.  J.  and  J.  W.  Dyson  (cds.),  The 
Making  of  Decisions,  London,  The  Free  Press  of 
Glencoe,  1964. 

(5)  Kuhlman,  N.  II.  C.,  Supply  Management, 
Industrial  College  of  the  Armed  Forces,  Washing¬ 
ton  D.C.,  1969. 

(6)  LI,  D.  I! . ,  Design  and  Management  of 
Information  Systens,  Chicago,  Science  Research 
Associates,  Inc.,  1972. 

(71  McKcercr,  J.  M.  and  B.  Kruse,  Managc- 
ment  Reporting  Systems,  New  York,  Wilcy- 
Intersciencc,  1971. 

(8)  Murdick,  R.  G.  and  J.  F..  Ross,  Informa- 
t i on  Systems  for  Modern  Management,  Engl cwood 
Cliffs,  New  Jersey,  Prentice-Hall ,  Inc.,  1971. 

(91  Newman,  W.  11.  and  J.  P.  Logan,  Strategy, 
Policy  and  Central  Management,  6th  Edition] 
Cincinnati,  South-Western  Publishing  Co.,  1971. 

(10)  Schcllenbcrger ,  R.  F.,  Managerial 
Analysis,  Homewood,  Illinois,  Kichard  D.  Irwin, 
Inc'.',  1969. 

(11)  Shubin,  J.  A.,  Business  Management. 

New  York,  Bames  and  Noble,  Inc.,  1957. 

(12)  Skeen,  II.  G.  and  W.  C.  Frank,  "Logis¬ 
tic  Management  System,"  Army  Command  and  Manage¬ 
ment:  Theory  and  Practice  Volume  II,  pp  301- 
544,  US  Army  War  College,  nrlislc  Barracks, 
Pennsylvania,  1976-1977. 

(13)  US  Army  Management  Engineering  Train¬ 
ing  Activity  (AMETA),  Organization  Planning, 
Course  Book  for  Course  Number  7A-F8,  Rock  Island, 
Illinois,  Octobcr-Novcmbcr,  1977. 

(14)  US  Army  Armament  Materiel  Readiness 
Command,  Conmanding  General's  Policy  Book, 
DnSAR-PT.l’ictober,  1975. 


(1)  Staff  News  Report,  "Emphasis,  Air  Force 
Manages  Foreign  Sales,"  Atmy  Logistician  9  (2), 

1  (Mar-Apr,  1977). 


Amy  Studies: 

(1)  Army  Materiel  Command  (AMC,  now  DARCOM) 

"Management  of  Materiel  Systems"  Study  by  Army 
Materiel  Command  Board.  AMCB-3-66.  30  June 

1967,  LD  76533A. 

(2)  US  Army  Materiel  Command  Board,  "Manage- 
sw»t  of  Quartermaster- Type  Items"  Project  Study- 
No.  AMCB  1-67,  Aberdeen  Proving  Ground,  Maryland, 
IS  November  1967,  LD  17145. 

(3)  US  Army  Materiel  Command  Beard,  "Inter¬ 
relationships  of  AMC  Major  Subordinate  Commands," 
Project  AMCB  2-69  Draft  Report,  Aberdeen  Proving 
Ground,  Maryland,  30  June  1969.  LD  24864. 

(4)  Crane,  A.  M.,  "Decentralized  Materiel 
Management  of  Commercially  Available  Items," 
Management  Survey  Report,  US  Army  Tank  and 
Automotive  Comnand,  Warren,  Michigan,  1973. 

LD  29323. 

(5)  Toler,  J.  M.,  Ron  Hartoebben,  Ruth 
I.illey,  "Systems  Oriented  Command  Study" 

TSARC0M  (the  TROSCOM) ,  St.  Louis,  Missouri, 

31  July  1968,  LD  16590A. 

(6)  R.  !,.  Sokol,  "Supply  Management  by 
Systems"  Study  No.  47-67,  US  Army  Mobility 
Equipment  Command,  St.  Louis,  Missouri, 

31  July  1968,  LD  16S90A. 

(7)  Cromwell,  G.  F.,  Jr.,  "National  In¬ 
ventory  Control  Point  'Item  Management  within 
US  Army  Armament  Materiel  Readiness  Command," 
Report  No.  DRSAR/SA/71,  Systems  Analysis 
Directorate  US  Army  Armament  Materiel  Readiness 
Cowitand,  Rock  Island,  Illinois  61299,  September 
1977. 

Other  Service  Studies: 

(1)  Ames,  D.  L.,  "Centralization:  A 
Review  and  Analysis,"  Research  Report  to  the 
Faculty,  Air  University,  Maxwell  Air  Force  Base, 
Alabama,  April  197s.  LD  33221D. 

(2)  Anderson,  G.  M.  "Guidelines  for 
Materiel  Management"  Research  Study,  Air 
University,  Maxwell  Air  Force  Base,  Alabama, 

1977,  LD  39140A. 

(3)  Fields,  SamucJ  E.,  "Organization  for 

Humanization,"  Research  Paper,  submitted  to  the 
faculty.  Auburn  Unjvcra.'y  and  '.i  ’diversity, 
Maxwell  Air  Force  Base,  Alabama,  1)  ?7801. 


550 


(1)  llaukeli,  Karstcn,  "The  Logistic  Systeii 
Concept  ami  Foreign  Military  Sales"  Thesis, 

Naval  Postgraduate  School,  Monterey,  California, 
December  1976,  LD  3S924A. 

(5)  Morrell,  Jimmy  R.,  "An  Analysis  of 

New  Cash  Payment  Plan  for  Foreign  Military  Sales 
to  Iran,"  Research  Study,  Maxwell  Air  Force  Base, 
Alabama,  May  1977,  LD  39U5A. 

(6)  Scappa,  J.,  Jr.,  "Forward  Realistic 
Centralization,"  Research  Report  eo  the  faculties 
of  Auburn  University  and  Air  War  College, 

Maxwell  Air  F.rce  Base,  Alabama,  1972,  LD  27901. 

POD  Study: 


tl)  Defense  Logistics  Agency  (Defense  Supply 
Agency) ,  "Materiel  Management  Optimization 
(MATMOP),"  Vol.  I  and  II,  "Analysis,"  Vol  III, 
"Statistical  Appendices"  LD  Nos.  '’5043,  25043A, 
2S043B,  (AD  Nos.  886788,  886789,  886790), 

Cameron  Station,  Virginia,  May  1970. 


551 


AFLC'S  NEW  CONCEPT  IN  MANNING  CENTRAL  PROCUREMENT  ACTIVITIES 


MAJOR  ROBERT  A.  HUBER,  AIR  FORCE  LOGISTICS  COMMAND 


CAPTAIN  LLOVl)  T.  WATTS ,  JR.,  AIR  FORCE  LOGISTICS  COMMAND 


INTRODUCTION 


In  cue  last  half  of  197b,  a  new 
system  for  determining  procurement 
manpower  requirements  was  employed 
within  live  Air  Force  Logistics 
Command  (AFLC'.'  central  procurement 
activities  located  at  AFLC's  Air 
Logistics  Centers  (ALCs).  This 
procurement  manpower  management 
system,  Known  l>y  ics  computer  program 
identifier,  "Ku41,"  was  developed  and 
employed  to  accomplish  three  goals: 

(1)  forecast  manpower  to  reflect  both 
workload  fluctuations  and  policy  and 
procedural  changes  within  the  procure¬ 
ment  environment;  (2)  provide  data  on 
the  effectiveness  of  personnel  in 
awaruing  contracts;  and,  (3)  be 
of  practical  use  to  managers  who 
are  not  statisticians  or  manpower 
specialists.  Although  these  three 
objectives  were  worthy  unto  them¬ 
selves.  the  main  thrust  behind  EB41's 
uevelopment  was  to  answer  the  ques¬ 
tion,  "how  many  people  does  it  take  to 
do  the  procurement  job  in  AFLC?"  This 
was  no  simple  questionl 

The  pi ocurement  activities  within 
AFLC  obligated  billion  in  FT  70 

to  buy  supplies  anu  services  for  the 
Air  Force,  other  government  activi¬ 
ties,  and  for  chose  foreign  govern¬ 
ments  participating  in  the  Security 
Assistance  Program.  The  K841  system 
huu  a  real  job  aheau  of  it  -  to 
determine  Che  necessary  number  of 
procurement  specialists  for  this 
multi-billion  dollar  workload.  If 
successful,  it  would  can  that 
"paper-pushers"  coui  manage  man¬ 
power  using  production  management 
techniques  long  ago  developed  for 
manufacturing  concerns.  Subjective 
judgments  and  negotiations  would  no 
longer  be  the  only  way  to  arrive  at 
manpower  requirements  for  support 
and  service  organizations. 


BACKGROUND 


Prior  to  Ec'41,  procurement  manpower 


requirements  were  developed  by 
virme  of  a  formula  that  was  predomi¬ 
nantly  driven  by  the  dollar  value  of 
past  contract  awaru3.  Hence,  the 
larger  the  dollar  volume  of  experi¬ 
enced  business,  the  greater  the 
manpower  requirement  for  the  future. 

This  procedure  was  deficient  for 
several  reasons.  First,  it  was 
reactive  -  not  forward  looking.  For 
example,  in  FV  /''  procurement  was 
manned  on  FY  74  e<-  erience,  not  on 
forecasts  for  FY  workload. 

Second,  the  contracts  that  consumed 
procurement’s  time  due  to  volume, 
technical  complexity,  or  because  of 
negotiation  difficulties  often  had 
relatively  low  dollar  price  tags 
which  precluded  their  being  given 
proportionate  consideration  in  the 
manning  formula.  An  additional 
defect  of  the  previous  manning 
methouology  was  that  management  had 
no  way  to  determine  whether  their 
people  were  performing  efficiently; 
that  is,  considering  the  volume  and 
complexity  of  workload,  how  did 
contract  output  relate  to  current 
manning? 

The  initial  impetus  to  develop  a 
system  to  enable  procurement  to 
match  hours  spent  with  contracts 
written  was  AFR  2b-9,  Air  Force 
Participation  in  the  Defense  Inte¬ 
grated  Management  Engineering  Systems 
(DIMES)  Program,  which  dealt  with  DOD 
productivity.  On  5  July  1974,  the 
AFLC  Deputy  Chief  of  Staff  for 
Procurement,  and  Production  gave  the 
Warner  Robins  ALC  Procurement  Direc¬ 
tor  the  responsibility  for  developing 
an  internal  management  system  to 
achieve  the  objectives  under  AFR  2b-9 
and  to  strengthen  the  credibility  of 
pi ocurement 's  manpower  requirements 
computation  through  the  use  of  a 
logical,  auditable  methodology.  The 
personnel  responsible  for  the  efforts 
to  attain  these  obji.ctivt.  wt  " c 
Mr.  Paul  Jarrett,  Mr.  Sam  'qu».-  .  r 
Mr.  Bill  Bennett,  and  Mr.  Ray  Benefield, 
all  from  WR-ALC  Procurement,  and 
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Mr.  Harvey  Brown  from  che  UK-ALC 
Management  Engineering  Team. 

Initial  testing  of  the  newly  developed 
Eb41  system  was  completed  in  June 
1975,  with  Command  implementation 
during  August.  The  original  objec¬ 
tives  were  expanded  during  development 
of  the  program  to  emphasize  measure¬ 
ment  of  personnel  efficiency  in 
awarding  contracts  and  to  reflect 
workload  fluctuations  and  changes  in 
procurement  policies  and  procedures. 


SYSTEM  FUNDAMENTALS 


To  be  responsive  to  the  AFLC  procure¬ 
ment  environment,  the  manpower  system 
was  tied  to  the  heart  of  procurement's 
business,  that  is .  the  type  of  con¬ 
tract  issued  and  the  unique  tasks 
involved  with  each  award.  The  "tool" 
used  to  accomplish  this  was  a  matrix 
from  which  buyers  could  select  one  of 
23  different  contract  types  and  up  to 
55  different  complexity  variables  to 
describe  the  events  that  occurred 
during  the  awarding  of  a  contract.  An 
example  of  the  form  with  which  buyers 
reflect  these  choices  is  shown  in 
Figaro  1.  Detailed  time  standards 
were  developed  for  each  basic  contract 
type  and  each  complexity  element  by 
the  AFI.C  Management  Engineering  Teams, 
in  conjunction  with  procurement 
personnel.  These  standards  are  Che 
vehicle  for  translating  procurement 
activity  into  earned  man-hours  and  are 
the  first  of  three  variables  necessary 
for  determining  future  procurement 
manpower  requirements.  The  second 
variable  is  a  erics  of  correlation 
factors  which  are  the  ratios  of  each 
of  the  23  contract  types  to  the  total 
number  of  purchase  requests  received 
during  che  previous  12  months. 
Procurement's  expected  number  of 
contracts  is  then  forecast  by  applying 
these  correlation  factors  (ratios) 
to  the  third  variable,  the  expected 
volume  of  future  purchase  requests. 

The  final  step  in  the  process  is  to 
multiply  the  expected  number  of  con¬ 
tracts  by  variable  if  1,  the  historical 
standards  for  each  contract  type.  The 
outcome  of  this  process  gives  procure¬ 
ment  managers  a  direct  manpower 
requirement  developed  from  the  com¬ 
plexity  and  volume  of  their  actual 
business. 


To  maintain  the  reliability  of  the 
system,  the  detailed  standards  that 
drive  E841  and  the  workload  data 


submitted  by  che  procurement  buyers 
are  periodically  validated.  For 
instance,  each  buyer  la  provided 
with  criteria  as  to  when  and  how 
the  various  complexity  factors  are 
to  be  applied.  Audits  by  Headquarters 
procurement  personnel  insure  chat 
these  criteria  are  applied  consis¬ 
tently  across  che  Command.  The 
standards  themselves  are  also 
audited  by  che  Management  Engineering 
Teams,  in  conjunction  with  procure¬ 
ment  personnel,  to  insure  that 
the  current  procurement  environment 
is  realistically  reflected.  The 
results  of  this  program  accomplish 
che  end  for  which  it  was  designed  - 
the  identification  of  actual  manpower 
requirements  to  accomplish  the 
procurement  workload. 

The  new  system  also  makes  performance 
measurement  possible  through  compari¬ 
son  of  the  standard  hours  Chat  a 
buyer,  section,  branch,  etc., 
actually  earns  to  total  available 
hours.  For  instance,  if  tasks  were 
accomplished  in  less  than  standard 
hours,  che  accomplishments  would 
reflect  efficiency  or  vice  .orsa. 

An  analysis  of  this  efficiency  can 
lead  to  understanding  che  effects  of 
workload  cycles,  policy  and  procedure 
changes,  absenteeism,  and  numerous 
ocher  factors  on  contract  output. 


ADVANTAGES / PI S ADVANTAGES 


The  principle  advantage  of  the  new 
system  versus  the  old  has  already 
been  discussed  -  che  new  system 
matches  manpower  to  the  projected 
volume  and  complexity  of  procurement's 
business  rather  than  to  an  unrealistic 
indicator,  such  as  past  contract 
dollars.  A  second  advantage  is  its 
common-sense  useability  by  manage¬ 
ment.  For  instance,  by  highlighting 
peculiarities  in  contracting  tech¬ 
niques  (complexity  elements) ,  the 
system  can  indicate  to  managers  that 
one  organizational  subdivision  may 
be  eliminating  steps  or  procedures 
that  another  is  accomplishing.  This 
visibility  could  lead  to  new, 
improved  procedures  or  possibly  to 
corrections  of  deficient  procurement 
practices . 

The  new  system  also  enables  manage¬ 
ment  to  aujusc  their  manpower  fore¬ 
casts  based  on  knowledge  of  workload 
or  procurement  policy  changes.  If  a 
procurement  policy  change  affects 
the  complexity  of  placing  con- 
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tracts,  a  new  complexity  element  can 
be  auded  to  the  system,  or  Che  stan- 
uare  hours  £or  an  old  complexity 
elewenc  can  be  c.i  .nged  to  reflect  che 
new  uevelopraents.  If  a  manager  knows 
of  future  workload  changes,  such  as 
major  shifts  from  initial  provisioning 
to  replenishment  spares  buying, ,  he/she 
can  transfer  the  manning  requirements 
from  areas  with  decreasing  activity 
to  ersose  with  increasing  activity 
by  aejusting  the  affected  correlation 
factors . 

Management  can  also  make  direct 
additives  to  this  system  if  a  peculiar 
situation  is  not  covered  by  any 
cxisling  standaru.  For  instance,  when 
the  manpower  management  system  itself 
was  developed,  an  additive  was  allowed 
for  one  person  to  manage  the  day-to- 
uay  operations  of  the  system  on  a 
full-time  basis.  Of  course,  all 
sue'.:  changes  to  the  E;>4 i  must  be 
cooruinneed  through  bocli  the  AFLC 
Deputy  Chiefs  of  Staff  for  Procure¬ 
ment  and  for  Personnel  before  implemen¬ 
tation. 

A  final  advantage  of  Eo4i  is  chat 
it  provides  descriptive  workload 
information  at  all  organizational 
levels  to  aid  management  in  its 
many  personnel  decisions.  For  exam¬ 
ple,  Ko'tl  can  provide  data  chat  will 
allow  a  comparison  to  be  made  between 
the  complexity  of  tasks  in  an  organiza¬ 
tion.  and  che  skill  levels  of  che 
people  actually  accomplishing  the 
tasks.  This  information  is  useful  in 
determining  whether  one  organization 
is  effectively  employing  its  personnel 
in  comparison  to  similar  organiza¬ 
tions.  The  conclusion  is  chac  what¬ 
ever  management  perceives  as  its 
particular  uniqueness,  the  Eb41 
provides  a  way  of  considering  this 
uniqueness  in  determining  procurement 
manpower  requirements,  and  in  deter¬ 
mining  the  efficiency  of  assigned 
procurement  resources. 

A  discussion  of  eke  disadvantages  of 
the  new  Eb41  system  primarily  centers 
on  the  resource  expense  in  forecasting 
requirements.  The  old  manpower 
determining  system  employed  a  formula 
chat  required  only  che  input  of 
several  variables  -  dollars,  line 
items,  and  actions  -  before  manpower 
needs  could  be  forecasted.  These 
values  were  retrieved  from  allied  • 
computer  syscems  and  did  not  require 
any  significant  procurement  involve¬ 
ment.  Forecasting  manpower  under  che 
E341  system,  however,  requires  the 
direct  participation  of  procurement 


personnel  to  input  anil  Interpret 
woi'kload  data  and  to  maintain  th* 
accuracy  and  reliability  of  the 
system.  In  addition  to  resource 
expense,  criticism  of  Ed41  has  been 
directed  cowards  its  self-adjustment 
feature  for  manpower  efficiency 
which,  some  claim,  tends  to  restrict 
innovation.  As  labor  efficiency 
increases,  the  EC41  system  proportion 
acely  reduces  future  requirements 
based  on  che  premise  chat  it  should 
cake  less  people  to  accomplish 
the  forecasted  workload.  Thus,  any 
innovativeness  that  results  in 
increased  output  will  also  result  in 
decreased  manpower.  However,  this 
crit-'cism  is  inherent  in  any  system 
chac  recognizes  efficiency  because 
it  i,  a  simple  fact  chat  an  efficient 
werk  force  c  a  output  more  work  than 
an  inefficient  one.  The  job  of 
providing  labor  incentives  rests 
with  management  and  is  not  really  a 
valid  criteria  by  which  the  success 
or  failure  of  a  manpower  management 
svstcra  can  be  judged.  Notwithstand¬ 
ing  these  disadvantages,  che  positive 
aspects  of  E841  experienced  during 
FY  76  and  FY  77  far  outweighed 
the  negative. 


UTILIZATION 


During  Fiscal  Year  1976,  EC41  faced 
its  initial  practical  applica¬ 
tion,  and  was,  therefore,  first 
subjected  to  the  scrutiny  of  manpower 
and  personnel  specialists  and  the 
parochial  interests  of  ocher  organiza 
cions  as  they  competed  for  limited 
manpower  authorizations.  During 
these  manpower  computations,  Eb41 
redefined  procurement  requirements 
for  che  five  central  procurement 
activities  by  identifying  some  70 
excess  manpower  authorizations. 

This  refinement  was  due  to  Eb41's 
tight  correlation  between  manpower 
and  the  volume  and  complexity  of 
procurement's  forecasted  workload. 

The  fact  chat  these  reductions  were 
offered  without  the  diccaces  of  che 
AFLC  Deputy  Chief  of  Staff  for 
Personnel,  who  recommends  che  alloca¬ 
tion  of  all  manning  authoriza¬ 
tions,  gave  weight  to  the  credibility 
of  che  system  at  its  inception. 

Since  then,  the  E841  computations 
have  demonstrated  objectiveness  by 
noL  only  decreasing  requirements  but 
also  adding  them  when  procure¬ 
ment’s  on-board  strength  did  not 
equate  to  its  projected  workload. 


555 


_ 


..ijM 


During  ?V  73,  Che  five  ALC  central 
procurement  directorates  will  be 
manned  at  approximately  92'/.  of  their 
projected  requirements.  Although  this 
is  less  than  full  manning,  the  reduc¬ 
tion  was  predicated  on  a  fair  share  of 
the  FY  /U  President’s  budget  cut  which 
was  spread  among  all  organizations, 
liven  with  these  reductions,  procure¬ 
ment  will  enjoy  manning  at  a  higher 
percentage  of  its  requirements  than 
the  other  major  logistics  organiza¬ 
tions  within  AFLC. 

Another  indication  of  E841’s  effec¬ 
tiveness  is  the  102. 2/i  command-wide 
efficiency  measurement  for  the  central 
procurement  buying  organizations 
during  FY  77.  This  is  to  say  Chat  the 
AFLC  buyers  are  earning  very  close  to 
tnose  hours  anticipated  under  the 
uctailed  time  standards.  Efficiencies 
significantly  under  L00’4  would  have 
shown  Chat  the  contract  standards  were 
undercutting  the  hours  that  were 
roall/  required  to  award  contracts, 
while  efficiencies  significantly  above 
lOu*.  wculu  have  shown  mat  the  stan¬ 
dard  s  were  overshooting  requirements. 
3ec.-‘.isc  the  standards  appeared  to 
accurately  reflect  the  workload 
experienced  during  FY  77,  the  con- 
>■ ’.:  s  >n  was  drawn  chat  Che  E841  system 
p  cv.dcd  a  firm  foundation  from  which 
t  >  ouild  FY  73  and  inter  procurement 
ranpovsr  needs. 


PRODUCTIVITY  INTERFACE 


In  addition  to  'tsing  E841  to  forecast 
procurement  man*  ewer  requirements 
and  to  manage  manpower  at  the  Air 
Logistics  Centers,  the  potential 
exists  fc"  its  use  in  productivity 
ir.aasuremenc .  Productivity,  in  this 
context,  is  the  ratio  b 'tween  organi¬ 
zational  output  and  input  during  a 
particular  period. 

The  concept  of  measuring  procurement 
productivity  i#  not  r  w.  For  example, 
in  1974,  an  Air  Fort  Academy  study  of 
USAF  procurement  pro-  activity  (USAFA- 
TR-74-9)  used  completed  contract 
instruments  as  organizational  output 
and  assignad  personnel  as  input, 
because  of  ite  similarity  to  the 
initial  attempts  by  AFLC  to  measure 
procurement  productivity  in  1975,  the 
Academy  study  is  used  as  n  point  of 
reference  for  addressing  the  possible 
adaptability  of  E841  to  future  produc¬ 
tivity  measurement. 


The  Academy's  productivity  measure¬ 
ment  went  beyond  simply  dividing 
total  contract  instruments  by  total 
ascigned  personnel.  The  study 
recommended  chat  the  contract  instru¬ 
ment  output  be  subjectively  weighted 
by  the  following  five  complication 
factors  (all  tied  to  the  DD  350): 
kind  of  procurement,  co  '.tract  place¬ 
ment,  the  extent  of  competition, 
certified  cost  or  pricing  data,  and 
type  of  contract.  Several  weak¬ 
nesses  are  apparent  in  using  this 
approach  to  compute  AFl.C  procure¬ 
ment  productivity.  First,  the 
p.T'.’uctivity  measure  includes  overly 
simplified  complication  factors  to 
describe  the  differences  in  procure¬ 
ment  complexity  from  contract  to 
contract.  Second,  it  subjectively 
weights  the  complication  factors  to 
determine  the  magnitude  of  complexity 
of  overall  output  and  third,  it 
treats  all  purchases  under  310,000 
(which  represent  907.  of  AFLC’s 
central  procurement  contracts) 
as  being  basically  identical.  The 
E341  data  base  may  offer  an  oppor¬ 
tunity  to  eliminate  these  weaknesses. 
First,  the  detailed  Ed41  work, 
standards  -  both  by  type  instrument 
and  by  complexity  clement  -  offer  an 
objective  wav  of  evaluating  output. 

That  is,  output  by  the  type  of 
contract  written  could  be  weighted 
objectively  by  the  respective  earned 
complexity  hours  rather  than  a 
subjective  complexity  racing. 

Second,  the  55  complexity  elements 
would  enable  a  much  more  accurate 
assessment  of  the  actual  contracting 
difficulties  than  the  five  general 
categories  used  in  the  Academy 
study.  Finally,  the  EU41  data 
includes  detailed  complexity  measure¬ 
ment  for  all  procurements,  not 
n  -.C  Chose  over  $10,000,  so  Che 
output  measure  would  be  much  mere 
comprehensive  under  E841  chan  the 
Academy  scudy. 

Alchough  E<s41  appears  to  be  able  to 
improve  the  methods  employed  in  the 
Air  Force  Academy  effort,  it  nay  also 
i  itroducc  its  ovr  peculiar  deficien¬ 
cies  into  procurement  productivity 
measurement.  The  unresolved  issues 
that  would  require  analysis  and 
decisions  before  a  modification  to 
ch'  current  E841  system  was  warranted 
include:  What  new  errors  would  be 
introduced  into  Che  productivity 
analysis?  What  levels  of  organization 
would  be  affecccd  by  the  m-as  ‘ement 
process?  What  costs  would  fc<*  ;  Ived 
in  the  d8ta  processing  systems?  To 
whom  would  the  productivity  measurement 
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SUMMARY 


E8A1  has  enjoyed  considerable  success 
and  has  earned  the  confidence  of  both 
procurement  specialists  and  manpower 
analysts  alike.  It  has  met  its 
original  goals  and  hat  provided 
procurement  managers  with  a  unique 
tool  that  is  highly  responsive  to 
th’  fluctuations  in  workload  volume 
and  complexity,  and  to  procurement 
policy  changes  as  well.  More  impor¬ 
tantly,  it  provides  an  accurate  and 
current  answer  to  the  question  of  how 
many  people  does  it  take  to  accomplish 
the  central  procurement  tasks  within 
AFLC.  However,  beyond  all  these 
attainments,  E841  loons  as  a  pioneer 
effort  into  quantifying  manpower 
management  in  support  activities  that 
are  not  hardware  output  oriented.  It 
is  this  achievement  that  has  the 
magnetic  appeal  to  draw  other  staff 
or  support  organizations  into  similar 
systems.  With  Government's  ever 
watchful  eye  on  personnel  expendi¬ 
tures,  the  E841  system  may  provide  a 
significant  insight  into  organiza¬ 
tional  effectiveness  and  efficiency 
and  thus  could  eventually  prove  more 
valuable  than  first  anticipated. 
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PURCHASING  PERFORMANCE:  MEASUREMENT  AND  CONTROL 

Dr.  Robert  M.  Monczka  and  Or.  Phillip  L.  Carter 
Michigan  State  University 


OVERVIEW 

More  than  tvo  hundred  managers  and  buyers  from 
eighteen  leading  private/public  organizations 
were  interviewed  and  more  than  two  hundred  pur¬ 
chasing  performance  measures  were  identified  in 
chls  survey,  thirteen  categories  were  estab¬ 
lished  for  the  purchasing  performance  measures: 
(1)  price  effectiveness,  (2)  cost  savings,  (3) 
workload, (41  administration  and  control,  (5) 
efficiency,  (6)  vendor  quality  and  delivery, 

(7)  KSteriai  flow  control,  (8)  regulatory/ 
societal /environmental,  (9)  procurement  plan¬ 
ning  and  research,  (10)  competition,  (11)  in¬ 
ventory,  (12)  transportation,  and  (13)  purchas¬ 
ing  procedure  audita. 

Important  differences  were  found  in  how  the 
participating  organizations  measured  perform¬ 
ance  in  each  of  these  key  areas.  Uaea/benc- 
flts,  inadequaciea/limitations,  negative/dya- 
functional  behaviors,  and  improvements  asso¬ 
ciated  with  the  measures  are  discussed.  Sta¬ 
tistical  analyses  of  the  research  data  revealed 
significant  differences  in  the  perceived  use¬ 
fulness  and  validity  of  various  purchasing 
measures  within  and  among  the  participating  or- 
ganizat ions . 


PURCHASING  PERFORMANCE:  MEASUREMENT  AND  CONTROL 
INTRODUCTION 

The  purpose  of  this  research  was  to  determine 
the  state  of  the  art  in  measurement  of  purchas¬ 
ing  performance  at  leading  private  and  public 
(federal  level)  organizations  and  to  develop 
information  which  could  lead  to  improved  pur¬ 
chasing  performance  measurement  and  control 
syseemo.  The  research  Identified  the  measures 
in  use  In  these  organizations  and  obtained  user 
ratings  of  the  measures.  In  addition,  users 
identified  the  uoes/beneflts,  performance 
standards,  lnadequacies/limicacions,  and  nega¬ 
tive/dysfunctional  behav'  -rs  for  the  measures. 
They  also  identified  wa;  in  which  the  measures 
might  be  Improved.  Statistical  analyses  of  the 
quantitative  rating  data  revealed  differences  in 
user  evaluations  of  the  measures. 

RESEARCH  SAMPLE 

Eighteen  organizations  were  surveyed  and  248  in¬ 
terview*  were  conducted  with  managers  and 
buyers.  Approximately  60  percent  of  the 
respondents  were  managers  and  40  percent  were 
nonmanagera.  All  were  experienced  purchasing 
personrel  and  had  considerable  knowledge  about 
the  puicha8lng  measurement  systems  used  hy 


their  organizations.  Firms  from  the  automo¬ 
tive,  aerospace,  appliance,  computer,  chemical 
and  electronics  industries  were  included  in 
the  survey  as  well  as  five  public  organiza¬ 
tions  at  the  federal  level.  Purchasing  mana¬ 
gers  at  all  levels  of  the  organization  were 
Interviewed. 

DATA  COLLECTION 

Four  questionnaires  were  used  to  collect  quan¬ 
titative  and  qualitative  data  about  the  organ¬ 
izations,  the  purchasing  department,  the  pur¬ 
chasing  measurement  systems  in  use,  and  user 
perceptions  of  the  measures.  Questionnaire  I 
obtained  data  about  the  organization,  includ¬ 
ing  products  sold;  products  purchaced;  numbers 
of  people  in  the  organization  and  in  purchas¬ 
ing;  the  purchasing  measurement  aysrem;  and 
who  received  what  measures,  how  often,  and  in 
what  form. 

Questionnaire  II  waa  used  to  collect  data 
about  the  respondents'  purchasing  reaponalbil 
ities  and  environment,  and  about  the  purchas¬ 
ing  measures  he/she  used.  Questionnaires  111 
and  IV  were  used  to  collect  detailed  data 
about  the  purchsBing  measures  used  by  the  re¬ 
spondent.  Respondents  were  asked  to  rate  each 
measure  along  thirteen  dimensions.  The  dimen- 
tlons  were:  (1)  accuracy;  (2)  timeliness; 

(3)  validity;  (4)  underatandabil Ity ;  (5)  com¬ 
parability  from  reporting  period  to  reporting 
period;  (6)  year  to  year  comparability;  (7) 
comparability  between  groups  such  as  buyers, 
products,  suppliers,  and  so  forth;  (8)  fre¬ 
quency  of  use;  (9)  importance;  (10)  useful¬ 
ness;  (II)  familiarity  of  users  with  perform¬ 
ance  standards;  (12)  challenge  of  the  per¬ 
formance  standards;  and  (13)  degree  of  real¬ 
ism  of  the  performance  standards. 


PURCHASING  PERFORMANCE  MEASURES 

More  than  200  purchasing  performance  measures 
were  found  in  the  organizations  visited. 

These  were  grouped  into  13  categories  by  the 
researchers,  and  a  discussion  of  each  follows: 

Price  effectiveness 

Price  effectiveness  measures  were  used  to 
measure:  (1)  actual  purchasing  price  perform¬ 
ance.  against  plan;  (2)  actual  purchasing  price 
performance  against  market;  and  (3)  actual 
purchasing  price  performance  between  buying 
groups /locations.  Purchase  rir  -artnneer. 
from  plan  were  calculated  on  an  T.jiv'-'va1 
line  item  and  on  a  total  purchasing  budget 
baois.  Die  indicators  were  the  price  var¬ 
iances  measured  in  terms  of:  (1)  actual  unit 
cost  minus  planned  cost;  (2)  s  pri>e  variance 
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percentage,  actual  unit  cost  over  planned  coat; 
or  (3)  an  extended  price  variance,  actual  unit 
cost  minus  planned  cost  multlpled  by  an  esti¬ 
mated  annual  quantity  (or  quantity  for  the  re¬ 
mainder  of  the  planning  period). 


The  key  element  in  measuring  price  effective¬ 
ness  against  plan  was  the  manner  in  which  the 
plan  wao  established.  The  planning  process 
generally  began  with  establishment  of  purchase 
requirements  and  line  item  purchase  price  fore¬ 
cast  for  the  next  budget  period,  usually  a 
year.  In  some  cases,  forecasts  were  also  made 
for  comparison  purposes  by  a  cost  accounting 
and/or  industrial  engineering  group  independent 
of  purchasing.  These  forecasts  were  reviewed 
by  purchasing  and  nonpurchasing  management, 
such  as  finance  and  manufacturing.  After  man¬ 
agement  review  and  acceptance/revision,  the 
purchase  price  plan  was  incorporated  into  the 
operating  plan. 


Price  effectiveness  was  measured  and  reported, 
usually  monthly,  by  comparing  actual  purchase 
price  to  planned  price  at  one  or  more  of  four 
possible  control  levels.  Level  1  was  at  the 
purchasing  department  level  and  Included  the 
overall  material  budget.  Level  2  was  at  the 
major  purchase  product  group  and  Level  3  was 
at  the  major  final  product  sold.  Level  4, 
which  was  the  most  detailed  level,  was  at  the 
purchased  item  level.  The  results  at  Level  4 
could  be  aggregated  up  to  Level  2  and  Level  3, 
while  results  at  Level  2  and  Level  3  could  be 
aggregated  up  to  Level  1.  The  results  at 
Levels  2,  3,  and  4  could  be  reported  by  vendor; 
buyer,  groups,  and  department. 


Maximum  control  was  exercised  in  those  organi¬ 
zations  measuring  performance  at  all  four 
levels.  All  organizations  were  at  least  meas¬ 
uring  at  Level  1.  Effective  control  would 
appear  to  require  measurement  at  least  at 
Levels  1  and  4.  Planning  appeared  most  effec¬ 
tive  on  an  annual  basis  with  revision  allow¬ 
able  up  to  one  month  prior  to  the  planning 
period. 


Other  indicators  of  price  effectiveness  were 
comparison  of  actual  purchase  costs  to  market 
and  comparison  of  purchase  costs  at  multiple 
buying  locations.  Organizations  developed  in¬ 
dices  of  actual  purchases  based  on  invoices 
paid  and  compared  these  to  similar  purchased 
items  Included  in  the  Wholesale  Price  Index  or 
the  Wholesale  Price  Index  in  total. 


Cost  savings 


Cost  savings  measures  Included  indicators  of 
both  cost  reduction  and  cost  avoidance.  Cost 
reduction  required  that  the  new  unit  cost  be 
lower  than  the  old  unit  cost  on  a  line-item 
basis.  Cost  avoidance  was  more  loosely  de¬ 
fined  and  could  be  obtained,  for  example,  by 
buying  at  a  price  lower  than  the  average  price 
being  quoted,  even  though  the  new  unit  price 
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would  be  on  Increase  over  the  old  price. 

Cost  reduction/avoidance  was  measured  on  the 
basis  of  an  absolute  unit  or  an  annual  cost 
reduction/avoidance,  or  by  comparing  actual 
cost  reduction/avoidnnce  to  a  budgeted  or  tar¬ 
geted  cost  reduction/avoidance.  Cost  savings 
data  was  usually  collected  and  reported  on  a 
monthly  basis  by  buyer,  section,  and  depart¬ 
ment. 

Selected  uses/benefits  of  these  measures  in¬ 
cluded  attention  on  cost  reduction,  discipline, 
provision  of  information  on  how  to  achieve 
cost  savings,  monitoring  of  performance  to 
goals,  comparability  of  coat  savings,  exposure 
to  other  functions,  and  performance  appraisal. 
Selected  inadequacius/llmltations  Included  dif¬ 
ferent  cost  savings  rules  for  different  groups 
in  the  purchasing  department  or  at  different 
locations,  use  of  credit  only  for  negotiating 
price  decreases  and  not  engineering  changes, 
subjectivity  and  luck  of  credibility  of  the 
measure,  lock  of  cost  savings  reduction  with 
price  increases,  lack  of  savings  reduction 
with  cancellation  of  a  part,  incorrect  usage 
estimates,  time  required  for  reporting,  diffi¬ 
culty  in  setting  targets,  and  Impact  of  exter¬ 
nal  business  conditions. 

Analysis  of  the  respondent  perceptions  of  the 
cost  savings  measures  revealed  that  the 
measures  with  the  highest  ratings  were  narrow¬ 
ly  defined  actual  cost  reductions.  Further¬ 
more,  cost  measures  were  rated  higher  in  those 
organizations  which  provided  the  opportunity 
to  adjust  the  quantity  purchased  and  net  out 
the  true  cost  reduction. 

Workload 


All  of  the  research  sites  measures  workload  in 
the  purchasing  department .  This  was  broken 
down  into  three  categories:  (1)  workload-lr.: 
a  measure  of  the  now  work  coming  into  tha  pur¬ 
chasing  department!  (2)  workload-current:  a 
measure  of  the  backlog  of  work;  (3)  workload- 
completed:  a  measure  of  the  work  accomplished. 
Measures  of  the  workload-in  classification 
were  usually  counts  of  work  received,  includ¬ 
ing  purchase  requisitions  received,  purchase 
information  requests  received,  number  of  pro¬ 
tests  received  (government  organizations),  and 
number  of  pricing  requests  received.  These 
counts  were  reported  on  a  weekly,  monthly,  nnd 
year-to-date  basis.  Workload-in  measures  were 
reviewed  regularly  by  purchasing  management 
and  were  used  to  help  predict  and  explain 
changes  in  other  departmental  measures.  For 
example,  an  increase  in  workload-in  could  lead 
to  a  corresponding  increase  in  purchasing's 
tdministrative  lead-time  if  workforce  size  and 
efficiency  stayed  the  same. 

Measures  of  the  workload-current  category 
were,  typically,  counts  of  the  backlog  of  work 
in  the  purchasing  department.  The  two  most 
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common  counts  were:  (1)  purchase  requisitions 
on  hand  and  (2)  line  items  on  hand.  Another 
approach  to  measuring  workload-current  was  to 
convert  the  workload  Into  number  of  days  of 
work  at  a  standard  rate-  All  of  the  measures 
were  uaually  reported  on  a  monthly  basis  along 
with  the  previous  year's  experience. 

Measures  found  in  the  workload-completnd  cate¬ 
gory  included  purchase  orders  placed,  line 
items  placed,  dollars  placed,  contracts  written 
and  price  proposals  written.  In  the  public 
sector  organisations,  the  workload-completed 
measures  were  subdivided  into  more  specific 
categories,  such  as  large  purchases  and  small 
purchases. 

Administration  and  control 

These  measures  were  used  to  help  plan  the  an¬ 
nual  administrative  budget  for  the  purchasing 
function  and  help  control  administrative  ex¬ 
penses  during  the  budget  period. 

The  major  question  In  this  ares  of  performance 
was  how  large  the  purchasing  administrative 
budget  should  be.  The  crux  of  the  question 
really  is:  What  should  cur  headcount  be? 

Since  salaries  are  the  major  Item  in  tho  bud¬ 
get,  most  organizations  felt  that  the  answer 
to  this  question  rested  on  the  workload  re¬ 
quired  of  purchasing.  This  led  to  further 
problems  in  defining  workload  and  establishing 
relationships  between  workload  and  headcount. 

The  most  common  method  for  establishing  a  bud¬ 
get  was  to  start  with  the  current  budget  and 
adjust  it  up  or  down,  depending  on  the  business 
forecast.  The  adjustment  reflected  management 
views  on  both  the  projected  purchasing  work¬ 
load  and  the  projected  profit  margins,  baaed  on 
ecouomlc  conditions.  For  the  firms  using  this 
approach,  no  formal  methods  were  used  to  relate 
workload  or  business  conditions  to  budget  or 
headcount  level.  The  budget  was  justified  each 
yeur  U3ing  whatever  arguments  were  currently 
val id . 

Another  approach  was  to  use  a  control  ratio. 

In  thin  approach,  purchasing's  administrative 
budget  was  established  as  a  percentage  (ratio) 
of  another  measure  chose-  ro  reflect  the  pur¬ 
chasing  workload.  Typi<  .iy,  the  workload 
measure  was  pi  tuned  dollar  expenditure  for 
direct  material.  Purchasing's  administrative 
budgie  was  calculated  by  multiplying  the  direct 
material  input  budget  by  the  control  ratio. 

The  ratio  was  based  on  historical  levels  and 
vas  negotiated  yearly  betveen  purchasing  and 
higher  management - 

The  material  input  budget  was  based  on  a  pro¬ 
jection  of  material  input  needed  to  support  de¬ 
liveries  for  the  next  year.  The  implicit 
assumption  was  that  the  purchasing  workload  was 
proportional  to  direct  material  Input  dollars. 
Once  the  ratio  and  the  budget  had  been  set  for 


the  year,  a  monthly  ratio  of  actual  adminis¬ 
trative  expenses  to  direct  material  input  be¬ 
came  a  control  figure  for  actual  expenses. 

A  critical  problem  with  the  control  ratio  ap¬ 
proach,  using  direct  material  input,  was  that 
much  of  the  actual  work  of  purchasing  was  com¬ 
pleted  before  the  direct  material  was  received 
and  paid  for  by  the  organization.  Significant 
variations  in  purchasing  workload  and  direct 
material  input  over  time  led  to  cycles  of 
over-  and  under-funding  for  the  purchasing  de¬ 
partment. 

Several  organizations  were  using  or  experi¬ 
menting  with  methods  for  translating  projected 
purchasing  workload  into  a  specific  headcount 
number.  There  were  several  vo-lations,  but 
the  essence  wan  to  establish  a  stundard  of 
workload  per  buyer,  based  on  historical  per¬ 
formance  standards  and/or  time  studies.  Pro¬ 
jected  workload  was  then  divided  by  the  stand¬ 
ard  to  calculate  the  total  number  of  buyers 
required.  The  projected  number  of  buyers 
needed  might  be  multiplied  by  another  ratio  to 
get  the  number  of  secretarial/derical 
employees  needed.  Finally,  a  fixed  number  of 
managers  and  other  Btaff  members  would  be 
added  to  get  a  total  headcount  for  the  depart¬ 
ment. 

The  critical  number  in  this  method  was  the 
workload  standard.  Typically,  these  standards 
were  based  on  historical  performance  and  the 
judgment  of  buyers  and  managers.  The  stand¬ 
ards  varied,  depending  on  the  difficulty  of 
the  items  to  be  purchased.  For  example,  a 
maintenance,  repair  and  operating  supplies 
buyer  would  be  expected  to  handle  many  more 
part  numbers  than  o  buyer  of  high  reliability 
parts. 

A  different  approach  was  to  set  the  standards 
in  terms  of  hours  per  document  and  to  estab¬ 
lish  how  much  time  u  buyer  spent  in  buying 
activity  each  week.  This  time  was  then  trons- 
Jated  into  a  standard  number  of  documents  per 
year  per  buyer.  A  specific  number  of  buyers 
was  then  established,  based  on  the  level  of 
workload  anticipated. 

The  most  detailed  and  complex  approach  to  bud¬ 
getting  was  found  in  a  public  sector  organiza¬ 
tion  in  the  U.S.  Department  of  Defense.  Varia¬ 
tions  existed  in  the  different  Defense  agen¬ 
cies,  but  all  operated  by  establishing  time 
standards  for  all  activities  within  purchas¬ 
ing.  Using  these  detailed  time  standards  amd 
a  workload  forecaat,  the  necessary  workforce 
could  be  calculated. 

The  major  difficult),  in  establishing  an  ad¬ 
ministrative  budget  icr  pure".. ’.tin,  vas  de¬ 
ciding  on  an  appropriate  headcouns  Lev'  and  a 
correponding  level  of  salary  and  benefit 
dollars.  Afrcr  reviewing  the  several  methods, 
it  nppenrn  lh.it  the  moot  useful  is  between  the 


560 


1 

J  -  -a 


control  ratio  approach  and  the  detailed  time- 
otandard8  approach.  It  appears  reasonable  to 
use  aggregate  standards,  such  as  line  items 
per  buyer,  to  help  establish  the  necessary 
staffing  levels.  The  control  ratio  is  often 
out  of  phase  with  the  actual  purchasing  work¬ 
load.  Detailed  time  standards  do  not  appear  to 
yield  results  that  are  sufficiently  superior  in 
most  purchasing  departments  to  justify  their 
development  and  use. 

Efficiency 

Efficiency  measures  related  purchasing  outputs, 
such  as  line  items  placed,  to  purchasing  inputs 
such  as  buyers.  These  measures  ranged  from 
two-factor  measures  that  had  one  input  and  one 
output,  to  multifactor  measures  chat  related 
several  outputs  to  several  inputs. 

Two-factor  measures  were  calculated  by  dividing 
a  count  of  some  output  fron  the  purchasing  de¬ 
partment  by  a  count  of  a  resource  input.  A 
wide  variety  of  inputs  and  outputs  were  counted 
by  the  organisations,  with  most  using  several 
different  measures. 

Among  the  more  common  two-factor  measures  were 
the  following:  purchase  orders  per  buyer,  line 
items  per  buyer,  dollars  committed  per  buyer, 
change  notices  per  buyer,  contracts  written  per 
buyer,  average  open  order  commitment,  worker 
hours  per  line  items,  worker  hours  per  purchase 
order,  worker  hours  per  contract,  administra¬ 
tive  dollars  per  purchase  order,  administrative 
dollars  per  contract,  and  administrative  dol¬ 
lars  per  purchase  dollar. 

Purchasing  administrative  lead  time  (PALT)  is 
a  different  kind  of  efficiency  measure  used  by 
both  public  and  private  organizations.  PALT  is 
generally  defined  as  the  elapsed  time  from 
arrival  of  the  purchasing  requisition  at  the 
purchasing  department  to  placing  of  the  requi¬ 
sition  with  a  vendor.  Average  PALT  was  uaually 
tracked  over  time  with  an  emphasis  on  keeping 
it  below  some  standard  time.  Also,  the  requi¬ 
sitions  with  the  longest  elapsed  time  in  the 
department  were  routinely  identified  and  moni¬ 
tored  until  they  were  finally  placed. 

All  of  the  other  multlfnctor  efficiency  ratios 
were  measures  of  labor  efficiency  found  in  the 
U.S.  Department  of  Defense  organizations. 

These  measures  were  all  essentially  of  the 
form:  performance  efficiency  »  earned  hours 
divided  by  actual  hours.  Earned  hours  were 
calculated  by  multiplying  the  number  of  trans¬ 
actions  completed  by  the  standard  time  for  com¬ 
pleting  the  transaction*.  Actual  hours  vere 
hours  on  the  Job  minus  the  hours  allowed  for 
auch  Items  as  sick  leave,  training  time,  and  so 
forth. 

Standard  hours  for  activities  had  been  estab¬ 
lished  over  the  years  by  *pecial  teams  working 
with  the  managers  and  buyers  ac  each  location. 


All  the  traditional  methods  of  establishing 
time  standards,  including  time  and  motion 
studies,  work  sampling,  nethods-tint  measure¬ 
ment,  statistical  analyst*,  historical  perform¬ 
ance,  and  judgment  have  been  used.  Much  effort 
has  been  expended  establishing  and  revising 
the  standards  and  maintaining  a  data  base  on 
them. 

In  one  public  sector  organization  which  had 
much  higher  user  rating  of  their  efficiency 
measures  than  the  other  public  organization, 
it  appeared  that  the  difference  could  be 
accounted  for  by  the  difference  in  perceptions 
concerning  the  adequacy  of  the  time  standards 
in  each  of  the  organizations.  The  highest 
rated  organization  had  the  most  detailed  time 
standards.  Furthe-more,  the  newness  of  this 
system  may  have  accounted  for  some  of  the 
differences  in  the  ratings. 

Vendor  quality  and  delivery 

Both  vendor  quality  and  delivery  measures  were 
found  in  use.  Characteristics  such  as  dollars 
by  vendors  were  also  measured.  The  vendor 
quality  measures  were:  number  and  percentage 
of  unlts/shipments/dollars  of  purchased  items 
accepted/rejected;  quality  cost  index  *  (total 
value  of  purchased  items  plus  costs  caused  by 
vendor  quality  problems)  divided  by  total 
value  of  purchased  items;  quality  rating 
system  based  on  number  of  quality  problems; 
and  quality  index  »  (number  of  lot6  rejected 
divided  by  number  of  lots  received)  multiplied 
by  (severity  of  the  quality  problem) . 

Vendor  delivery  measures  were  based  on  a  num¬ 
ber  of  pieces,  shipments  or  dollars  that  were 
early,  on  time,  or  late.  The  critical  element 
In  these  measures  was  the  establishment  of 
the  scheduled  due  date  against  which  perform¬ 
ance  was  measured.  Three  basic  approaches 
were  used  in  establishing  the  due  .date:  pro¬ 
mised  delivery  date;  need  date  to  make  user 
schedule;  and  due  date  based  on  requisition 
date,  plus  purchase  time,  plus  vendor  lead 
time,  plus  transit  time. 

It  appeared  that  the  most  effective  vendor 
quality  and  delivery  measurement  systems  were 
those  which  provided  detailed  breakdowns  by 
buyers  and  parts  and  provided  the  ability  to 
measure  vendor  delivery  against  more  than  one 
need  date.  Furthermore,  systems  which  ap¬ 
peared  to  be  effective  assigned  causes  to  the 
types  of  delivery  or  quality  problems. 

Material  flow  control 

Most  of  the  organizations  bad  reports  and 
measures  concerned  with  the  flow  of  material 
from  vendors  to  the  buying  organization. 

These  reports  can  be  classified  Into  four 
functions:  (1)  identification  of  all  open 
purchase  orders  and  their  due  dates;  (2) 
identification  of  past-due  open  orders;  (3) 
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identification  of  material  or  orders  that  are 
needed  immediately  by  manufacturing,  that  is, 
a  hoc  list;  and  (4)  measurement  of  how  well 
purchasing  buyers  and  vendors  nre  doing  in 
meeting  due  dates. 

In  many  of  the  organizations,  functions  (1)  and 
(?)  were  combined  in  the  same  reports.  For  ex¬ 
ample,  a  buyer  might  get  a  weekly  listing  of 
all  open  purchase  orders,  with  overdue  orders 
as  a  percentage  of  the  total  orders.  The  hot 
lict  in  an  organization  was  a  separate  report 
generated  by  manufacturing.  Items  would  appear 
on  the  hot  list  when  manufacturing  was  ready  to 
. Miserable  a  project  and  discovered  a  shortage  in 
the  parts  Inventory. 

The  most  sophisticated  material  flow  control 
reports  showed  projected  manufacturing  require¬ 
ments  by  part  number  by  time  period  (usually 
weekly  or  monthly).  The  promised  delivery 
tine  was  shown  in  the  same  report.  As  manufac¬ 
turing  requirements  and  vendor  delivery  dates 
were  updated,  the  report  would  reflect  these 
changes. 

It  appeared  that  the  moat  effective  systems 
were  tine-phased  material  flow  reports  which 
showed  both  requirements  and  promised  shipments 
over  an  extended  horizon.  This  approach 
allowed  buyers  and  expeditors  to  have  a  look 
into  the  future  and  alleviate  problems  before 
they  became  shortages  in  manufacturing.  Also, 
It  allowed  a  more  systematic  approach  to  ex¬ 
pediting  materials,  allowing  buyers  more  tine 
to  concentrate  on  buying. 

Rcgulatory/socletal/envltonocntal 

These  measures  provided  information  about  pur¬ 
chasing’s  achievement  of  rcgulatory/societal/ 
environmental  goals.  Examples  Included:  (1) 
purchase  dollars  and  percentage  of  purchase 
dollars  places  with  small  and  minority  busi¬ 
ness;  (?)  purchase  dollars  and  percentage  of 
purchase  dollars  placed  In  labor  surplus  areas; 
and  (1)  number  and  percentage  of  minority  em¬ 
ployees  in  purchasing. 

Procurement  planning  and  research 

Various  Indicators  were  categorized  into  the 
broadly  defined  area  of  pr  -.urement  planning 
and  research.  The  measur  i  were  generally  used 
to  monitor  the  amount  of  planning  and  research 
activity  and  its  accuracy.  These  measures  in¬ 
cluded  the  number  of  procurement  plana  estab¬ 
lished  per  year  (including  availability  and 
price  forecasting),  price  forecasting  accuracy 
(actual  to  forecast),  lead-time  forecasting 
accuracy  (actual  to  forecast) ,  and  number  of 
make-buy  studies  completed.  Each  of  these  In¬ 
dicators  was  relatively  straightforward  from  a 
measurement  standpoint. 


Competition 


These  measures  provided  Information  about  the 
extent  to  which  the  buying  organization  was  de¬ 
veloping  competition  in  the  supply  marketplace 
and  improving  purchase  prices  and  terms. 
Measures  included  <itmii.il  purchase  dollars  and 
percentage  of  annual  purchases  on  national, 
area,  or  annual  contracts  and  with  sole  source 
suppliers,  competitive  awards  percentage,  and 
formal  advertised  awards  percentage. 

Inventory 

Inventory  measures  were  found  in  several  of  the 
purchasing  departments  visited.  These  organi¬ 
zations  typically  measured  turnover,  tracked 
consignments,  and  projected  inventory  levels. 
Most  respondents  did  not  receive  and  use  these 
measures  because  Inventory  management  was  not 
their  responsibility.  Therefore,  only  limited 
data  was  obtained  about  these  measures. 

Transportation 

Transportation  measures  were  found  in  three 
purchasing  organizations.  They  were  used  to 
determine  how  much  was  being  spent  on  premium 
transportation  to  obtain  needed  materials  or 
products. 

Purchasing  procedure  audita 

These  indicators  provided  data  about  whether 
purchasing  procedures  were  being  followed  in 
establishing  and  monitoring  contracts  with 
suppliers.  Audit  procedures  varied  between  or¬ 
ganizations  and  included  many  categories  of 
procedural  violations.  Audits  were  conducted 
by  both  purchasing  and  nonpurchaolng  personnel . 

KEY  PURCHASING  MEASURES 

Several  measures  used  to  control  purchasing 
performance  appeared  to  be  key  irdicatots  at 
the  organizations  visited.  These  measures 
were  price  effectiveness,  workload,  cost  sav¬ 
ings,  administration  and  control,  vendor  qual¬ 
ity  and  delivery,  and  material  flow  control. 

The  researchers  consider  these  to  be  key  meas¬ 
ures  because  they  were  extensively  used  and 
the  respondents  considered  them  to  be  most  use¬ 
ful  and  Important,  Managing  price,  the  admin¬ 
istrative  budget,  workload,  assuring  continuity 
of  supply,  and  managing  vendors  effectively 
were  perceived  ns  key  purchasing  objectives, 
and  purchasing  measures  were  developed  and  used 
to  manage  in  these  activity  areas.  Further¬ 
more,  even  though  some  of  the  cost  savings 
measures  were  suspect,  cost  reduction  was 
viewed  as  a  primary  objective  of  purchasing 
needing  moasuri>o''nt. 

Tlie  above  should  not  be  interpreted  to  mean 
that  the  other  purchasing  meaaures  found  were 
unimportant  or  unnecessary,  which  is  not  the 
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case.  All  of  the  purchasing  measures  dls- 
cussed  were  used  to  better  manage  purchasing 
performance. 

STATISTICAL  RESULTS 

The  objectives  of  the  statistical  analysis  were 
to  look  for  systematic  variations  in  the  re¬ 
spondent.  ratings  and  to  find  variables  that 
could  help  explain  the  variation.  Some  of  the 
major  findings  are  discussed  below. 

The  measure  category  with  the  highest  mean  rat¬ 
ing  over  all  respondents  was  price  effective¬ 
ness.  Competition  and  administration  and  con¬ 
trol  were  next  highest  rated,  ignoring  measure 
categories  with  an  insufficient  number  of  rat¬ 
ings.  These  categories  were  rated  high  appar¬ 
ently  because  they  were  well  defined  measures 
that  could  be  easily  understood  and  accepted  by 
purchasing  personnel.  They  measured  activities 
that  are  the  core  of  the  put  chasing  department, 
that  is,  purchase  price  and  administrative  ex¬ 
pense. 

The  lowest  rated  category  was  cost  savings, 
preceded  b  fficlency.  The  low  rating  of  cost 
savings  wa  . pparently  due  to  the  loose  way  in 
which  cost  savings  were  defined  in  many  organi¬ 
zations.  Cost  savings  figures  were  often 
thought  to  be  easy  to  manipulate  and  were 
viewed  skeptically  both  within  and  outside  pur¬ 
chasing.  In  the  few  organizations  with  tight, 
narrowly  defined  cost  savings  measures,  the 
ratings  were  higher.  Low  ratings  for  effi¬ 
ciency  measures  were  due  to  the  low  marks  given 
by  the  public  sector  personnel  to  labor  effi¬ 
ciency  measures. 

Another  significant  finding  was  that  the  re¬ 
spondents  rated  all  measures  low  on  their  use 
for  "group-to-group  (individual-to-indivldual 
and  so  forth)  comparisons"  and  for  "year-to- 
year  comparisons."  This  finding  was  supported 
by  many  of  the  respondents,  who  stated  that 
they  did  not  like  to  be  compared  with  other  in¬ 
dividuals  or  groups.  They  did  realize  the  need 
for  managers  to  evaluate  them  as  part  of  the 
management  process,  but  did  not  like  for  the 
comparisons  to  be  made  public  on  a  regular 
basis.  Furthermore,  they  felt  that  many  of  the 
measures  used  for  comparison  (for  example,  dol¬ 
lars  saved)  could  not  be  taken  at  face  value 
but  had  to  be  considered  in  light  of  the  kind 
of  items  purchased  by  each  individual. 

The  analysis  also  showed  that  organizations  dif¬ 
fered  significantly  in  their  overall  ratings  of 
the  measure  categories.  The  reasons  are  not  en¬ 
tirely  clear.  The  public  organizations  (with 
one  exception)  raced  their  measures  lowest.  The 
firms  with  the  highest  ratings  ware  metal-parts 
fabrication  and  assembly  operations.  In  gen¬ 
eral,  the  private  firms  rated  their  measures 
higher  than  did  the  public. 


Significant  differences  also  were  found  in  the 
ratings  of  managers  and  nonmanagera.  On  ques¬ 
tions  concerning  the  objective  characteristics 
of  the  measures  (for  example,  accuracy  and 
timeliness)  managers  and  nonmanagers  did  not 
differ  in  their  ratings.  However,  on  questions 
concerned  with  uses  of  the  measures  (for  ex¬ 
ample,  comparisons,  usefulness,  Importance)  the 
managers  rated  the  measures  significantly 
higher  than  did  the  nonmanagera.  One  possible 
explanation  vas  that  the  managers  had  developed 
the  measures  and  thus  had  a  greater  commitment 
to  their  use. 

GENERAL  CONCLUSIONS  ABOUT  PURCHASING 
MEASUREMENT 

The  researchers  developed  some  general  percep¬ 
tions  of  purchasing  measurereen-  as  practiced  at 
the  organizations  visited.  These  oerceptiona 
are  not  based  strictly  upon  the  haro  data  col¬ 
lected,  but  are  synthesized  from  the  total  ex¬ 
perience.  We  believe  that  these  conclusions 
arc  as  important  as  the  findings  reported 
earlier.  They  can  be  classified  into  aystems- 
oriented  and  people-oriented  Attributes  of  pur¬ 
chasing  measurement  systems. 

From  a  aystemg-oriented  perspective,  purchasing 
measurement  is  not  free.  There  is  considerable 
cost;  the  development  and  use  of  specific 
measures  and  their  benefits  must  be  weighted 
against  the  cost  of  developing  and  maintaining 
the  system.  In  addition,  a  few  measures  well 
understood  and  narrowly  defined  are  better  than 
a  large  number  of  loosely  defined,  partlslly 
understood  measures. 

Effective  measurement  systems  require  a  good 
data  base  which  is  consistent  and  valid  and 
whicli  all  people  in  the  purchasing  organization 
use.  The  data  base  and  the  measurement  system 
it3clf  must  be  reviewed  periodically  so  that  un¬ 
important  measures  can  be  weeded  out  and  new 
measures  added. 

Furthermore,  there  is  no  one  best  way  to  meas¬ 
ure.  Each  organization  must  conduct  a  detailed 
analysts  of  its  own  situation  to  determine 
which  indicators  ore  needed  and  will  be  most 
effective  in  its  environment,  and  what  the  ap¬ 
propriate  standards  should  be.  The  reporting 
requirements  vary  by  levels  in  the  organization 
and  from  organization  to  organization. 

Lastly,  on»  overall  productivity  meanure  in 
purchasing  is  probably  neither  feasible  nor  de¬ 
sirable.  Multidimensionality  of  the  purchas¬ 
ing  problem,  the  masking  effect  of  overall  pro¬ 
ductivity  measures,  and  the  need  to  separate 
the  components  of  such  a  measure  to  determine 
the  cause  of  chsnges  ell  aiMgete  5g»in*i-  one 
overall  measure. 
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Oveiull  perception*  which  focus  on  the  people 
aspect  of  measurement  Include  the  belief  that 
the  measurement  system  Is  not  a  substitute  for 
good  management.  However,  good  managers  will 
have  and  use  a  good  measurement  system.  Fur¬ 
ther,  communication  Is  Important  In  developing 
effective  systems.  The  goals,  the  measurement, 
and  the  evaluation  process  must  be  thoroughly 
understood  by  all  In  the  organization. 

Effective  use  of  purchasing  measures  requires 
that  they  be  used  to  positively  manage  the  or¬ 
ganization  and  not  be  perceived  as  mechanisms 
U6ed  only  to  punish  people. 
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DESIGNING  T1IF.  SPATIAL  ENVIRONMENT  TO  EFFECT  WORKGROUP 
INTERACTION  AND  IMPROVEMENT  OF  BUSINESS  OPERATIONS 
Bonita  II.  M»lcher,  Cleveland  State  University 


INTRODUCTION 


An  important  area  of  Interest  for  Hie  organi¬ 
zation  designer  is  the  physical  design  of  the 
work  environment  and  how  it  influences  be¬ 
havior  within  the  organization.  Systematic 
attention  to  this  factor  is  a  relatively  new 
area  of  Interest  for  organization  research. 
Physical  environment  is  considered  usually 
of  marginal  concern.  The  manager  typically 
judges  that  It  Is  unimportant  to  evaluate  the 
way  In  which  che  physical  setting  Impacts  on 
behavior.  However,  the  limited  research  that 
has  been  done  reveals  physical  space  has  an 
Important  Influence  on  the  kinds  of  experi¬ 
ences  and  relationships  people  are  having. 

The  following  example  illustrates  this 
point:  [10:5]. 

When  several  executives  in  a  large  corporation 
decided  that  they  wanted  to  work  directly  on 
some  of  their  process  problems,  they  hired  a 
behuvtoral  science  consultant  to  work  with 
them.  After  a  diagnostic  period,  one  of  the 
major  issues  Identified  was  hostility  between 
two  units  of  the  organization.  To  deal  with 
this,  an  off-site  session  at  a  conference 
center  was  attonued  by  most  members  of  the 
group.  They  identified  problems,  causes, 
perceptual  differences,  and  possible  solutions. 
They  agreed  to  work  on  them  over  time. 

When  they  returned  to  work  some  contact  be¬ 
tween  groups  occurred,  hut  It  died  down 
quick!1-,  .,nd  relationships  returned  to  their 
pre-session  state.  One  reason  was  a  lack  of 
resolution  of  fundamental  areas  of  mistrust  at 
the  off-site  session.  Another  was  that  the 
two  group-,  were  located  on  different  floors  of 
a  high-rise  office  building,  so  they  had  little 
informal  contact.  The  distance  separating  them 
resulted  in  few  contacts;  the  motivation  to 
contlr.i.c  to  get  to  know  and  value  the  other 
group's  members  waned  in  competition  with  more 
immediate  day-to-day  contacts.  The  physical 
system  as  well  as  the  social  system  of  the 
rr-anlzation  must  be  considered  changes  in 
the  organization  are  desired.  People  are 
typically  blind  to  the  Impact  of  the  physical 
environment  on  their  day-to-day  lives,  es¬ 
pecially  their  work  lives. 

Several  approaches  In  organization  design  deal 
with  spatial  factors  but  disregard  behavioral 
Implications.  Location  analysts  consider 
costs,  ease  of  performing  basic  tasks,  avail¬ 
ability  of  personnel  snd  congruence  between 
lo.-atlon  and  the  organization's  identity.  In 
many  Instances  location  decisions  are  made  on 


cost  considerations  alone,  with  behavioral  im¬ 
plications  carrying  little  weight  [10:16], 

Another  approach  to  spatial  design  is  office 
landscape  (Burolandachaft)  from  Germany  [9] 
l 31.  The  aim  of  this  approach  ia  specifically 
workflow  oriented.  The  proponents  of  this 
approach  design  "landscapes"  with  paths  and 
areas  after  extensive  studies  of  the  floes  and 
contacts  of  the  system  at  work.  This  approach 
mirrors  what  the  organization  is,  whereas 
organization  designers  are  working  to  bring 
the  system  to  what  it  should  be  with  physical 
changes  being  facilitators  of  this  development. 

Limited  systematic  research  on  the  Impact  of 
physical  settings  on  organizational  behavior 
has  identified  several  aspects  of  the  physical 
environment.  Osmond  [5]  refers  to  those 
factors  that  discourage  interaction  and  stable 
relationships  as  sociofugal  in  character. 

Such  factors  v.  spatial  physical  barriers, 
noise,  bright  lighting,  and  extreme  tempera¬ 
tures  are  sociofugal.  Conversely,  sociopetal 
arrangements  support  and  encourage  development 
of  interaction  and  stable  interpersonal  re¬ 
lationships.  Osmond  describes  spatial  context 
in  terms  of  location,  distance,  and  senl-fixed 
or  fixed  features. 

A  study  of  a  college  dormitory  reveals  some  of 
the  sociofugal-sociopettl  qualities  of  a  nine 
story  complex  [12],  Each  floor  was  sociopetal 
in  character  since  the  residents  ware  physi¬ 
cally  divided  from  other  floors  so  each  floor 
developed  into  a  cohesive  social  group. 

Richards  and  Dobyns  T7]  identified  the  way  in 
which  changes  in  physical  arrangements  in  ai 
office  affect  intragroup  and  intergroup  rela¬ 
tions.  A  small  group  of  employees  in  a  bank 
was  initially  located  in  a  small  enclosed  work 
area  with  its  own  entrance  from  the  outside 
of  the  building.  The  group  of  workers  devel¬ 
oped  a  high  degree  of  cohesion,  a  well  struc¬ 
tured  social  system,  a  sense  of  special  status 
and  of  working  in  a  friendly  atmosphere. 

In  a  reorganization  the  group  was  moved  to 
another  floor  to  a  similar  room  except  that 
the  boundary  was  defined  by  steel  mesh  and 
there  was  no  separate  entrance.  This  arrange¬ 
ment  allowed  the  group  to  be  directly  super¬ 
vised  and  observed  from  outside  the  steel 
mesh.  Increased  stress,  less  satisfaction, 
more  absenteeism,  passive  resistance  to  in¬ 
structions,  a  greater  degree  of  overt  oppo¬ 
sition  and  decline  in  efficiency  developed  in 
ihe  unit  Those  behavior  patterns  could  be 
attributed  to  the  type  of  supervision  and 
elimination  of  special  status,  but  these.  In 
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turn,  were  made  possible  by  the  removal  of  the 
barriers.  The  few  existing  research  studies 
support  the  importance  of  studying  organiza¬ 
tion  design  characteristics:  as  important  de¬ 
terminants  of  behavior  in  organizations. 


THE  STUDY 


An  empirical  study  of  six  organizations  ex¬ 
plored  the  importance  of  spatial  physical 
arrangements  for  determining  work  group  inter¬ 
actions.  Several  structural  dimensions  of 
organizations  ns  well  as  some  characteristics 
of  group  structure  were  included  in  the  study 
to  control  for  other  possible  determinants  of 
interactions.  Structural  dimensions  of  the 
organiz.it  i o\  <:< .  listed  of  the  spatial  physical 
environment  and  the  nature  of  the  work.  Spa¬ 
tial  physical  environment  is  defined  in  terms 
of  distance  degree  of  eye  contact  and  the  ex¬ 
tent  of  physical  barriers  between  individuals 
in  tbe  work  group.  Characteristics  of  the 
nature  of  the  work  considered  were  the  degree 
of  specialization,  existence  of  buffers, 
nobility,  Intensity  of  work  and  degree  of  ex¬ 
ternal  interactions  required  by  the  Job.  Croup 
structural  factors  were  age,  sex,  race,  friend¬ 
ship  and  supervisory  status. 

The  importance  of  spatial  arrangements,  nature 
of  work,  and  group  structural  factors  for 
determining  work  group  interactions  were 
assessed.  The  frequency  of  face-to-face  inter¬ 
actions  between  individuals  were  measured  at 
the  point  of  initiation.  The  frequencies  were 
subdivided  into  task  or  social  related  inter¬ 
act  Iona. 

The  following  model  describes  the  causal  re¬ 
lationships: 

FIGURE  1 

INTERACTION  MODEL 
ORGANIZATION  STRUCTURE 


SPATIAL  PHYSICAL  SETTINGS. 
3ARRIERS  \ 

EYE  CONTACT 
DISTANCE 

NATURE  OF  THE  WORK 
SPECIALIZATION 
BUFFERS 
MOBILITY 

CONCENTRATION  > 

EXTERNAL  INTERACTION^/ 

CROUP  STRUCTURE  / 

AGE 

RACE 

SEX 

FRIENDSHIP 
SUPERVISORY  STATUS 


INTERACTIONS 

TASK 

SOCIAL 


THE  SAHPLE 


The  sample  consisted  of  3lx  different  organi¬ 
zations.  Three  organizations  were  involved  in 
manufacturing  and  three  were  service  organi¬ 
zations.  Samples  of  small  work  groups  were 
obtained  within  each  of  these  organizations. 
The  tasks  represented  in  the  study  were  mostly 
of  a  clerical  and  service  nature.  Eight  hun¬ 
dred  and  sixty  interactions  in  a’ 1  were  re¬ 
corded. 

Data  was  collected  by  observation,  question¬ 
naire  and  self-recording  forms.  Demographic 
facto,  •,  and  factors  concerning  the  nature  of 
the  work  were  obtained  by  questionnaire  from 
oacn  individual.  Spatial  physical  setting 
variables  were  collected  by  obser.'.g  types 
and  numbers  of  barriers  and  by  raeasu-'  .)  dis¬ 
tance.  Interactions  were  tabulated  nn  self- 
recording  forms. 


Table  1  shows  the  results  of  the  step-wise  re¬ 
gression  using  task  interactions  as  the  de¬ 
pendent  variable.  Seven  of  the  variables  were 
significant  at  t  .05.  Friendship  was  the  most 
important  variable  with  a  beta  weight  of  .2?. 
Spatial  physical  barriers  was  the  second  most 
important  variable.  Three  of  the  seven  signif¬ 
icant  variables  were  from  organizational  struc¬ 
ture  and  four  were  from  group  structure. 


TABLE  1 

Task  Interactions  Regressed  on  Organization 
and  Croup  Structure 


Variable  t- 

■test  of  b 

Beta  Weight 

Irlendshlo 

6.07* 

0.22 

Barriers 

3.69* 

0.21 

Supervisory  Status 

5.04* 

0.19 

P.ace 

2.64* 

0.09 

Sex 

2.04* 

0.08 

External  Interactions 

2.07* 

-0.07 

Mobility 

1.86* 

-0.07 

Ag» 

1.46 

0.05 

Distance 

.82 

0 .04 

Specialization 

1.16 

0.04 

Buffers 

.49 

0.0? 

Concentration 

.31 

0.01 

Table  2  shows  the  results  of  the  steo-wloe 
regression  using  sociax  intciafi  -  ns  the 
dependent  variable.  Eleven  vori.it  *-• 

significant.  Spatial  physical  barriers  ex¬ 
plained  the  most  variance  with  a  bein  weight 
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of  .25.  Friendship  followed  closely  with  a 
beta  weight  of  .21.  Again  barriers  was  found 
to  be  a  significant  variable  for  explaining 
Interactions. 


TABLE  2 

Social  Interactions  Regressed  on  Organization 
and  Croup  Structure 


Variable 

t-test  of  b 

Beta  Height 

Barriers 

A. 26* 

0.25 

Friendship 

6.13* 

0.20 

Mobility 

3.92* 

-0.13 

Eye  Contact 

2.85* 

0.12 

Age 

3. A3* 

-0.12 

External  Interactions 

3.39* 

-0.11 

Sex 

2.79* 

0.11 

Race 

3.A2* 

0.11 

Concentration 

3.10* 

0.11 

Buffers 

2.A9* 

-0.08 

Supervisory  Status 

2.09* 

-0.07 

Specialization 

1.5A 

-0.05 

Distance 

.15 

-0.01 

*p<-05 


in  the  last  step  total  interactions  (task  plus 
social)  was  analyzed  using  the  set  of  inde¬ 
pendent  variables.  The  results  of  the  re¬ 
gression  appear  in  Table  3. 


TABLE  3 

Total  Interactions  Regressed  on  Organization 
and  Croup  Structure 


Variable 

t-test  of  b 

Beta  Weight 

Barriers 

A.  60* 

0.27 

Friendship 

7.35* 

0.25 

Sex 

2.87* 

0.12 

Race 

3.55* 

0.12 

Mobility 

3.22* 

-0.11 

External  Interactions 

3.11* 

-0.11 

Age 

3.77* 

-0.10 

Supervisory  Status 

2.58* 

0.09 

Concentration 

1.81* 

0.06 

Eye  Contact 

1.A0 

0.06 

Distance 

0.65 

0.03 

Buffers 

0.90 

0.03 

*p<-05 


Again  barriers  and  friendship  have  the  highest 
beta  weights  with  specialization  not  signif¬ 
icant  at  the  required  level.  Nine  of  the 
Independent  variables  were  significant  at  t 
.05. 


The  correlation  matrix  presented  in  Table  4 
indicates  the  relationships  among  six  variable* 
where  (intercorrelations  were  .AO  or  greater). 


TABLE  A 

Correlation  Matrix  of  Variables 
with  Highest  Intercorrelations 


Barr. 

Dist.  Cont. 

Frnd. 

Supr. 

Stat. 

Sex 

Barriers  1.00 

0.77  -0.66 

0.39 

-0.06 

-0.23 

Distance 

1.00  -0.AS 

0.A0 

0.11 

0.06 

Eye  Contact 

1.00 

-0.32 

0.22 

0.32 

Friendship 

1.00 

0.03 

0.01 

Supervisor 

Status 

1.00 

0.52 

Sex 

1.00 

Barriers  is  highly  correlated  with  distance 
and  eye  contact.  Sex  and  supervisory  status 
are  also  moderately  correlated.  Sex,  distance 
and  eye  contact  do  not  play  significant  roles 
in  the  explanation  of  variance  probably  due  to 
the  multicollinesrity  which  exists  between 
them  and  other  variables  in  the  regression. 

The  multicolinnearity  between  barriers,  dis¬ 
tance  and  eye  contact  results  in  an  unstable 
b  value  for  barriers.  This  is  reflected  in 
the  t  values  presented  in  Tables  1-3  where 
barriers  ha3  a  high  beta  weight  but  not  the 
highest  t  value. 


DISCUSSION  AND  CONCLUSION 


The  results  of  the  study  indicate  that  as  spa¬ 
tial  barriers  increased  both  the  frequency 
and  types  of  interaction  were  adversely  af¬ 
fected.  As  the  type  of  barriers  changed  from 
separation  by  different  floors  to  separation 
by  a  short  distance,  the  frequency  of  both 
types  of  interactions  Increased.  Barriers  was 
the  most  important  variable  for  explaining 
variance  for  total  interactions.  These 
findings  are  consistent  with  the  results  of 
Van  Der  Ryu  and  Silversteln’s  study  of  the 
dona  complex.  The  only  barriers  Investigated 
by  their  study  was  separation  by  floors.  How¬ 
ever,  when  a  fuller  range  of  variables  is 
introduced  this  basic  hypothesis  is  supported. 

The  findings  also  support  Osmond's  theories 
about  the  sociopctal  characteristics  of 
barrleis.  Osmond  tested  his  theories  in  psy¬ 
chiatric  institutions,  airports  and  bars  but 
the  results  are  verified  in  this  study  for 
work  environments  and  for  on-going  groups 
rather  than  chance  groupings  which  often  occur 
In  airports  and  bars. 


Richards  and  Dobyns'  results  are  further  am¬ 
plified  by  the  results  of  this  study  by 
taking  work  environments  and  measuring  actual 
Interactions  between  the.  members  of  the  group. 
While  the  Richards  and  Dobyns'  studies  high¬ 
lighted  the  importance  of  spatial  barriers  for 
the  development  of  group  cohesion,  their 
study  lacked  quantative  measures  of  group 
interaction. 

This  study  highlights  the  importance  of  the 
spatial  setting  in  organizational  design.  The 
industry  application  can  be  generalized  to 
the  program  office  procedures  of  the  pro- 
'urement  environment.  Operations  of  the 
program  office  can  be  improved  by  increasing 
both  social  and  task  interactions.  Results 
o'  industry  studies  indicate  that  both  types 
of  interact! o-'!  "n  be  increased  by  more 
effective  spatial  design. 
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ABSTRACT 


Driven  by  North  Atlantic  Treaty  Organization 
(NATO)  standardization  and  designs  which  pro¬ 
vided  for  interchangeable  and  interoperatabil- 
ity,  near  term  hardware  acquisitions  may  well 
be  procured  from  competing  manufacturers  in  a 
truly  international  type  competition.  While 
policy  is  evolving  to  provide  top  level  guid¬ 
ance  to  control  such  activities,  a  review  of 
current  source  selection  practices  and  proce¬ 
dures  identifies  selected  issues  associated 
with  international  competition  which  are  worthy 
of  address i no.  These  issues  deal  with  a  variety 
of  subjects,  but  this  paper  addresses  only  the 
select,  but  important,  cost  issues.  This  paper 
first  identifies  a  manageable  set  of  important 
cost  issues  and  then  proceeds  to  detail  solu¬ 
tions  to  the  problems  raised  by  the  issues 
themselves. 

From  a  combination  of  exoerience  and  recently 
gathered  research  data,  this  presentation 
examines  the  cost  presentation,  estimating, 
evaluation,  negotiation,  and  reviewing  issues 
associated  with  the  procurement  of  a  major 
international  piece  of  Department  of  Oefense 
hardware.  Included  is  a  look  at  the  proposal 
and  its  peculiar  needs  when  it  is  directed  to 
both  domestic  and  foreign  producers.  Emphasis 
is  on  the  type  of  documentation  and  data  that 
would  be  necessary  for  use  in  evaluating  com¬ 
peting  proposals,  giving  full  considerations 
to  the  very  different  approaches  and  quality  in 
data  of  both  friendly  nations  and  the  United 
States  military  producers.  If  international 
competition  is  to  be  truly  international  with¬ 
out  an  absolute  veto  power  or  final  determina¬ 
tion  on  the  part  of  the  United  States,  then  the 
Source  Selection  Team  for  the  evaluation  and 
recommendations  would  be  international  in  make¬ 
up.  The  evaluation  itself  proposes  problems  of 
placinq  competing  proposals  in  a  comparative 
position  when  different  currencies  and  rates  of 
inflation  exist.  Interchangeability  and  inter- 
operatability  directly  involves  operating  and 
support  costs.  Part;,  which  may  be  interoperat- 
able  and  interchangeable,  are  not  designed  with 
the  same  reliability.  In  evaluating  competing, 
friendly  nations'  proposals  and  the  United 
States  producers'  proposals,  on-site  validation 
of  contractor  data  and  claims  proposes  shear 
geographic  handling  o-  such  validations.  The 
audit  agencies  on-site  and  the  lack  of  audit 
agencies  cn-site  is  ar  example  of  a  problem 
area.  With  the  evaluation  completed,  negotia¬ 
tions  to  clarify  with  the  proposing  contractors, 
cost  technical,  and  other  terms  and  conditions. 


requires  a  reexamination  of  our  own  professional 
training  and  its  limitations  in  an  effort  to 
develop  flexibility  in  our  evaluation  and  for¬ 
mats  which  is  so  vitally  necessary  to  reach  a 
final  source  determination.  Extending  beyond 
the  evaluation  and  negotiation,  the  profession¬ 
alism  must  be  soundly  based  in  order  to  assure 
firm  and  fair  rationale  and  methodology  which 
can  provide  to  the  unsuccessful  offeror  the 
basis  for  the  selection,  wnich  avoids  any  inter¬ 
national  claim  of  "fouls."  Finally,  the  review 
and  approval  cycle  when  tailored  to  Internat’onai 
competition  with  friendly  nations  Is  examined 
to  see  what  pitfalls  exist.  The  review  and 
approval  mechanics  can  be  so  structured  to  accom¬ 
modate  the  interests  of  the  friendly  nations, 
as  well  as  our  own  acquisition  agency. 

The  research  behind  this  paper  has  included 
contacts  with  various  Project/Prc-gram  Managers, 
who  have  been  involved  in  major  end  Item  pro¬ 
curements  with  an  international  flavor.  While 
their  lessons  learned  are  directly  associated 
with  evolutionary  stages  of  international  com¬ 
petition,  we  can  extrapolate  from  this  data  to 
develop  the  issues  identified  in  the  early 
paragraphs  of  this  paper.  This  extrapolation, 
when  analyzed,  presents  a  set  of  preferred 
solutions  based  on  the  writer's  personal  expe¬ 
rience:  i-i  three  major  source  selections.  Th.s 
paper  fi::$  an  apparent  research  void  in  the 
detailed  planning  for  methodology,  rationale, 
budgets,  and  manpower  requirements  associated 
with  true  international  competition. 
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THE  APPLICATION  OF  COST  ACCOUNTING  STANDARDS  TO  FOREIGN  CONTRACTS 

CAPTAIN  JAMES  N.  GIBSON 
HEADQUARTERS  UNITED  STATES  AIR  FORCE 


3  INTRODUCTION 

The  O'  -*t  Accounting  Standards  (CAS)  Board  wan 
established  in  1970  by  Public  Law  91-379-  The 
‘nr  l  was  set  up  in  the  legislative  branch  of 
<!.*■  government  as  on  agent  of  the  Congress 
with  the  function  of  promulgating  "...cost 
accounting  standards  designed  to  achieve  uni- 
tormity  and  consistency  in  the  cost  accounting 
nractiros  followed  by  defense  contractors."  (l) 
>  date,  the  Board  has  Issued  fifteen  stond- 
v is  and  has  published  six  proposed  standards 
th't  ere  currently  out  for  public  review  and 


The  standards  are  basically  applicable  to  all 
negotiated  defense  contracts  in  excess  of 
$100,000.  Negotiated  contracts  which  are 
priced  on  the  basis  of  catalog  or  market  price 
nr.l  prices  set  by  law  or  regulation  are  exclu¬ 
ded.  Certain  other  categories  of  contracts 
are  also  exempt  from  CAS  requirements.  These 
include:  contracts  awarded  to  small  business; 
contracts  awarded  to  Canadian  Commercial  Cor- 
porut 'or ;  contracts  awarded  to  United  Kingdom 
contractors;  certain  contracts  under  $500,000; 
cu.tracts  both  executed  and  performed  outside 
the  United  States;  and  contractc  awarded  to  a 
business  unit  of  other  than  a  small  business 
concern  where  that  business  unit  has  less  than 
pic  million  of  CAT  cohered  contracts  and  CAS 
cvered  contracts  account  fer  less  than  ten 
percent  of  the  business  unit's  sales.  (?) 

\ibj. ic  Law  93-379.  as  implemented  by  CAS  Board 
r o>  ilations,  has  always  been  interpreted  to 
rep. ire  tnat  the  CAS  cluuse  be  included  in 
'•  visru-ts  nnc  subcontracts  negotiated  with 
torelgn  contractors  unless  they  are  otherwise 
e>V>pt  .  o»!iC"  tV  inception  of  CAS,  the 
'vpa.-tnen  of  Defense  ’ TOD )  I  as  experienced 
!i  ffleultlos  iti  obtaining  CAS  acceptance  and 
■  ompli'uice  fro’  foveigr.  governments  and  con- 
torr.  LniLe  the  exemptions  for  contracts 
awarded  to  the  Cunad i an  Comrorcial  Corporation 
a:  d  United  Kingdom  contractor1-  save  helped 
streamline  the  contracting  process  with  firms 
in  those  countries,  contractors  in  other 
countries  are  required  t>  omply  wit.)  CAS  to 
the  ..amo  degree  as  contr  .-tors  m  thic  country. 
The  implementation  of  all  the  CAS  Board  stand¬ 
ards,  >ules,  and  regulations  In  these  foreign 
countries  requires  a  great  amount  of  effort 
by  both  t'.S.  and  foreign  personnel.  Because 
collaborative  programs  in.olviig  foreign  con¬ 
tractors  are  expected  to  Increase  in  the 
future,  there  i3  much  concern  about  the  prac¬ 
ticability  and  necessity  of  expending  such  a 
large  amount  of  effort  to  ia.pl cment  CAS  on 


each  foreign  contract,  (3) 

There  are  a  number  of  issues  which  arise  when 
implementing  CAS  on  ‘‘oreign  contracts,  fie 
most  important  are  sovereignty,  conflicting 
national  laws  or  regulations,  administration, 
lack  of  a  legal /regulatory  framework,  and 
benefit.  The  author's  experience  with  these 
issues  in  recent  I)QD  efforts  to  implement  CAS 
overseas  has  led  him  to  conclude  that  requir¬ 
ing  full  CAS  compliance  is  not  appropriate 
foi  '■oreign  contracts.  This  paper  discusses 
the  issues,  briefly  looks  at  the  present 
approach  of  full  CAS  implementation,  and  sug¬ 
gests  two  alternatives  that  voul  .  facilitate 
the  contracting  process. 

THE  ISSUES 

The  first  issue  to  be  discussed  is  national 
sovereignty.  Foreign  contracts  are  performed 
by  foreign  contractors,  in  foreign  coiaitries. 
The  governments  of  these  countries,  and  their 
countractors,  are  often  opposed  to  the  impo¬ 
sition  of  U.S.  Jaw3  and  regulations  on  their 
contracts.  They  maintain  that  th*-  United 
States  has  no  sovereignty,  and  therefore  no 
legal  right  to  impose  these  requirements  on 
such  contracts.  This  argument  has  been  put 
forth  most  strongly  on  cooperative  effort  pro¬ 
grams  where  the  United  States  and  foreign  gov¬ 
ernments  are  Jointly  funding  a  program  and  the 
United  States  is  acting  as  an  agent  or  partner. 
The  foreign  governments  have  suggested  that  if 
every  nation  participating  in  a  c  llaborative 
program  were  to  insist  on  imposing  their  own 
laws  and  regulations  on  each  ether,  an  agree¬ 
ment  would  never  be  reached.  V'lth  the 
increased  interest  in  collaboration  on  major 
programs,  this  issue  has  become  even  more  3ig- 
ni f icnnt. 

A  second  issue  has  to  do  with  the  laws  and  reg¬ 
ulations  of  foreign  countries.  Foreign  con¬ 
tractors  are  required  to  comply  with  the  pro¬ 
curement,  accounting,  and  tax  ■  *  and  regula¬ 

tions  of  their  respective  nati<  Their  nor¬ 
mal  business  and  accounting  practices  are  cast 
within  the  framework  of  these  laws  and  regula¬ 
tions.  To  date  it  has  generally  been  U.S. 
policy  to  superimpo.,c  cost  accounting  standards 
on  foreign  contractors  to  the  extent  that  their 
own  national  laws  or  regulations  do  not  prohil  -• 
it  them  from  complying  with  CAS.  This  approach 
tends  to  ignore  the  practical  question  of  com¬ 
patibility.  It  is  one  thing  to  say  that  for¬ 
eign  laws  do  not  prohibit  the  application  of  a 
CAS  Board  standard  or  requirement ,  an i  yet 


(1)  >i  C.-H  301.2 
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another  to  say  that  CAS  is  compatible  with  contract,  or  a  prime  contractor  issuing  a 

foreign  laws,  regulations  and  business  prac-  foreign  subcontract,  is  required  by  U.S.  law 

tices,  or  that  CAS  will,  in  fact,  be  effec-  to  flow  down  CAS  if  applicable.  However, 

tively  implemented.  there  are  not,  as  yet,  any  laws  in  foreign 

countries  which  compel  foreign  contractors 

The  third  areu  for  consideration  is  CAS  imple-  or  governments  to  comply  with  Cost  Accounting 

mentation  and  administration.  Many  of  the  Standards  Board  rules  and  regulations,  nor 

standards  are  luite  sophisticated.  U.S.  gov-  is  there  an  established  regulatory  framework, 

ernment  and  U.S.  industry  personnel  have  CAS  must  be  implemented  by  mutual  agreement 

frequently  disagreed  with  each  other,  and  among  01'  t'ie  parties  via  a  contract  clause  or  memo- 

thenselves,  on  exactly  what  was  intended  by  a  rondum  of  understanding.  Where  a  foreign  con- 

particular  CAS  requirement.  In  spite  of  those  tractor  or  government  unequivocally  refuses 

disagreements,  cost  accounting  standards  have  CAS,  the  U.S.  agent  does  not  have  the  leverage 

been  successfully  implemented  in  some  locations  iaw  to  require  compliance;  neither  does  the 

in  the  United  States.  But,  this  successful  U-S-  agent  have  waiver  authority.  The  desire 

implementation  has  been  due  primarily  to  close,  f°r  business,  previous  business  relationships, 

timely  face-to-face  cooperation  between  U.S.  or  other  factors  are  the  only  motivators  left 

government  and  U.S.  contractor  personnel — per-  Cor  effecting  compliance  with  U.S.  public  law. 

sonnel  who  are  knowledgeable  with  respect  to  Absent  these  motivators,  a  waiver  must  be 

cost  accounting  standards  and  the  contracting  sought.  Thus,  without  an  established  legal 

process.  This  typo  of  cooperation  is  frequent _  an<l  regulatory  framework  n3  a  base,  the  U.S. 

ly  hindered  on  foreign  contracts.  First,  there  contracting  agent  is  in  a  perilously  weak 

are  language  differences  to  overcome,  and  negotiating  position  to  effect  acceptance  ol 

perhaps  more  significantly,  the  circumstances  CAS- 

surrounding  the  contract  or  subcontract.  Many 

recent  foreign  contracts  and  subcontracts  are  Finally,  recent  experience  indicates  that  the 

the  result  of  international  cooperative  pro-  implementation  of  CAS  for  foreign  governments 

grams.  When  the  United  States  enters  into  and  contractors  is  administratively  burdensome 

these  programs,  foreign  governments  may  insist  an<*  costly.  In  the  past  three  years,  U.S.  gov- 

as  a  condition  of  the  program  that  their  ernment  personnel  permanently  assigned  to  the 

national  auditors  perform  audits  on  their  own  Washington,  D.C.  area  have  expended  over  150 

contractors,  permitting  United  States  person-  man-days  of  travel  overseas  solely  to  resolve 

nel  to  observe  only.  While  these  agreements  CAS  implementation  and  administration  problems, 

nay  permit  U.S.  auditors  to  conduct  on  audit  This  does  not  include  time  expended  by  these 

in  extraordinary  circumstances,  they  nonethe-  personnel  on  foreign  problems  while  in  the 

less,  limit  visibility  of  U.S.  contract  admin-  United  States,  nor  doe3  it  consider  time 

i3tration  and  audit  personnel.  Foreign  gov-  expended  by  U.S.  government  personnel  peroan- 

err.ment  and  industry  personnel  cannot  be  ently  assigned  overseas.  Attendance  at  over¬ 
expected  to  be  as  knowledgeable  or  highly  seas  CAS  meetings  by  foreign  government  and 

motivated  about  implementing  a  United  States  contractor  personnel  and  cognizant  U.S.  prime 

law  as  are  their  counterparts  in  the  U.S.  contractors  indicates  that  they  are  also 

While  there  is,  as  yet,  little  experience  In  expending  considerable  cost  and  effort  in  try- 

this  area,  it  appears  that  it  may  prove  imprac-  ing  to  implement  CAS. 

ticable  to  impose  cost  accounting  standards  in 

situations  where  overall  program  and  political  CURRENT  TRENDS 

considerations  limit  the  ability  to  implement 

and  administer  CAS.  Foreign  procurements  are  expected  to  increase 

substantially  in  the  future  due  to  increased 

The  fourth  i3sue  embraces  elements  of  the  three  emphasis  on  collaborative  programs  between  the 

proceeding  areas  and  is  a  causal  factor  in  United  States  and  its  allies  for  major  weapons 

their  existence.  This  issue  deals  with  the  systems.  Public  Law  9IJ-361,  as  implemented  by 

basic  framework  in  which  CAS  is  implemented  the  Department  of  Defense,  has  resulted  in  the 

and  administered.  In  the  United  States  the  NATO  Standardization/Interoperability  program. 

Congress  passed  a  law  establishing  a  Board  to  This  program  reflects  national  policy  and  will 

promulgate  cost  accounting  standards.  The  likely  stimulate  increased  foreign  purchases. 

Department  of  Defense  implemented  this  law  in  Economic  trends  are  also  encouraging  more  inter- 

its  contracting  regulations.  By  law  and  regu-  national  collaboration  for  defense  products, 

lation,  defense  contractors  in  the  U.S.  are  The  trend  in  cost  accounting  standards  is  also 

required  to  comply  with  these  standards  on  all  upward.  The  CAS  Board  presently  has  six  pro- 

applicable  defense  contracts  and  also  flow  posed  standards  out  for  comment  and  a  list  of 

down  CAS  requirements  to  subcontracts.  Con-  projects  waiting  in  the  wings, 

tractlng  agencies  have  an  established  legal/ 

regulatory  framework,  and  the  ieverage  that  Kith  the  prospects  of  more  foreign  contracting 

it  provides,  to  support  their  implementation/  ahead,  the  DOD  must  do  all  it  can  to  facilitate 

administration  efforts  for  domestic  contracts.  the  acquisition  process  while  still  providing 

The  situation  is  somewhat  different  for  the  adequate  protection  for  U.S.  taxpayer  dollars, 

foreign  contract.  The  U.S.  contracting  agent,  CAS,  in  spite  of  foreign  resistance,  has  con- 

be  it  the  government  issuing  a  foreign  prime  tributed  to  greater  visibility  of  foreign 
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acc  citing  practices.  Attempts  to  impose  CAS 
ini  .-’ther  requirements  have  generated  much  dis¬ 
cussion  with  U.S.  allies  overseas  regarding 
their  accounting  practices.  This  does  not 
imply  that  foreign  governments  have  changed 
their  laws,  or  that  foreign  contractors  have 
improved  their  accounting  practices  as  a  result 
.f  CAP.  However,  the  very  problem  itself  has 
forced  some  beneficial  communication  between 
the  parties.  We  may  also  assume  that  if  CAS 
could  be  fully  implemented  overseas  that  we 
might  ultimately  enjoy  better  visibility  of 
contract  costs  and  more  reliability  in  contrac¬ 
tor  coat  estimates;  two  benefits  we  have 
experienced  to  some  degree  on  domestic  con- 
’-r lets.  However,  the  controversies  regarding 
r  U  CAS  implementation  raise  a  question  regard¬ 
ing  b  .th  the  method  and  desirability  of  the 
prosei  *  •siP  imo’ementatlon  policy. 

THE  CUHREHT  POLICY 

The  present  policy  of  full  CAS  implementation 
has  the  potential  advantages  of  greater  cost 
visibility  and  more  reliable  contractor  cost 
estimates.  However,  if  it  is  the  intent  of 
C  tigress,  and  tile  CAS  Board  that  Public  Law 
31-379  be  fully  implemented  overseas,  then 
several  basic  changes  must  be  made.  First, 
tne  CAS  Board,  as  the  Congressional  agent  for 
'AS  should  he  clearly  charged  with  responsi- 


w 

bility 

ir  ‘ 

meats; 

peb 

find  as: 

W  ' 

ing  thi 

1 ' 

work. 

p  j 

'•}•  its 

on  a  f< 

e'Tort'i  should  bo  coordinated  with  Department 
<  f  State,  Department  of  Defense,  and  other 
inplienble  U.S.  government  agencies.  Clear 
understandings  should  be  established  between 
the  U.S.  government  and  foreign  governments  as 
*■;  what  standards  will  apply  to  foreign  con¬ 
tracts  as  we] ;  as  how  they  will  be  implemented 
and  enforced.  This  is  not  offered  os  a  casual 
suggestion.  CAS  was  effectively  implemented  in 
the  United  Stater,  because  first,  a  base  was 
established  in  law  and  an  agent  was  set  up  to 
implement  the  law.  For  CAS  to  be  effectively 
implemented  overseas,  similar  action  is 
required  for  foreign  governments.  The  present 
arrangement  of  contractua1 ’y  requiring  full  CAS 
implementation  overseas  -hout  the  legal/ 
regulatory  framework  has  -.laced  U.S.  contract¬ 
ing  personnel  in  the  position  of  "promulgating" 
CAS  for  foreign  contractors  and  governments. 
U.S.  contracting  personnel  should  not  be 
responsible  for  effecting  such  "promulgations," 
especially  when  there  is  no  legal  or  regulatory- 
basis  for  them  to  enforce  compliance. 

Tf  full  CAS  implementation  is,  in  fact,  the 
U.S.  Government ' s  Intention  with  respect  to 
foreign  contractors  ami  governments,  then  the 
approach  described  above  is  the  appropriate 
method  <  f  pursuing  that  implementation.  IP  •- 
ever,  t!e  road  to  implementation  will  likely  he 


a  long  one.  It  is  this  author's  opinion  ti 
full  compliance  is  neither  realistic  nor 
necessary  in  the  international  environment . 

A  more  reasonable,  practicable  approach  is 
needed  which  provides  a  long-term  policy  an: 
also  deals  with  the  immediate  short-term  pro* - 
lems.  There  are  two  options,  short  of  full 
compliance,  that  could  eliminate,  or  at  least 
reduce,  the  current  problems. 

ALTERNATIVES 

The  first  option  is  total  exemption  of  CAS  for 
all  foreign  contracts.  This  has  several 
advantages:  it  effectively  eliminates  the 
controversies  discussed  earlier  in  this  paper; 
it  avoids  the  future  problems  we  would 
encounter  if  we  continue  trying  to  impose  CAS 
overseas;  it  eliminates  the  administrative 
costs  and  burdens  of  foreign  CAS  I” n,  (denta¬ 
tion  and  administration  for  the  governm  rts 
and  contractors  involved;  and  finally,  it  is 
easily  implemented,  requiring  only  one  sen¬ 
tence  in  paragraph  331.30(b)  of  the  CAS 
Board's  regulations.  The  primary  disadvantage 
to  this  approach  is  the  possible  lost  poten¬ 
tial  for  increased  cost  visibility  and  more 
reliable  cost  estimates. 

Tne  second  option  is  the  application  of  the 
CAS  Board '3  Modified  Contract  Coverage  to 
foreign  contracts.  This  would  basically 
require  foreign  contractors  to  disclose  their 
accounting  practices  under  the  same  conditions 
as  U.S.  contractors  and  comply  with  two  almost 
axiomatic  accounting  requirements.  They  would 
have  to  estimate,  accumulate,  and  report  costs 
consistently  as  required  by  CAS  A 01 ,  and  con¬ 
sistently  allocate  costs  incurred  for  the 
same  purpose  us  required  by  CAS  HO This 
approach  has  several  uppenling  leatures:  it 
acknowledges  the  primary  purpose  of  the  CAS 
legislation,  accounting  consistency;  it  estab¬ 
lishes  a  base-line  for  all  future  foreign 
contracts  and  eliminates  the  problems 
associated  with  introducing  new  standards  when 
they  come  out;  it  allows  for  differences  in 
individual  countries'  accounting  laws  and 
practices;  and  finally,  it  is  easily  imple¬ 
mented  since  all  the  machinery  already  exists 
in  Part  33?  of  the  GAS  uoord  regulations;  it 
need  only  be  mode  available  to  foreign  con¬ 
tracts  Tills  approach  does  have  a  major  dis¬ 
advantage.  Many  of  the  arguments  against  fnl  : 
CAS  iO’-erage,  f-pecially  national  sovereignty, 
aie  equally  appl'csblc  to  '’he  Modified  Con¬ 
tract  Coverage.  Thus  it  may  provide  only 
partial  relief  from  the  problems. 

CONCLUSION 

The  ultimate  goal  of  any  acquisition,  foreign 
or  domestic,  is  to  obtain  the  needed  goods  or 
services  at  fair  a...  *  iccn.ii  1  >•  -  ~"5.  In 

the  international  contracting  t:  •. 

U.S.  policies  must  protect  U.S.  interests  (  it 
at  the  same  time  recognize  the  interests  of 
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other  countries.  If  every  nation  participating 
in  a  eollabox-ative  defense  acquisition  program 
were  t>.  insist  on  imposing  all  their  applicable 
national  laws  and  regulations,  an  agreement 
would  never  be  reached.  It.  is  unreasonable  and 
impracticable  to  insist  that  CAS  lie  fully 
implemented  on  foreign  contracts.  This  author 
believes  that  tile  requirement  for  full  CAS 
implementation  should  be  eliminated.  U.S. 
interests  can  be  adequately  protected,  and 
the  problems  attendant  to  foreign  CAS  imple¬ 
mentation  and  administration  eliminated  or 
reduced,  by  implementing  one  of  the  two  alter¬ 
natives  suggested.  Total  exemption  would 
greatly  facilitate  the  contracting  process  and 
business  relations  in  the  international 
environment.  Modified  Contract  Coverage  would 
provide  partial  relief,  while  recognizing  the 
CAS  law's  basic  consistency  requirements. 

Either  of  these  options  are  easily  implemented. 
Experience  indicates  that  attempts  to  Impose 
requirements  beyond  these  alternatives  becomes 
significantly  more  difficult  to  explain, 
negotiate,  administer  and  enforce. 
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A  CONCEPT  PAPER  ON  TOMORROW: 

ACQUISITION  AND  SUPPORT  OF  THE  TOTAL  FORCE 

Captain  Robert  D.  Materna,  Air  Force  Acquisition  Logistics  Division 
Wright-Patterson  AFB,  Ohio 


PREFACE 

This  article  is  a  by-product  of  a  considerable 
amount  of  research  conducted  by  personnel  from 
the  Air  Force  Acquisition  Logistics  Division 
(AFALD)  into  the  field  of  International 
Logistics.  Within  the  AFALD  it  had  become 
apparent  that  recent  trends  in  International 
i.ogi sties  were  causing  numerous  new  and 
uniqup  management  problems  associated 
primarily  with  the  acquisition  and  support  of 
new  systems  Ac'ordingly,  a  study  was 
directed  to  systematically  identify  exactly 
what  v/as  causing  these  problems,  followed  by 
recommended  action  for  achieving  near,  mid, 
and  long  term  solutions.  The  study  team 
attempted  to  follow  a  scientific  problem 
solving  process,  but  as  in  many  real  world 
situations  the  most  difficult  task  was  in 
defining  the  problem.  As  the  study  progressed, 
however,  it  became  apparent  that  many  of  the 
problems  resulted  from  the  fact  that  the 
Department  of  Oefense,  as  well  as  civilian 
industry,  lacked  a  comprehensive  set  of 
procedures  for  meeting  these  new  trends.... 
making  it  extremely  difficult  to  carry  out 
some  of  cur  latest  foreign  policy  commitments. 
This  realization  stimulated  further  research 
into  Uf.  planning  for  the  future,  which  in 
turn  led  to  this  paper  on  acquisition  and 
support  of  the  Total  Force.  Coincidentally, 
the  results  of  this  research  are  appropriate 
■'or  the  theme  "Working  Tomorrow's  Contracting 
and  Acquisition  Systems  Today".  Indeed,  the 
findinns  of  the  study  indicate  that  if  we  are 
to  achieve  the  security  needs  of  the  future, 
it  is  imperative  that  the  Department  of 
Defense,  as  well  as  the  commercial  sector, 
structure  their  planning  around  the  concepts 
addressed  in  this  paper.  The  following 
discussion  is  a  summary  of  the  key  elements 
of  this  extremely  complex  am!  overwhelming 
concept  which  is  being  developed  in  substantial 
detail  to  be  published  this  summer. 

THE  CO"  TPT 


Let  us  begin  by  defining  exactly  what  is 
meant  by  the  term  "Total  Force".  Total  Force 
is  defined  as  the  sum  total  of  active  and 
reserve  components  of  the  United  States,  those 
of  our  allies,  and  the  additional  military 
capability  of  our  allies  and  friends  made 
available  through  local  efforts  or  through 
provisions  of  appropriate  security  assistance 
programs.  The  Total  Force  concept  is  expressed 
as  a  Department  of  Defense  policy  which 
recognizes  all  components  contributing  to 
the  de'errence  of  war  and  protection  of  United 


States  national  security  interests.  The 
objective  of  this  policy  is  to  insure  that 
an  appropriate  balance  is  achieved  throughout 
all  phases  of  planning,  programming,  manning, 
equipping,  and  employing  the  components  of 
the  Total  Force,  so  that  United  States 
nononal  security  objectives  can  be  most 
effectively  •  efficiently  achieved  (4:39). 

Given  the  above  definition  and  a  clearly 
stated  objective,  the  question  then  uecomes: 
How  does  one  insure  that  an  appropriate 
balance  is^  achieved  throughout  all  phases  oi 
planniny,  programming,  manning,  equipping,  and 
employing  the  respective  components  of  the 
Total  Force?  The  answer  of  course,  is  through 
international  cooperation  ...  disciplined 
and  resolute  cooperation  tnolivuted  by  the 
very  survival  of  the  components.  Although  at 
this  time  there  may  be  no  "Master  Plan"  for 
acquiring  and  supporting  systems  on  a  fully 
cooperative  basis,  there  are  many  indications 
that  top  level  policy  makers  are  moving  in 
this  direction.  Key  concepts  such  as 
"interoperabi 1 i ty" ,  "standardi zation" , 
"codevelopment",  "coproduction",  and 
"cooperative  iogistics"  are  bringing  the 
United  States  levels  of  magnitude  closer  to 
the  other  components  of  the  force.  President 
Carter's  proposal  to  NATO  in  May  m  1977 
provided  a  vital  stimulus  to  this  concept 
v/nen  he  called  for  improvements  in  coordinated 
national  efforts,  and  emphasized  the  impor¬ 
tance  of  improved  cooperation  in  the  develop¬ 
ment,  production,  and  procurement  of 
standardized  alliance  defense  equipment.  In 
response  to  this  proposal,  the  defense 
ministers  developed  short  and  long  term 
initiatives  highlighting  cooperative  defense 
improvements.  Without  going  into  detail 
on  the  content  of  each  initiative,  let  it 
suffice  to  say  that  each  task  addresses  a 
deep  concern  within  NATO  ranging  from  the 
preparation  of  collective  need  statements 
to  improved  iogistics  support  procedures. 
Closer  to  home,  Secretary  of  Defense  Brown 
recently  issued  a  new  DOD  Directive  2016.6, 
Standardization  and  Interoperability  of 
Weapon  Systems  and  Equipment  within  the  North 
Atlantic  Treaty  Organization  (NATO),  and 
has  requested  the  services  to  examine  and 
rerort  on  opportunities  for  more  conmon  RSD, 
greater  interoperability  and  standardization, 
and  for  buy'ng,  licens  ng,  or  co-producing 
European  as  us  tej'p ‘ '  creatp 
more  of  a  two  way  street  £2:5-1'  ■  - 
iritiatives  are  certainly  important  but  ..ut 
lotal  Force  Concept  ->s  not  limited  to  NA’O, 
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and  this  fact  alone  requires  a  significant 
expansion  in  thought. 

What  this  all  adds  up  to  is  that  new  trends 
are  upon  us,  and  comprehensive  reforms  are 
necessary  in  our  acquisition  and  support 
procedures.  The  first  step  must  be  to 
establish  a  cooperative  requirements  process 
for  identifying,  evaluating,  and  prioritizing 
collective  operational  requirements  to 
justify  the  initiation  of  major  system 
acquisitions.  This  process  should  identify 
the  area;  project  the  threat;  identify 
existing  capabilities  to  meet  the  threat; 
identify  deficiencies  in  that  existing 
capability;  identify  constraints;  assess 
the  impact  of  not  acquiring  or  maintaining 
that  capability;  and  lastly,  establish  a 
plan  for  developing  and  acquiring  systems 
to  meet  the  proposed  threat.  Already  we 
are  seeing  evidence  that  this  is  beginning  to 
happen.  Within  the  DOD  we  have  seen  signif¬ 
icant  changes  in  our  requirements  process 
which  require  us  to  consider  existing 
sources  outside  the  United  States.  On  the 
other  extreme,  we  also  have  procedures  for 
developing  systems  specifically  to  meet 
foreign  needs. 

We  are  all  familiar  with  foreign  governments 
purchasing  US  goods  and  services  to  meet  their 
defense  requirements,  but  we  have  not 
frequently  seen  the  opposite  take  place.  If 
we  are  serious  in  our  efforts  to  support  the 
Total  Force  concept,  we  will  all  be  seeing 
nxjre  of  tnis  as  we  continue  to  seek  collective 
solutions  to  meet  common  needs. 

The  second  major  element  in  this  overall 
system  must  be  to  develop  a  cooperative 
acquisition  process  for  converting  these 
needs  into  articles  and  services.  This 
process  should  follow  a  logic  similar  to  that 
of  the  US  acquisition  process  consisting  of 
well  defined  phases,  separated  by  key 
decision  points.  This  cooperative  acquisition 
process  should  be  tiered,  consisting  of 
sequential  levels  of  cooperative  Involvement 
ranging  from  cooperative  development,  through 
various  stages  of  licensing  and  cooperative 
production. 

With  some  restrictions,  practically  every  new 
tactical  system  being  acquired  by  the  US  is 
subject  to  consideration  for  some  degree  of 
cooperative  activity.  Perhaps  the  most  noted 
example  is  the  multinational  F-16  US/EPG 
Program.  In  fact,  Secretary  of  the  Air  Force 
Stetson  noted  that  many  foreign  governments 
view  the  outcome  of  this  arrangement  as  a 
test  of  US  sincerity,...  and  are  looking  to  it 
as  a  demonstration  of  US  willingness  to 
cooperate  (3:56).  Numerous  other  examples  of 
coproduction  could  be  discussed,  but 
unquestionably  the  precedent  for  cooperative 
acquisition  has  been  set.  Let  us  now  proceed 
to  discuss  the  third  element  of  this  overall 


system. 

The  last,  and  possibly  most  complex  process, 
Involves  establishing  and  maintaining  an 
effective  cooperative  logistics  support  base. 

To  develop  such  a  system  would  require  extra¬ 
ordinary  effort  to  plan,  negotiate,  and  imp! e- 
nient  cooperative  supply  support  procedures, 
cooperative  maintenance  plans,  cooperative 
facilities  plans,  cooperative  technical  data 
management  programs,  cooperative  transporta¬ 
tion  and  handling  plans,  cooperative  training 
programs,  and  an  extensive  management  informa¬ 
tion  system,  to  mention  just  a  few.  Specific 
examples  within  each  of  these  area  could  be 
discussed  at  great  length;  however,  let  it 
suffice  to  say  that  the  task  of  establishing 
an  effective  and  truly  cooperative  logistics 
system  is  overwhelming. 

Although  the  underlying  theories  expressed  In 
this  concept  are  not  new,  the  overall  concept 
is  so  complex  that  volumes  could  be  written 
about  the  advantages,  disadvantages,  and 
potential  implications  of  each  element  of  the 
process.  To  be  sure,  this  relatively  simple 
concept  is  fraught  with  difficulties.  To 
mention  just  a  few  would  include  the  realities 
of  group  decision  making;  existing  legal 
restrictions;  fluctuations  in  currency; 
different  funding  processes;  the  release  of 
proprietary  information;  the  dissemination  of 
technical  information;  delays  in  feasibility 
studies;  differences  in  threat  estimations; 
and  the  basic  fear  of  losing  jobs  to  foreign 
competitors  (1:51-52;  2:11-12).  Against  these 
very  real  concerns  we  must  weigh  the  advan¬ 
tages  of  International  cooperation.  In 
addition  to  obvious  advantages  in  doctrine  and 
operational  employment  a  natural  by-product 
of  this  process  would  be  built  in  interopera¬ 
bility  and  standardization.  There  would 
certainly  be  economic  benefits  resulting  from 
increased  economic  order  quantities,  and 
the  multiplier  effect  could  become  extraordi¬ 
narily  effective. 

Despite  numerous  disadvantages  and  advantages 
to  this  concept,  the  bottom  line  is  that  we 
really  do  not  have  any  choice.  The  time  is 
right  to  follow  the  administration’s  bold  and 
innovative  proposals  and  to  establish 
procedures  for  collectively  identifying, 
acquiring,  and  supporting  common  needs  of 
the  Total  Force.  To  be  sure,  the  intent  of 
this  proposal  is  not  to  proliferate  the 
acquisition  and  sale  of  arms  ...  but  rather 
to  reduce  Inefficiency  and  the  unnecessary 
use  of  resources  which  could  be  otherwise 
dedicated  to  achieving  other  national  or 
international  objectives. 

SUMMARY 


The  theme  of  this  paper  can  be  sunned  up  by 
stating  ...  as  we  look  to  the  future  we  can  no 
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longer  afford  the  luxury  of  procuring  and 
supporting  hardward  Individually.  We  cannot 
afford  to  do  it  in  the  US  Air  Force,  US  Army, 
US  Navy,  or  US  Marines.  We  cannot  even 
afford  to  do  it  across  the  US  Department  of 
Oefense.  We  must  look  to  how,  when,  where, 
by  whom,  and  why  new  systems  will  be  used  and 
as  we  do  so  it  becomes  obvious  that  the 
answer  lies  in  the  Total  Force  policy.  In 
much  the  same  manner  as  we  have  seen  an 
evolutionary  shift  from  Grant  Aid  to  Foreign 
Military  Sales,  we  are  now  experiencing  a  new 
trend  toward  increasing  international 
cooperation.  Therefore,  as  we  seek  solutions 
to  meet  the  needs  of  the  future,  we  cannot 
fail  to  accept  this  very  real  concept  on 
toifior'‘Ow. 
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ABSTRACT 


This  is  an  analysis  of  the  evolution  of  multi¬ 
national  collaboration  for  defense  procuranent 
amongst  the  15  members  of  the  North  Atlantic 
Alliance,  in  order  to  provide  historical  depth 
and  a  broader  perspective  for  present  and  future 
developments  in  this  area.  Particular  attention 
will  be  given  to  the  nature  of  the  environment 
and  the  accumulation  of  experience  in  the  orga¬ 
nization  and  management  of  multinational  con¬ 
sortia  and  licensing  arrangements. 

The  roots  of  the  problems  facing  Alliance  col¬ 
laboration  in  defense  procurement  research  to 
the  very  core  of  the  International  political 
order--natiorial  sovereignty,  and  its  manifesta¬ 
tions  in  national  defense  and  national  economic 
policies.  The  tariff  liberalization  in  Europe 
starting  in  the  late  ‘50s  led  to  the  need  to 
develop  non-tariff  instruments  of  national 
policy  (large  national  finns  in  either  public 
or  private  ownership)  in  promoting  national 
welfare  and  development  and  the  necessity  of 
concentrating  national  industries  through  mergers 
so  as  to  better  deal  with  the  increased  exposure 
to  foreign  competition.  This  has  meant  that  the 
national  state  industry  relationships  have  taken 
on  an  increasing  particularism  as  they  have  moved 
toward  more  of  a  one-to-one  correspondence,  often 
resulting  in  structural  rigidities  that  hinder 
transnational  collaboration  and  the  efficient 
reallocation  of  resources  internationally  (i.e.« 
greater  economic  integration). 

In  Alliance  armaments  collaboration  there  must 
be  compatibility  of  industry-to-industry, 
government-to-goverre^ent,  and  industries-to- 
governments.  Collaboration  can  be  blocked  by 
any  one  of  the  four  (or  more)  parties'  narrowly 
defined  perception  of  self-interest  in  its  inter¬ 
nal  or  external  markets  or  its  national  defense 
requirements.  The  defense  procurement  environ¬ 
ment  of  each  ally  is  unique  and  may  limit  cr 
foreclose  the  leverage  of  the  other  governments 
and  firms.  Each  part  is  thus  faced  with  a 
higher  than  normal  degree  of  risk  and  uncertainty 
due  to  greater  exposure  to  the  unilateral  actions 
of  any  one  of  the  foreign  participants. 

Therefore,  with  the  U.S.  aerospace/defense  Indus¬ 
try  dominant  in  the  world  market  generally,  and 
its  largest  single  market  in  particular  (the  U.S, 
market),  it  is  natural  that  there  is  only  limited 
interest  in  taking  on  the  extra  risks  and  loss  of 
sales  involved,  simply  in  order  to  gain  access 
to  Europe's  smaller,  less  penetrable  markets . 
Although  the  Europeans  need  access  to  the  U.S. 
market,  they  have  less  to  offer  in  return,  across 


the  board.  It  Is  this  unequal  bargaining  posi¬ 
tion,  combined  with  the  differences  in  priorities 
that  makes  transatlantic  compatibility  of  the 
defense/aerospace  industries  so  difficult.  Even 
though  there  has  been  an  important  new  factor 
introduced— the  change  in  the  U.S.  policy  toward 
NATO— this  general  situation  will  continue  in  the 
future,  be  it  somewhat  modified. 

The  pattern  of  the  European  F-104  replacement 
choices  portrays  roughly  the  constraints  and  the 
two  dominant  trends  in  Alliance  armaments  colla¬ 
boration.  First,  however,  if  a  nation  can  still 
go  it  alone  through  the  sufficiency  of  the  size 
of  its  own  national  market  or  by  developing  an 
extensive  export  market,  as  with  France's  Mirage 
series,  it  will.  Only  then  if  it  can't,  will  it 
attempt  to  co-develop  a  system  on  a  parity  basis 
with  one  or  two  other  allies  (MRCA).  Although 
this  results  in  increased  costs  to  a  given  sys¬ 
tem,  it  is  both  cheaper  for  each  nation  than 
unilateral  development,  while  also  supporting 
the  national  technology  base.  If  the  extra 
cost  involved  in  co-development  is  not  feasible, 
then  the  remaining  option  (short  of  purchasing 
the  system)  is  licensed  production  of  an  ally's 
system  so  as  to  at  least  minimize  disruptive 
BOP  problems  and  maximize  domestic  employment 
(the  F-16  consortium).  The  first  choice  of 
going  it  alone  has  been  primarily  a  U.S.  option 
(although  the  new  U.S.  policy  changes  this  some¬ 
what);  however,  also  one  that  Is  sometimes  op»n 
to  the  U.K.  and  France,  and  even  occasionally 
the  FRG  and  Italy.  More  often  than  not  though, 
these  European  nations  have  increasingly  had  to 
resort  to  the  co-development  option,  or  in  the 
case  of  the  smaller  nations  and  often  FRG  and 
Italy,  licensed  production  or  minor  subcontracting 
role. 

The  general  framework  for  NATO  procurement  reflects 
the  constraints  referred  to  above.  On  the  inter¬ 
governmental  level,  although  the  North  Atlantic 
Treaty  Organization  has  been  invested  with  jurid¬ 
ical  personality  and  the  privileges  necessary  to 
perform  its  diplomatic  tasks  through  the  1951 
Ottawa  Agreement,  the  member  States  have  never 
shown  any  desire  to  delegate  to  any  entity  inde¬ 
pendent  of  themselves,  the  necessary  authority 
to  carry  out  the  purpose  of  the  treaty— defense, 
defense  procurement,  and  logistics  remain  a 
national  affair.  This  is  the  reason  behind  the 
failure  of  NATO's  own  internal  weapons  procure¬ 
ment  procedures,  through  the  NATO  Basic  Military 
Requirements  (NBMR's,  1959-66),  which  led  to  the 
abolishment  of  NATO's  Armaments  Comnittee  and  the 
establishment  of  the  Council  of  National  Armaments 
Directors  in  1966.  This  resulted  from  the  recog¬ 
nition  that  all  Alliance  authority  rested  with 
the  national  governments,  and  if  Alliance  armaments 
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(•  'lat'oration  was  to  be  promoted,  it  would  have 
to  be  done  on  a  more  limited  and  realistic 

"NATO  has  no  permanent  procurement  role, 
•u>  established  procurement  regulations,  no 
generally  aoplicable  standards  on  which  contrac¬ 
tors  can  safely  rely,  and  on  which  they  can 
predict  costs  and  perform  forecasts. "(1 )  Never¬ 
theless,  the  Alliance  does  provide  an  ideologi¬ 
cal  banner,  a  structure  for  the  planning  and 
coordination  of  the  member  states'  armed  forces, 
and  as  an  information  and  coordination  conduit, 
facilitating  ad  hoc  government- to -government 
agreements  for  defense  procurement. 

"NATO"  programs  are  the  result  of  inter-govern- 
mentai  agreements  covering  two  subcategories: 

'!)  weapon  projects  consisting  of  any  two  or 
■nre  "ember  states;  or  (2)  special  infrastruc¬ 
ture  nrojt  ‘  * s  '■•intled  by  all  13  DPC  members.  Tor 
the  weapon  , /slo.-.s,  these  inter-governmental 
groupings  set  up:  either  their  own  NATO-charter¬ 
ed  NPlO's  (NATO  Production  and  Logistics  Organi¬ 
zations)  with  a  Board  of  Directors,  consisting 
of  representatives  from  each  participating 
government,  and  an  inter-governmental  project 
Management  Organization;  or  simply  an  interna- 
t‘onal  Steering  Committee,  involving  no  legal 
entity  and  reiving  on  one  of  the  participating 
natiors  t-<  perform  the  procurement  function. 

In  NA10  infrastructure  (involving  Alliance-wide 
Ending)  ordinarily  the  government  of  the  host 
natior  (where  the  construction  is  taking  place) 
carries  out  the  procurement  function  under  the 
supervision  of  NATO's  standing  Infrastructure 
Progress  and  Payments  Committee.  This  involves 
several  special  procedures  like  NATO's  Inter¬ 
national  (ompetitivn  Sidd'ng  rules  (can  b° 
waived  by  unanimous  vote  of  the  P&P  Committee), 
audit  of  contractors  by  NATO's  International 
Board  of  Auditors,  and  a  Board  of  Arbitration 
for  die’-;i:e< .  Although,  in  the  exceptional  cases 
of  such  ’arqer,  more  complex  projects  as  NAOGE, 
NiCS  and  most  likely  N4TC/AIWAC  (AWACS),  the 
need  foi  more  centralized  management  has  led  to 
the  creation  of  the  international  Management 
Organizations  (NPLO's).  even  here  there  is  still 
considerable  reliance  on  the  national  procure¬ 
ment  authorities.  Therefore,  the  framework  with¬ 
in  which  contracting  takes  place  is  provided  by 
the  national  laws  and  regulations,  and  any 
relevant  govemment-to-govemment  agreements. 

Where  any  two  o>'  more  a  ied  governments  are 
procuring  the  same  basic  system  and  a  multina¬ 
tional  industrial  effort  is  involved,  there  are 
seven  principal  patterns  that  industry-to- 
Industry  relationships  take  within  the  Alliance. 
These  patterns  roughly  represent  the  types  of 
cooperation  in  R4D  and  production  In  which  the 
Alliance  members'  firms  have  been  involved, 
with  variable  degrees  of  success.  Nevertheless, 
the  experiences  of  learning  by  doing  have  pro¬ 
vided  these  firms  and  their  respective  govern¬ 
ments  with  invaluable  Insight  into  the  complex 
set  of  oroblems  faced.  This  has  involved  -"ealing 
with  d  -'ferirg  national  policies,  military 


requirements  and  doctrines,  regulations,  s,<-  - 
fications  and  practices,  as  well  as  work  if  : 
with  firms  with  differing  capabilities,  prior¬ 
ities,  standards  and  practices  in  the  organ;  •i- 
tion  and  management  of  inul  tigovernment/multi  f ;  m 
efforts.  The  seven  patterns  that  will  be 
elaborated  on  through  case  studies  are:  (1)  i 
single  European  nation's  finn(s)  producing  an 
American  system  under  license  (the  simplest  cf 
the  patterns),  (2)  Licensed  production  by 
multinational  coii'-ortia  of  a  U.S.  system  under 
license,  (3)  A  U.S,  firm  as  the  licensee,  which- 
unlike  licensing  the  other  way— also  involves 
redevelopment  (Americanization),  (A)  European 
multinational  codevel opment  and  production 
(■/•'•ini  has  been  the  most  significant  of  these 
patterns),  Transatlantic  codevel  opment 
(which  lias  proven  to  be  the  most  difficult  of 
the  patterns),  (6)  General  oi"c“t  procurement 
agreements  for  single  nation  pure- -ises  such  as 
Involved  in  the  FUG  purchase  of  the  r-l,  and  (7) 
U.S.  led  multinational  production  consortia 
(involving  no  codevel opment)  contracting  with 
both  U.S.  and  European  governments  in  an  ad  hoc 
grouping,  or  the  whole  Alliance,  and  including 
the  F-lfi  ACE-HIGH,  NADGE,  and  NATO/AEWtC. 

Tne  present  !J.S.  government  policy  has  brought 
about  the  introduction  of  more  diffuse  All'..-'.*, 
considerations  in  equipment  selection  distir 
sions.  For  the  U.S.  aerospace  industry,  this 
increases  the  need  to  better  understand  past 
arrangements  and  problems  In  Alliance  collabora¬ 
tion,  so  as  to  be  better  able  to  hedge  their 
positions  in  the  U.S.  market  and  to  gain  lever¬ 
age  in  the  European  national  markets  by  further 
developing  their  relationships  vrth  European 
governments  and  firms.  And  as  f  "  the  DOD, 
although  it  has  already  gone  a  ling  way  in  the 
development  and  implesientation  of  ‘his  new 
policy.  It  will  mean  that  certa’n  previous 
practices  will  still  need  to  !-<*  modified  so 
as  to  be  in  line  with  the  present  polity. 
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STRUCTURED  ANALYSIS  AND  QUALITY  ASSURANCE  FOR  SERVICE  CONTRACTS 
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INTRODUCTION 


During  the  past  several  years,  it  has  been  the 
policy  of  the  Federal  Government  to  rely  in¬ 
creasingly  on  the  private  sector  to  satisfy  its 
needs  for  services.  This  well  known  policy  is 
expressed  in  the  Office  of  Management  and  Bud¬ 
get  Circular  A-76  and  is  fully  supported  by 
the  Department  of  Defense  and  in  turn,  has 
been  implemented  by  each  of  the  military  ser¬ 
vices.  Service  contracts  in  the  Air  Force,  for 
example,  jmounted  to  over  $1.3  billion  in 
fiscal  year  1976  alone.  As  a  result  of  thi3 
trend  toward  contracting  out,  service  contrac¬ 
tors  have  assumed  a  major  role  in  day-to-day 
operations  of  bases,  posts,  camps,  and  stations. 
Contractors  provide  diverse  services  such  as 
transportation,  refuse  collection,  food  ser¬ 
vices  and  maintenance  of  sophisticated  defense 
related  equipment.  Some  contractors  are 
responsible  for  an  entire  installation  support 
function;  for  example,  at  Vance  AFB  Oklahoma, 
a  contractor  provides  the  full  spectrum  of 
support  services. 

The  move  to  contract  services  precipitated 
numerous  management  problems.  The  Air  Force 
Logistics  Management  Center  (AFLMC)  reviewed  a 
large  variety  of  statements  of  work  and  con¬ 
tract  management  schemes  used  by  bases  and 
found  numerous  weaknesses.  The  most  apparent 
weakness  was  the  ill  definition  of  requirements 
and  consequent  inability  to  measure  true  per¬ 
formance.  The  AFLMC,  with  HQ  USAF  support, 
established  an  Air  Force  project  to  develop  new 
streamlined  procedures  which  would  focus  a 
contract  manager's  attention  on  key  areas  of  a 
specific  service  contract.  This  paper  des¬ 
cribes,  in  general  terms,  the  approach  taken 
by  the  AFLMC  in  this  project  and  briefly  dis¬ 
cusses  the  project's  conclusions.  The  major 
recommendations  include  a  method  of  identifying 
and  stating  service  requirements  so  that  a  con¬ 
tract  will  accurately  express  the  minimum 
essential  requirements  and  their  associated 
measurable  characteristics,  and  a  method  for 
assuring  that  the  contractor  has  provided  the 
contractually  required  services. 


THE  CONCEPT  OF  QUALITY 


Previous  studies  of  ssrvicc  contracting  havo 
identified  numerous  factors  which  influence 
service  quality.  A  list  of  major  factors 
always  includes  the  contractor,  the  statement 
of  work,  the  government  quality  inspector  and 
the  quality  inspection  method.  The  performance 
of  the  contractor  and  the  government  quality 


inspector  are  direct  functions  of  the  statement 
of  work  and  the  Quality  inspection  method. 

This  relationship  allowed  the  AFLMC  to  focus  or. 
the  statement  of  work  end  inspection  methods 
since  they  were  most  amenable  to  influence  by 
centrally  established  policies  and  procedures. 
The  rationale  was  that  contractor  performance 
can  only  be  measured  through  specific  require¬ 
ments.  Further,  the  ability  of  an  inspector  to 
determine  whether  a  requirement  nas  been  met  is 
a  function  of  the  quality  assurance  method  as 
well  as  the  measurability  implicit  in  the  re¬ 
quirement  statement,  e.g.,  a  requirement  "to 
keep  a  room  cool"  is  subject  to  measurement 
error  since  coo)  13  a  very  subjective  word; 
however,  a  requirement  "to  keep  a  room's  tem¬ 
perature  between  6B  and  72  degrees"  can  be 
quite  precisely  measured.  At  this  point,  the 
project  scope  wus  narrowed  to  zero  m  on  (1) 
ways  to  write  statements  of  work  which  include 
useful  and  measurable  requirements,  and  (2) 
efficient  and  effective  ways  to  determine  whe¬ 
ther  the  requirements  are  being  satisfied. 


THE  APPROACH 


Approaches  to  defining  requirements  have  tra¬ 
ditionally  involved  translating  existing 
methods  or  processes  into  a  statement  of  work, 
hence  they  were  process  oriented.  Contractors 
were  asked  to  provide  satisfactory  service 
using  procedures  dictated  by  the  government. 

In  looking  for  a  better  way  to  write  a  state¬ 
ment  of  work,  the  AFLMC  decided  to  take  an 
approach  that  would  look  at  a  performance, 
output  oriented  statement  of  work,  rather  than 
procedures.  This  approach  to  service  contract¬ 
ing,  while  certainly  not  new  in  a  .conceptual 
sense,  lias  not  been  widely  reported  on;  there¬ 
fore,  the  AFLMC  found  itself  in  the  position  of 
trying  new  applications  for  old  theories. 

Field  personnel  were  initially  resistant  to  this 
concept  since  it  is  a  traumatic  experience  for 
a  functional  manager  to  be  asked  to  describe 
the  service  needed  in  discrete,  measurable 
units.  Functional  managers  underestimate  their 
ability,  thankfully,  and  our  experience  shown 
that  they  can  define  precise  service  require  • 
raents  if  they  use  a  carefully  structured  analy¬ 
sis  technique. 

Systems  analysis,  when  applied  to  a  proposed 
service  contract,  partitions  the  desired  ser¬ 
vice  into  sets  of  jobs  which  then  servo  as 
focal  points  for  defining  a  measure  of  job  per¬ 
formance.  From  a  contractor's  view,  the  ser¬ 
vice  contract  requires  that  the  inputs  -  people, 
facilities,  material,  and  the  government  state¬ 
ment  of  work,  etc.  -  be  integrated  into  a 
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the  job,  what  happens  to  the  inputs  during  • 
work  process,  and  what  measurable  job  out  j  u* 
is  created  by  the  work  process . 

<1.  Job  Class  if  lout  ion.  The  class!  f  wo"  ion 
."tep  ir.  a  decision  point  which  require:  mat" 
nqeinont  to  decide  whether  It  wants  a  rn.d  i  aiii.r 
i.o  provide  a  service  nr  retain  'he  tunr  t'f.i. 
in-house.  This  decision  point  is  'tots!  '  1  ,* 
tl"ce  contract  coct:  growth  which  frequently 
o' curs  as  managers  find  new  jobs  wltith  they 
want  added  to  a  basic  contract,  r’lar.r.tr  ica- 
*■  ion  mokes  these  additions  a  conscious  'inci¬ 
sion. 

e.  Data  Gathering.  Workload  data  ip  collected 

for  each  job  classified  ns  a  con:  t  ,»  job 

arid  government  furnished  resources  art  >  ’early 
stated.  Contractors  need  this  infoimat  j.m  in 
order  to  prepare  a  responsive  and  realistic 
bid.  This  information  also  Iwcom  :s  an  n- 

t  i.tl  part  of  the  government's  qual  ity  a: ‘.'tr¬ 
ance  pi, in  an  described  later. 

f.  Performance  Analysis.  The  jot.  analyst  ; 
step  produced  statements  which  described 
measurable  output-  which  are  associated  with 
each  job.  Thin  step  cotiver  r.u  those  outputs 
into  performance  values  which  include  the 
desired  response  together  with  a  ramie  of 
acceptable  value:)  around  the  desired  response. 
Emphasis  is  placed  on  stating  the  let)) red 
response  in  terms  whip  permit  objective 
measurement..  The  technique  for  is  the  state 
merit  of  work  writer  to  state  wli.it  standard  t  , 
associated  with  an  element  of  sc.  .ice,  Stow  the 
service  can  tie  measured,  and  what  al  lowat  !e 
error  rate  or  acceptable  quail  f,  level  can  lie 
present  before  a  service  becomes  unsatisfac¬ 
tory. 


production  function  (process)  which  produces 
the  contractually  required  output  sorvicos. 

'Hie  contractor  uses  quality  control  mothoda,  as 
a  control  loop,  to  mensuro  output  services 
against  requiromcnitu,  identify  out -of -tolerance 
si  t  uat  iorif,,  iind  take  corrective  action  to  bring 
tin*  work  preens'.  back  into  control  .*1  nubst.nnd- 
anl  services  are  produced. 

This  qentraj  view  of  a  service  contract  permits 
the  use  of  structured  analysis  to  define  the 
output,  services  of  the  process  and  the  standaitis 
!■.■  .vie.  fated  with  that  output.  An  unamblguouii 
of  nit  ion  of  a  job  permits  the  measurement  of 
ntpu'  by  both  the  contractor,  from  a  process 
tiinliil  viewpoint,  and  the  government,  from  an 
aceep '■  ri'  i  *  'i,,  sot  vice  viewpoint. 

OVERVIEW  Of  THE  ANAI.VSIS  METHOD 


The  development  of  a  performance  oriented  state¬ 
ment  of  work  and  the  techniques  for  quality 
assurance  '.surveillance  starts  with  structured 
analysis.  Structured  analysis  provides  the 
oasis  for  writing  a  statement  of  work  by 
assembling  nil  the  essentia)  information  des¬ 
criptive  of  each  element  of  service  to  be  per¬ 
formed.  The  steps  in  the  AFI.MC  approach  to 
analysis  are  described  below. 

a.  Organizational  Analysis.  The  process  of 
analysis  start:;  at  the  macro  level  of  organi¬ 
zation  analysis.  The  existing  in-house 
opera  '.ton  is  examined  to  see  how  it  is  organiz- 

to  scu,..,!1'.;.  its  job  and  data  is  gathered 

..'n  describes  and  measures,  in  a  general  way, 
the  services  currently  per formed.  Vehicle 
maintenance  or  inventory  management  are  example* 
of  the  way  in  which  services  are  initially 
described . 

b.  .lob  Definition.  Organizational  analysis 
provides  macro  level  statements  of  service  out¬ 
put,  however,  these  statements  are  vague  and 
cannot  be  measured.  These  macro  level  services 
do  provide  excellent  guides  to  critical  service 
requirements  which  can  be  broken  into  their 
constituent  elements  by  defining  the  work  pro 
ceose3  that  make  up  the  ,cro  level  service. 

For  example,  the  major  process  of  inventory 
management  has  as  constituent  elements  .such 
work  processes  as  stock  ordering,  warehousing, 
stock  Issuance,  and  stock  accounting.  F.ach  of 
these  work  elements  can  be  broken  into  (.mailer 
elements  of  service.  Job  definition  is  com¬ 
plete  when  the  total  service  ne«rf  is  broken  into 
discrete  jobs,  where  each* job  can  be  unamblgu 
oualy  defined  and  possess  the  potential  for 
measurer-tent. 

c-  Job  Analysis.  Job  analysis  is  conducted  to 
clsarl*.  define  exaot  job  outputs.  This  »<  ■  ivlty 
includes  «  thorough  analysis  of  each  job's  in¬ 
puts,  I'ocoen,  nod  output  factors.  This  very 
'rllic.tl  step  la  complete  when  each  job  has  been 
deeri1  *d  in  terms  of  the  action  which  starts 

SB4 


g.  Governing  Directive  Analysis.  Historically, 
service  contracts  have  included  a  statement 

of  work  which  tries  to  replicate  the  in-lvur* 
operation  which,  it  in  to  replace.  Promi  seen  e. 
imposition  ol:  military  functional  procedure:: 
creates  an  environment  in  which  the  service 
contractor  Is  inhibited  from  devising  cost 
effective  approaches  which  provide  tin*  desired 
service.  During  this  analysis  the  functional 
manager  requesting  *he  service  contract  is 
ioLced  to  cat-'  J ogee  all  directives  ’■hat  pci 
tain  'o  the  servtc*,  which  are  used  fur  in* 
house  operations.  These  direct  ives  n*  e  ;  lien 
examined  to  determine  if  they  are  absolutely 
required  to  satisfy  one  or  more  measures,  of 
joii  performance.  This  step  la  designed  to 
oi'.  'if*  that  a  directive  will  rot  be  included 
it  the  statement  of  work  rnl:*:::.  an  *’  "ilute  t 
need  is  proven. 

h.  Deduct  Analysis,  Servic  ..  it  - 

variably  fail  to  provide  one  or  tw  i  *■  >  ,  .  "Is 

•  f  service  and  the  government  muvd  ivo:.t  payi  " 
for  service*)  lhal  have  not  been  itrliae'i  in  a 
sat  in  factory  manner.  This  Is  in  a  ' t  ion  to 
I  he i  o  tit  ractunl  remedies  ottch  a  ,, 

w  -  1  default.  Deduct  analy  te  u! -r’  wi"!  tl 
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specific  30b  outputs  discovered  during  30b 
analysis,  their  frequency  of  performance,  and 
resource  input.  The  analyst  then  derives  the 
oercontage  of  cost  contribution  which  each  30b 
makes  to  the  total  contract  effort.  When  a 
service  is  not  performed  within  an  acceptable 
quality  level,  the  government  is  now  in  a 
position  to  make  appropriate  monetary  deduc¬ 
tions  from  normal  contract  payments  for 
specific  non-performance.  These  deduction 
percentages  along  with  the  performance  values 
are  placed  in  the  statement  of  work  and  be¬ 
come  a  part  of  the  contract  which  is  awarded 
after  bidding. 

The  structured  analytic  steps  bring  a  macro 
statement  of  requirements  down  to  micro  level, 
measurable  outputs.  Each  of  these  outputs  is 
described  in  terms  of  the  performance  charac¬ 
teristics  that  are  critical  if  the  obgectives 
of  the  service  contract  are  to  be  met.  Know¬ 
ing  the  exact  deliverables  in  the  contract 
permits  the  definition  and  construction  of  a 
quality  assurance  program  that  will  assure  tnat 
delivered  services  meet  requirements  prior  to 
their  acceptance. 


SERVICE  CONTRACT  QUALITY  ASSURANCE 


A  maior  difficulty  in  service  contracting  stems 
from  imprecise  statements  of  work  and  inade¬ 
quate  methods  of  contract  surveillance.  The 
preceding  pai'  of  this  report  described  in 
general  terms  a  technique  for  making  a  state¬ 
ment  of  work  more  precise.  This  ptrt  of  the 
report  describes  the  quality  assurance  techni¬ 
que  developed  by  the  AFLMC  for  base  level 
service  contracts.  The  approach  has  been  ex¬ 
tensively  tested  with  existing  service  con¬ 
tracts  and  the  system  is  now  being  implemented 
throughout  the  Air  Force.  The  key  document 
that  implements  the  concept  is  a  surveillance 
plan.  This  choice  of  nomenclature  serves  to 
distinguish  it  from  the  traditional  checklist 
method  of  contract  surveillance  since  a  sur¬ 
veillance  plan  os  designed  by  the  AFLMC  is  an 
organized,  planned  approach  to  quality  assur¬ 
ance. 

Quality  control  models  are  generally  broken 
down  into  acceptance  sampling  and  process  con¬ 
trol  approaches  where  each  model  would  use 
sampling  by  attributes  or  variables  as  appro¬ 
priate.  Acceptance  models  aid  the  purchaser 
of  a  product  or  service  in  determining  whether 
the  product  or  service  satisfies  minimum 
standards.  This  model  description  fits  the 
government's  needs  exactly  since  a  major  obiec- 
tive  of  this  entire  approach  is  to  determine 
whether  services  satisfy  specific  requirements. 
A  contractor,  however,  is  concerned  about  the 
work  process  itself  and  therefore  would  logic¬ 
ally  establish  a  quality  control  scheme  using 
process  control  techniques.  This  approach 
focuses  the  government's  attention  on  accept¬ 
ance  of  services  and  allows  the  contractor  to 


establish  process  control  procedures  which 
should  reduce  the  numerous  complaints  of  ser¬ 
vice  contractors  who  claim  the  government  med¬ 
dles  t.00  much  in  trying  to  dictate  process 
methods.  Attribute  sampling  has  been  used 
most  widely  in  applying  this  approach  to 
acceptance  sampling,  however,  variable  sampling 
can  be  easily  incorporated  if  it  is  appropriate. 
Attribute  sampling  satisfies  most  of  the  needs 
for  monitoring  service  performance  since  it  can 
be  applied  to  either  30b  standards  which  can 
be  precisely  measured,  e.g.,  temperature  of 
wash  water  in  a  kitchen;  or  to  30b  standards 
which  are  more  sub30ctive,  e.g.,  food  taste. 

In  addition.  Military  Standaid  105-D,  "Sampling 
Procedures  and  Tables  for  Inspection  by  Attri¬ 
butes,"  is  an  excellent  reference  for  develop¬ 
ing  service  contract  surveillance  plans.  Thi3 
is  particularly  true  since  the  structured 
analysis  technique  permits  clear  definition  of 
output  services,  demands  the  statement  of 
standards,  and  forces  decisions  about  accept¬ 
able  quality  levels.  In  other  words,  the 
vague  expression  "service"  was  refined  through 
the  steps  described  earlior  into  discrete  ser¬ 
vice  elements  called  jobs,  where  each  30b 
had  associated  with  it  a  set  of  measurable  per¬ 
formance  characteristics.  These  performance 
characteristics  collectively  are  used  to  deter¬ 
mine  whether  a  job  has  been  satisfactorily 
performed.  Attribute  sampling  when  applied  at 
the  service  acceptance  decision  point  allows  a 
government  contract  monitor  to  efficiently  and 
effectively  evaluate  performance  by  answering 
yes  or  no  to  simple  statements  abaut  the  per¬ 
formance  characteristics. 

The  major  product  contained  in  a  surveillance 
plan  is  the, sampling  guide.  The  sampling  guide 
brings'together  the  MIL-STD-IOSD  sampling  plan, 
information  on  how  to  draw  a  random  sample  to 
select  those  output  services  to  be  checked,'  and 
an  inspection  procedure  for  checking  the  output. 
Once  constructed,  this  document  contains  all 
the  information  that  an  inspector  noeds  to  do 
the  job  when  random  sampling  is  the  method 
chosen  to  check  the  service  output.  The  major 
components  of  the  sampling  guide  are  explained 
below. 

a.  Acceptable  Quality  Level.  MIL-STD-105D 
describes  the  acceptable  quality  level  as  tho 
maximum  percent  defective  which  for  a  service 
contract  is  translated  to  mean  tho  frequency 
with  which  a  service  cjn  be  performed  unsatis¬ 
factorily  and  still  not  cause  total  rejection 
of  that  service.  Many  functional  managers 
initially  find  this  bothersome  since  they  want 
everything  100%  correct  all  the  time.  Most 
functional  managers  eventually  realize  that 
there  are  only  two  ways  to  get  such  service: 

(1)  by  paying  an  exorbitant  fee,  or  (2)  by 
setting  a  low  level  of  quality.  This  statement 
of  acceptable  quality  level  is  an  excellent 
feature  of  this  overall  approach  to  service 
contracting,  since  it  forces  the  functional 
manager  to  make  conscious  decisions  and  trade¬ 
offs  between  service  quality  and  cost.  The 
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data  developed  during  performance  value  analv- 
"15  is  the  source  of  acceptable  quality  levels 
:or  the  sampling  guide. 

b.  Lot  Size.  Lot  size  is  an  estimate  of  the 
total  volume  of  jobs  for  a  particular  type  job 
and  time  period.  For  example/  the  number  of 
meals  served  in  a  dining  hall  during  a  month 
:ould  serve  as  the  lot  size  for  sampling  pur- 
i/oses.  As  noted  during  the  analysis  discus¬ 
sion,  the  technique  calls  for  data  gathering 
about  workload  by  specific  service  output. 

This  workload  or  frequency  data  is  the  source 
<. '  'he  lot  size. 

-■  oatple  clze.  MIL-STD-105D  is  used  to  ob¬ 
tain  the  j.:w.  sample  size  based  on  lot  size 
and  other  statistical  criterion.  For  example, 
if  the  lot  size  were  185  jobs,  the  month's 
sample  would  be  32  jobs  using  Inspection  Level 
II  and  the  single  sampling  plans  for  normal 
inspections  contained  in  HIL-STO-105O. 

d.  Sample  Procedures.  Single  sampling  schemes 
have  been  used  most  widely  m  current  contracts 
developed  under  this  approach;  however,  other 
sample  plans  can  be  adopted  without  loss  of 
generality.  The  sample  procedure  requires 
that  each  service  job  within  a  lot  be  uniquely 
identified  which  can  be  accomplished  by  sys¬ 
tematically  inspecting  every  i'th  gob,  by 
assigning  job  numbers  to  every  service  job, 

or  other  plans  which  preserve  the  random  nature 
of  the  sample.  Random  number  tables  are  pro¬ 
vided  for  use  in  those  situations  where  jobs 
have  unique  numbers. 

e.  Inspection  Procedure.  Attribute  inspection 
requires  the  statement  of  definitive  criteria 
which  is  used  to  determine  whether  or  not  a 
service  meets  a  standard.  These  criteria, 
developed  during  the  performance  analysis  step, 
now  become  guidelines  used  to  determine  whether 
a  specific  job  has  boon  satisfactorily  perform¬ 
ed.  The  standards  along  with  a  written  proce¬ 
dure  for  the  inspector's  use  in  checking  the 
service  become  the  inspection  procedure. 

f.  Performance  Criteria.  ML-STP-iOSn  des¬ 
cribes  specific  acceptanc-  and  rejection  numbers 
based  on  sample  size  an  icceptable  quality 
level.  As  Inspection  progresses,  a  simple 
tally  of  the  sample  observations  of  service  out¬ 
put  enables  the  inspector  to  determine  if  a  lot 
or  group  of  services  is  of  acceptable  quality 
by  comparing  the  number  of  defects  discovered 
with  the  acceptance  and  rejection  numbers. 

g.  Problem  Location.  Service  contracts  call 
for  many  interfaces  with  on-base  government 
agencies.  Frequently,  factors  associate!  with 
these  interfaces  can  cause  a  contractor  to 
provide  unacceptable  service.  For  example. 

If  thn  atatnroul  nf  work  required  t.ho  con'  ac¬ 
tor  to  use  the  government  aupply  system  to: 
repair  ports,  a  low  equipment  ln-commlimlon 
rate  c-  ilcl  only  bo  chargeable  v>  the  contractor 
if  "he  lovernmont  supply  system  wore  not  a 


source  of  parts  delay.  Problem  location  is 
not  a  direct  part  of  the  sampling  guide.  How¬ 
ever,  it  is  part  of  the  surveillance  plan 
and  is  necessary  before  any  decision  can  be 
made  to  accept  or  reject  the  lot  of  service 
outputs. 

CONCLUSION 


'fnis  paper  has  described  the  approach  taken 
l,v  the  AFLMC  to  resolve  many  of  the  historical 
problems  associated  with  base  level  service 
contracts.  In  particular,  it  addresses  a 
method  to  insure  acceptable  service,  whose 
major  components  are  a  definitive  c.  •  -ent  of 
work,  and  a  quality  assurance  techniqi*  . 
Structured  analysis,  with  its  step  by  step 
procedures  has  been  described  as  a  means  of 
defining  specific  service  outputs  and  their 
associated  standards.  A  quality  assurance 
surveillance  plan,  based  on  MIL-STD-10SD 
techniques,  has  been  proposed  as  the  method 
to  perform  acceptance  sampling  of  the  service 
output.  Analysis  and  the  surveillance  plan, 
when  taken  together,  answer  persistant  ques¬ 
tions  on  how  to  succinctly  state  requirements 
and  measure  progress  toward  satisfaction  of 
these  requirements. 
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ABSTRACT 


This  paper  explains  the  process  of  acquiring 
Embedded  Computer  Systems  (ECS)  within  the 
context  of  the  Department  of  Defense  life 
cycle  acquisition  phases.  The  major  object¬ 
ive  of  the  paper  is  to  provide  a  description 
of  the  ECS  acquisition  process  in  its  current 
state.  The  acquisition  tasks  and  hardware/ 
software  interrelationships  are  described 
during  each  of  the  phases  of:  concept 
formulation,  validation,  full  scale  develop¬ 
ment,  production  and  deployment.  The  paper  is 
intended  to  cover  the  acquisition  process  from 
a  conceputal  point  of  view  by  focusing  on  the 
interdependence  of  hardware  and  software 
development. 


INTRODUCTION 


Today,  almost  all  major  Department  of  Defense 
(DOD)  weapon  systems  such  as  the  Trident 
Submarine  or  the  F-15  Air  superiority  Fighter 
are  ctitically  dependent  on  the  proper 
operation  of  Embedded  Computer  Systems.  A  key 
component  of  these  electrical-mechanical 
syscems  has  become  the  computer  and  its 
integrated  aoftware. 

An  Embedded  Computer  System  as  used  within  the 
DOD  is  a  system  which  is  dedicated  to  a 
specific  function  within  a  larger  system  whose 
primary  function  is  not  data  processing. 

There  are  two  key  characteristics  of  Embedded 
Computer  Systems,  which  distinguish  them 
quite  well  from  other  computer  systems.  In  an 
Embedded  Computer  System  the  hardware  and  soft¬ 
ware  are  designed  and  developed  simultaneously. 
In  non-embedded  (general  purpose)  computer 
systems  the  hardware  is  developed  to  be 
compatible  with  a  multitude  of  programming 
purposes.  The  embedded  computer  ar-.i  its  soft¬ 
ware  are  developed  as  an  integral  part  of  the 
much  larger  electrical-mechanical  system. 
Another  characteristic  of  note  is  that  the 
embedded  systems  are  mobile.  That  is,  they 
are  within  a  moving  system  with  all  the 
implications  of  miniaturization,  cooling  and 
power  requirements.  (5) 

One  of  the  most  perplexing  and  urgent  problems 
now  facing  the  DOD  is  how  to  control  the  mush¬ 
rooming  costs  of  the  software  needed  to 
operate  Embedded  Computer  Systems.  The  DOD 
now  spends  billions  of  dollars  annually  on 
software.  These  costa  are  projected  to 


continue  to  rise  in  the  forseeable  future.  In 
some  recent  major  programs  the  cost  of  embedd¬ 
ed  computer  software  has  been  three  times  the 
coil  of  its  accompanying  hardware.  It  has 
been  estimated  that  DOD  annually  spends  frcci  3 
to  3.5  billion  dollars  on  the  various  forms  of 
software.  Approximately  55%  to  .  jl.  of  these 
dollars  can  be  classified  as  weapons  systems 
(embedded)  software  costs.  (1) 

The  spiraling  use  of  embedded  computers  in 
major  weapons  systems  has  not  beer,  accompanied 
by  appropriate  management  techniques,  tailored 
to  the  unique  environment  of  acquiring  embedd¬ 
ed  computer  software.  This  lack  of  management 
response  based  on  n  clear  understanding  of  the 
acquisition  process  within  both  DOD  and 
industry  may  be  the  reason  for  the  escalating 
cost  of  software  within  the  DOD.  This  article 
provides  a  descriptive  mode)  of  the  ECS  ac¬ 
quisition  process  in  furtherence  of  under¬ 
standing.  The  focus  is  to  introduce  the 
concept  of  an  interdependent  system  for  hard¬ 
ware  and  software  development  for  Embedded 
Computer  Systems. 


THE  EMBEDDED  COMPUTER  SYSTEM  MODEL 


TRADITIONAL  LIFE  CYCLE  PHASES 


Department  oi  Defense  Weapons  systens  gener¬ 
ally  go  through  five  phases  during  their  life. 
Thd  phases  in  sequence  are:  Concept  Formula¬ 
tion,  Program  Validation,  Full  Scale  Develop¬ 
ment,  Production  ard  Deployment. 

Before  a  new  system  can  be  seriously  con¬ 
sidered  for  acquisition  some  change  fh  the 
environment  must  occur.  The  military  threat 
may  change  or  technological  advances  may  be 
made  that  allow  significant  Increases  in 
military  capabilities.  Existing  systems  may 
be  aging  or  deteriorating.  Many  different 
changes  may  occur  in  the  environment  simul¬ 
taneously,  but  the  key  is  that  there  must 
be  a  felt  need  before  a  new  system  can  be 
conceptualized . 


DESCRIPTION  OF  THE  MODEL 


Concept  Formulation,  During  the  dcncept 
Formulation  Phase  the  emphasis  is  on- 
whether  or  not  the  felt  need  can  or  should 
be  established  as  a  firm  requirement. 


587 


Various  studies  are  performed  to  determine  if 
the  envisioned  systems  are  technically/ 
economically  feasible  and  if  it  can  be  pro¬ 
duced  in  time  to  realize  the  desired  benefits. 
Concept  formulation  can  be  considered  both  a 
defining  and  a  weeding  out  process.  The 
major  output  of  this  phase  is  a  description  of 
J  system  which  will  fulfill  the  operational 
needs  of  the  user.  A  key  attribute  of  this 
phase  is  the  minimal  expenditure  of  funds. 


As  shown  in  the  Figure,  a  system  (project  or 
program)  must  pass  a  series  of  hurdles  prior 
to  completing  the  concept  formulation  process. 
These  hurdles  are  designed  to  optimize  the 
alternative  approaches  to  the  problem  solution. 
The  primary  emphasis  of  this  phase  is  on  the 
major  weapons  system  (aircraft,  missile,  ship, 
etc).  The  subsystems  (such  ns  embedded 
computers)  are  considered  from  a  functional 
viewpoint.  Only  if  the  major  system  pusses 
the  hurdles  of  concept  formulation  is  it 
appropriate  to  expend  funds  to  determine  how 
to  achieve  the  subsystem's  performance. 


Validation.  The  Validation  Phase  was  formerly 
called  the  contract  definition  phase  or  pro¬ 
ject  definition  phase.  During  this  phase 
only  the  minimum  preliminary  design  and 
engineering  necessary  to  define  the  system's 
performance  is  accomplished.  An  analysis  and 
evaluation  is  accomplished  to  determine  the 
technical  and  economic  adequacy  of  the  pro¬ 
posed  system  requirements.  The  completeness, 
effectiveness,  and  any  deficiencies  in  the 
proposed  system  are  evaluated  in  light  o'  the 
users'  mission.  This  analysis  and  evaluation 
process  results  in  a  refinement  of  the  original 
performance  concepts,  systems  definition  and 
performance  requirements. 


After  the  major  system  has  been  treated,  each 
subsystem  (e.g.  avionics,  airframe,  propulsion, 
etc)  is  analyzed,  evaluated  and  defined  in 
detail.  The  results  of  this  subsystem  activity 
is  an  operating  concept,  performance  require¬ 
ments  and  a  set  of  design  requirements.  These 
concepts  and  requirements  are  then  compiled 
into  specification  documents  which  will  govern 
all  of  the  following  development  activities. 


in  parallel  with  the  technical  refining 
activities  are  the  detailed  planning,  cost 
estimating  and  scheduling  activities.  Plana 
are  made  for  the  design,  development,  test, 
integration  and  eventual  acceptance  of  each 
major  subsystem  as  well  as  the  overall  system. 
Detailed  cost  estimates  are  accomplished  and 
prel:minary  schedules  are  established.  The 
work  of  this  phase  is  usually  a  joint  effort 
between  the  government  and  a  civilian  contract¬ 
or  (or  contractors),  at  least  for  major  weapons 
systems.  After  design  work  accomplished 
during  the  concept  formulation  phase  is 
verified;  ttie  major  technical  approaches  are 
validated  through  extensive  analysis  and 
possibly  even  some  hardware  development.  The 


last  part  of  this  phase  results  in  a  con¬ 
tract  definition  to  be  implemented  during  the 
Full  Scale  Development  (FSD)  Phase. 


Most  authors  who  explain  the  acquisition  of 
software  (including  embedded  computer  soft¬ 
ware)  do  two  things.  First,  they  ignore  the 
hardware  or  only  make  passing  references; 
second,  they  start  the  Concept  Formulation 
Phase  with  the  analysis  of  software  require¬ 
ments  and  carry  this  analysis  through  the 
Validation  Phase.  The  Development  Phase  then 
starts  with  coding,  testing,  debugging,  and 
parallel  design  efforts.  Although  the  above 
sequences  may  be  desirable,  instances  of  this 
sequence  happening  aTe  very  few  and  far  be¬ 
tween. 


Some  analysis  of  software  does  occur  during 
the  Concept  Formulation  and  Validation 
Phases;  hut  compared  to  the  detailed  studies, 
analyses  and  even  exploratory  development  ol 
hardware;  software  studies,  are  so  minima!  as 
to  be  almost  non-existent.  Software  Is 
studied  and  analyzed  only  enough  to  establish 
two  facts.  First,  the  system  can  and  should 
be  controlled  to  sane  degree  by  software; 
second,  approximate  software  sizing  activi¬ 
ties  'are  accomplished  to  give  a  rough  order 
of  magnitude  of  the  job  and  software  costs. 


Boehm  in  his  often  quoted  article  referred 
ro  the  software  as  secondary  to  hardware. 

His  emphasis,  however,  was  that  software 
decisions  and  requirements  should  not  wait 
until  af.-.er  the  critical  hardware  decisions 
are  made,  but  should  be  accomplished  first. 
These  facts  lead  us  to  the  conclusion  that 
the  hardware  and  software  activities  during 
the  Validation  and  the  Development  phases 
are  in  reality  significantly  offset  as  shown 
in  the  Figure. 


Full  Scale  Development.  Because  of  the  tim¬ 
ing  of  software  validation  we  now  break  the 
Full  Scale  Development  (FSD)  Phase  into  four 
separate  parts.  In  this  phase  of  the 
acquisition  cycle,  we  will  cover  hardware 
development,  software  validation  (analysis), 
software  development  and  testing. 


Hardware  Development.  The  hardware  phase  of 
FSD  covers  all  the  work  necessary  to  build 
one  or  more  prototypes  for  testing.  The 
development  of  hardware  can  be  generally 
broken  down  Into  the  stages  listed  below: 


1.  Preliminary  Analysis  and  Design. 

2.  Critical  Analysis  and  Design. 

3.  Building  of  Prototypes. 

4.  Developmental  Testing. 


5.  Verification  Testing. 

6.  Validation  Testing. 


■M. 
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During  the  preliminary  design  the  developer 
and  buyer  gain  an  increased  confidence  in 
the  feasibility,  cost  and  performance  of  the 
system  through  a  critical  look  at  the  system 
concepts.  Thin  phase  does  not  normally  re¬ 
sult  in  drawings  for  fabrication.  Major 
modules  and  their  interfaces  are  defined. 
Functional  flow  diagrams  are  prepared.  Gen¬ 
eral  layout  drawings  may  be  prepared.  Brass¬ 
boarding  and  testing  of  critical  components 
may  occur.  Maintainability  and  reliability 
requirements  are  addressed.  Preliminary  plans 
for  further  development,  test,  manufacture, 
installation,  integration  and  support  are 
developed.  The  results  of  the  preliminary 
design  review  are  inputs  to  the  next  stage, 
which  is  the  design. 

In  the  critical  design  stage  the  recoiranenda- 
tlons  of  the  preliminary  design  review  are 
implemented.  The  work  In  this  stage  is  the 
detailing  of  design  and  analysis  necessary  to 
build  the  procotype.  Detailed  drawings  fot 
fabrication  and  part  selections  are  made. 

Basic  packaging  decisions  are  made.  If  the 
basic  processor  bus  not  already  been  selected 
In  the  preliminary  design  phase,  It  will  be 
selected  here.  Building  of  prototypes  el- 
tb.oug  listed  separately,  occurs  during  the 
critical  design  process.  Developmental 
testing  also  starts  during  this  phase.  Often 
a  number  of  preproduction  prototypes  will  be 
fabricated  to  allow  various  activities  to 
occur  simultaneously.  For  example,  because 
of  the  delay  (or  offset)  In  the  beginning  of 
software  activities,  the  design,  coding  and 
Implementation  of  the  software  may  occur 
simultaneously  with  reliability,  environmental 
and  other  developmental  teeming  of  the  hard¬ 
ware. 

The  end  of  the  critical  design  stage  will  he 
a  critical  design  review.  The  detailed  de¬ 
sign  is  generally  completed  at  this  point. 
Barnuse  validntion/verlficntlon  and  integra¬ 
tion  vesting  require  the  integration  of  the 
.-.ottware  Into  the  total  system  they  will  be 
coveted  after  the  software,  development. 

Software  Validation.  The  software  analysis 
stnrt3  with  the  input  or  the  overall  perform¬ 
ance  specifications  fo  the  embedded  computer 
system.  An  analyst  1-  performed  In  conjunc¬ 
tion  wich  the  preliminary  design  of  the  hard¬ 
ware  to  determine  the  sof twaie/hardware  Inter¬ 
actions  required  to  supply  the  system  perform¬ 
ance  functions.  From  these  Interactions  the 
software  operating  and  design  concepts  ore 
completed  and  documented  In  a  software  per¬ 
formance  and  design  specification. 

Software  Development..  The  actual  software 
development  can  be  broken  down  Into  f Wa¬ 
stages. 

1.  Bmlc  Tool  Building. 


2.  Preliminary  Design. 

3.  Critical  Design. 

4.  Code  and  Debugging. 

3.  Developmental  Testing. 

The  basic  tool  building  stage  is  used  to 
build  such  support  tool3  ns  compilers, 
environmental  simulators,  documentation  aids, 
test  case  generators,  test  data,  management 
systems,  assemblers,  system  exercisers, 
standards  enforcers,  special  computer  con¬ 
soles  or  other  necessary  tools.  (6) 

During  the  preliminary  debign  stipe,  analysis 
and  tradeofts  are  performed  to  ue'eimlne 
alternative  approaches  to  the  compulv.  pro¬ 
gramming  problem.  The  design  approacn  is 
selected  during  this  activity.  The  pro¬ 
gramming  technique,  such  as  top-down  pro¬ 
gramming,  ego- less  programming  or  chief 
progra-OTer  team  programming,  is  seLected. 
Compatibility  requirements  are  defined, 
such  as  interface  definitions,  timing, 
message  formats  and  available  computei 
memory.  Other  activities  are: 

1.  Definition  of  Inputs/Outputs. 

2.  Designation  of  Programming  Tasks. 

3.  Data  Base  Description. 

4.  Functional  Flows  are  Created. 

5.  Allocation  of  Storage. 

6.  Coses  and  Schedules  are  Updated. 

7.  Development  oi  Initial  Test  Plans. 

At  the  end  of  the  preliminary  design  a  formal 
preliminary  design  review  Is  held  to  deter¬ 
mine  if  the  software  development  is  ready 
to  continue  to  the  critical  design  stage. 

During  the  critical  design  stage  activities 
which  are  necessary  prior  to  actual  coding 
or  the  software  are  accomplished.  The 
individual  and  system  program  flows  are 
tinaii/.ed.  Pr"’ 'm'nary  test  plans  and 
procedures  are  finalized  and  submitted  for 
approval.  A  tnajcr  result  of  the  critical 
(detail)  design  process  is  the  compilation 
of  'he  major  portions  of  data  necessary  to 
describe  the  computer  software  product, 
ills  data  will  become  the  proposed  product 
spec li i cat ion  at  the  end  of  the  validation 
verification  prowess. 

The  critical  derign  review  i„  i ,,  to 

insure  the  design  Is  sufficiently  tin' me  to 
permit  start  of  the  actual  coding.  Also 
the  testing  procedures  and  plans  are  n 
focus  of  this  review. 
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During  ihe  coding  stage  the  flow  charts  are 
converted  to  lines  of  coded  instructions.  The 
programming  process  is  usually  accomplished  on 
a  module  or  subroutine  basic.  The  module  or 
subroutine  is  then  desk  checked  for  illegal 
expressions,  logic  errors  and  deviations  from 
programming  standards.  The  subroutines  or 
modules  are  then  put  through  developmental 
testing  with  the  special  software  tools  such 
as  simulators  or  special  test  cases.  After 
sufficient  modules  have  been  checked  out  they 
are  then  compiled  and  assembled  into  a  larger 
computer  program  segment  which  can  then  be 
tested  and  the  process  is  repeated  until  the 
entire  software  program  has  been  compiled  and 
assembled  and  developmental  testing  performed. 

The  computer  program  now  is  ready  to  enter 
the  formal  testing  stages. 

Thus  far  the  principle  outputs  of  the  soft¬ 
ware  development  have  been:  (7) 

1.  Computer  Program  Development  Specification 

2.  Test  Plans  and  Procedures 

3.  Drawings 

4.  Flow  Charts 

5.  Computer  input  and  Output  Formats 

6.  Source  Program  Statement  (Listings) 

7.  Object  Program  m  Machine  Language. 

Testing.  During  the  testing  stage  two  types 
of  tests  are  performed  —  verification  testing 
and  validation  testing.  Verification  testing 
is  sometimes  referred  to  as  systems  integra¬ 
tion  testing.  During  validation  testing  both 
the  hardware  and  software  are  testing 
separately  against  their  requirements  as 
spelled  out  in  the  specifications.  The  object 
of  this  testing  is  to  determine  if  the 
specified  requirements  will  be  met.  After 
successfully  completing  the  validation  testing 
the  software  and  hardware  arc  combined  togeth¬ 
er  and  subjected  to  verification  testing  which 
is  essentially  the  application  of  Input/output 
analysis  to  results  ODtalned  under  a  simulated 
operational  environment. 

The  results  are  then  used  to  determine  the 
degree  of  satisfaction  of  the  user's  require¬ 
ments. 

The  testing  phase  normally  ends  with  an  audit 
of  all  performance  functions.  This  audit  ia 
used  to  document  that  the  performance 
requirements  have  been  met.  Once  the  audit 
(Functional  Configuration  Audit)  has  been  com¬ 
pleted  the  system  las  been  qualified  for 
production.  An  audit  is  then  performed  to 
establish  the  product  Identification.  This 
audit  (Physical  Configuration  Audit)  is  used 
to  verify  that  the  technical  documentation  Is 
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complete  and  a  true  description  of  the 
product  qualified. 

Production.  The  Production  Phase  may  cover 
the  production  of  one  item  or  of  many  items. 

In  the  case  of  a  one  of  a  kind  item,  the 
Production  Phase  is  a  continuation  of  the 
development  process,  in  production  of  many 
items  we  have  the  traditional  mass  production 
line.  The  topics  of  acceptance  and  qualitv 
assurance  become  increasingly  important. 

In  traditional  procurement  models,  production 
is  depicted  as  a  block  of  time,  after  which 
operation  and  maintenance  starts.  Actually 
in  a  multiple  item  procurement  operation  and 
maintenance  will  starl  very  shortly  after  the 
first  production  item  rolls  off  the  assembly 
line.  The  first  item  or  items  are  deployed  to 
the  field  and  run  through  a  shakedown  pro¬ 
cess  to  certify  that  they  are  <v  -or.it tonally 
ready.  So  we  can  see  from  the  Figure  that 
there  are  parallel  production,  deployment 
and  operational/maintenance  phases.  The 
relationship  of  these  phases  is  described 
below. 

During  production  separate  and  parallel 
activities  are  accomplished.  The  hardware 
Items  are  sequentially  manufactured  over  a 
long  period  of  time.  The  hardware  is 
sequentially  accepted  on  n  one-time  basis. 
Activities  necessary  for  the  support  of  the 
hardware  and  software  are  accomplished.  The 
software  production  activities  amount  to 
nothing  more  than  duplication  and  acceptance 
of  the  software  programs  developed  during 
the  Full  Scale  Development  phase.  This 
duplication  and  acceptance  can  be  accomplish¬ 
ed  in  a  matter  of  days. 

During  the  software  support  stage  two  major 
activities  can  be  expected  to  occur.  First, 
the  technical  writing  and  editing  is 
accomplished  to  complete  the  user  maintenance 
and  operation  documents.  The  second  activity 
is  that  of  training  the  user’s  personnel  to 
operate  and  maintain  the  system. 

Training  materials  are  prepared  if  they  have 
not  been  previously  developed  during  the 
Full  Scale  Development  phnsc.  The  training 
program  is  then  conducted.  Training  rooy  be 
through  briefing  or  formal  classroom  instruc¬ 
tions.  Two  separate  and  distinct  types  of 
maintenance  training  must  be  provided  for. 

The  user's  personnel  must  be  trained  to 
maintain  the  equipment  and  the  software. 

The  last  activity  of  the  production  phase 
is  the  acceptance  of  both  the  software  and 
liardware.  Previously  during  the  development 
phase  tests  were  designed  and  specified  for 
acceptance.  These  tests  arc  designed  to 
demonstrate  that  the  hardware  and  software 
comply  with  their  production  acceptance 
requirements.  When  the  equipment  and 
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sof tonre  pass  their  acceptance  test  we  have 
established  with  confidence  that  they  will 
perforn  satisfactorily  in  their  operational 
environment. 


Deployment.  Deployment  activities  take  place 
In  two  different  ways.  First,  in  the  normal 
sense  each  individual  system  must  be  deployed 
to  the  field  before  normal  operations  can 
start.  The  other  deployment  concept  is  that 
of  initial  system  deployment.  The  initial 
system  deployment  activities  are  essentially 
i.  shakedown  cruise.  The  system  Is  taken  to 
Lite  field  and  Installed.  In  the  case  of  air¬ 
craft  sy ' terns ,  the  equipment  Is  normally  in¬ 
stalled  i.  the  factory.  Field  installation 
activity  for  .n-c-.  *  systems  is  generally 
concerned  with  the  placement,  check  out  of 
support  equipment  and  ocher  preparations  for 
support  activities.  Aiter  the  systems  and 
their  support  functions  are  in  place,  user 
tescing  is  accomplished.  The  purpose  of  this 
testing  is  to  assure  that  the  system  performs 
properly  in  the  operational  environment  under 
live  conditions.  The  output  of  this  stage  Is 
a  formal  declaration  by  the  user  that  the 
system  ia  ready  for  normal  operations 
ilnlcial  Operating  Capability). 


ment.  The  revisions,  corrections,  and 
modifications  are  in  essence  a  redevelopment 
through  the  design,  code  and  testing  processes 
covered  previously  In  the  Full  Scale  Develop¬ 
ment  Phusc.  The  Operation  and  Maintenance 
Phase  for  major  systems  usually  run  from  10 
to  2C  years  in  length  or  even  longer.  During 
this  phase  the  system  is  operated  and  main¬ 
tained,  and  modifications  are  made  to  update 
capabilities.  When  the  system  can  no  longer 
fulfill  its  function  (mission)  either  through 
age  (degradation)  or  not  being  able  to  keep 
up  with  changing  threat,  it  will  be  considered 
for  ic|. lacemcnf  and  retirement. 

The  final  stage  of  a  system's  lite  is  retire¬ 
ment  from  active  use  either  through  permanent 
retirement  or  sale. 

As  stated  earlier,  one  of  the  major  obstacles 
to  effective  management  for  ECS  has  been  the 
lock  of  management  understanding  of  the  com¬ 
plicated  acquisition  process.  The  transfer 
ol  knowledge  and  understanding  from  those  who 
have  some  degree  of  expertise  to  those  who  do 
not  has  been  almost  nonexistent.  The  manage¬ 
ment  of  ECS  acquisition  represents  a  major 
problem  within  rhe  DOD  and  industry. 


Operation,  Maintenance  and  Retirement. 
Operation  of  an  Embedded  Computer  System  is 
the  performance  of  its  mission  on  a  regular 
basis.  Because  operation  is  so  readily  under¬ 
stood  we  will  skip  discussion  of  operational 
activities.  Because  of  the  unique  differences 
between  hardware  and  software  we  must  break 
the  maintenance  activities  into  two  separate 
and  cistlnct  types  of  activities. 

Hardware  33  a  component  will  degrade  over  use 
and  time.  Mechanical  parts  wear  out. 
Electrical  components  fall.  Electrical 
characteristics  of  components  may  change  re¬ 
quiring  electrical  adjustments  and  alignments. 
The  hardware  maintenance  activities  are  to  put 
the  equipment  back  into  the  physlcaL  condition 
(specifications)  that  it  was  prior  to  the 
failure.  Thi3  requires  the  use  of  technical 
data,  testing  equipment  and  a  spare  parts 
inventory. 

Software  does  not  fall  in  t  .o  same  way  that 
hardware  falls.  Software  doe3  not  degrade 
over  Its  use  or  time.  It  is  not  subject  to 
the  sudden  and  catastrophic  failures  that 
hardware  is.  One  of  the  unique  features  of 
software  la  Its  consistency.  In  the  opera¬ 
tional  phase  the  failures  of  software  arc  not 
a  cessation  of  the  program's  operation,  but 
rather  the  recognition  of  errors  which  have 
been  In  the  software  all  along.  So  we  cun 
soy  that  the  Software  maintenance  actlvitlcn 
are  the  correction  cf  errors  and  modifications 
of  the  pr<  gran  to  improve  system  capabilities 
Modlficati  ms  are  also  improvements  which 
are  necessary  to  upgrade  systems  capabilities, 
bufiune  o'  the  changing  operotiomil  environ- 
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The  present  educational  process  for  DOD  ECS 
managers  Is  basically  a  learn-whlle-dotng 
process.  A  basic  understanding  of  the 
hardware/sof rware  interfaces  must  ferm  the 
foundation  for  learning  and  improving  the 
management  of  the  ECS  acquisition  process. 

The  Figure  is  a  synthesis  of  the  Cf-epts, 
tasks  and  hardware/software  interrelation¬ 
ships  discussed  earlier  during  tht  l'rc 
acquisition  process. 

In  all  cases  software  activities  appear  to 
lag  behind  the  hardware  activities.  Hard¬ 
ware  decisions  and  activities  ore  l.he  driving 
force  during  most  ECS  acquisitions.  The 
validat lon/verif lrat ion  testing  activities 
are  confusing  ono  in  need  of  clarification, 
Thi6  need  for  ciftrif Icetion  is  also  indicated 
by  the  profusion  of  different  defiiitions 
found  in  the  literature.  Only  the  most 
knowledgeable  managers  seen  to  have  on 
appreciation  for  the  importance  of  softwaie 
production  process. 

In  the  past,  attempts  to  describe  and  explain 
acquisition  tasks  have  been  overaly  depend¬ 
ent  upon  emphasizing  existing  rules,  regu¬ 
lations,  requirements  and  documents  to  the 
detriment  of  understanding.  The  ECS 
ares!  ittlon  tasks  must  bn  explained  In  the 
genera'  terms  o(  goals  to  be  accomp’  I skt ■! 
and  how  to  irrivt  cl  thf  v  v'-als  tn  a 
technical  sense  rathe:  man  |,  ■  'eg 

administrative  requirements.  Esc' 
organization  has  differing  admin  1st t at lv  ■ 
stnndnrdi,,  and  explaining  tasks  Ir  'e-ns  of 
'’in  organization's  requirements  is  c*. 
icadllv  t rnnsi crable  to  another  orgai  t-at  l<m. 
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In  furtherance  of  improved  management  ECS  (7)  Kelson,  E.A.,  "Hanagfment  Handbook  for 

costs  should  be  broken  down  into  hardware,  tbe'Eatlmatlon  of  Computer  Programing  Costs," 

software,  and  system  costs.  Hardware  costs  System*  Development  Corporation,  Santa 

would  ho  only  those  costs  to  develop  and  pro-  Monica,  CA  (March  1976) 

duce  the  hardware  as  a  single  entity.  Soft¬ 
ware  costs  would  be  those  costs  to  develop 
and  duplicate  the  software  as  a  single  entity. 

System  costs  should  be  all  of  those  costs 
occurring  because  the  hardware  and  software 
are  wedded  together  as  an  integrated  function¬ 
ing  system.  In  other  words,  those  costs  which 
would  not  have  occurred  if  software  and  hard¬ 
ware  were  not  integrated  into  a  single  system. 

In  this  way  the  ECS  acquisition  process  can  be 
managed  with  direct  task/cost  accounting 
methods.  To  accomplish  this  task,  an  account¬ 
ing  system  which  will  separate  the  costs  must 
be  developed.  At  present,  few  ECS  programs 
have  an  accounting  system  which  shows  soft¬ 
ware  costs. 

It  should  be  noted  here  that  although  the 
field  evaluation  shows  that  this  model  re¬ 
presents  the  current  state  of  the 
acquisition  process,  this  model  is  not  com¬ 
pletely  adequate  for  today's  needs.  The  soft¬ 
ware  must  be  given  more  attention,  software 
efforts  must  start  earlier,  and  a  unified 
systems  approach  must  be  developed  for  the 
acquisition  of  Embedded  Computer  Systems. 
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INTRODUCTION 


The  objective  of  this  study  was  to  develop  a 
l>lon  to  provide  Air  Force  Logistics  Command 
( AFI.C )  engineers  with  the  capability  to  perform 
Durability  and  Damage  Tolerance  Assessments 
' DAOTA )  of  airframe  structures.  An  organic 
DAT)  A  reliability  supporting  AFlC's  Aircraft 
Sync  '  inir'i  will  allow  the  U5AE  to  Increase 
safety,  ,  .  .  manpower  saving',  through  com¬ 

puterized  damage  evaluation,  decrease  aircraft 
down  time  due  to  structural  damage,  reduce 
contract  lead  time,  reduce  contract  costs,  and 
maintain  technological  pace  with  developments 
In  the  design  of  sophisticated  and  complex 
weapon  systems.  This  paper  Is  an  abstraction 
of  the  final  report,  wnich  was  submitted  to  AFLC 
Headguat  ters  1.1]. 


THE  DAOTA  CONCEPT 


a  DADTA  Is  a  sequence  of  procedures  which  pro¬ 
ject  operational  time  to  failure  of  life- 
limiting  structural  components.  Decisions  to 
extend  aircraft  service  life  may  then  be  based 
on  economic  considerations.  The  DADTA  process 
considers  the  sequence  of  loads  encountered  by 
Che  aircraft  while  performing  Its  mission. 
Sophisticated  computer  programs  are  u'snd  to 
apply  the;--  loads  to  mathematical  models  of 
the  structure,  detect  nigh  stress  areas,  com¬ 
pute  crack  growth  rate  as  a  function  of  flying 
hours,  and  project  the  life  of  the  structure. 

At  each  step,  laboratory  or  'light  tost  data  Is 
used  to  verify  the  analytical  results  [2,3,4], 

Prior  to  OADTA  a  single  production  airframe 
was  fatigue  tested  to  a  preset  number  of  simu¬ 
lated  flying  hours.  The  service  life  was  then 
computed  by  applying  a  statistically  derived 
scatter  factor  to  alio*-  for  dissimilarities  In 
airframe  structure  an  .peratlonal  usage.  Upon 
reaching  this  servi  :<•  limit  the  aircraft  Is 
either  removed  from  flight  or  recertified  by 
further  testing.  Information  Is  a  key  distinc¬ 
tion  between  DAOTA  and  the  earlier  approach. 
Life  limiting  structures  are  specifically  iden¬ 
tified  by  DAOTA  and  the  magnitude  of  the  effort 
necessary  to  extend  the  life  of  the  aircraft 
may  be  assessed  more  accurately. 


THE  SERVICE  TEST 


The  "bjectlve  of  the  service  test  was  to  develop 
a  plan  to  Integrato  a  high  technology  analytical 
tool  into  an  organization  oriented  toward  con- 
»-ar  ad  support  of  engineering  analyses.  The 


organizational  structure  within  which  this 
capability  could  effectively  function  we:,  t  *  i>. 
outlined.  Thu  levels  of  expertise  and  masher: 
of  the  personnel  required  to  support  the  effort 
vere  to  be  specified.  Finally,  the  computer 
configuration  necessary  to  support  the  program 
1:  the  systems  management  environment  was  to  L<‘ 
acet- 1  >!"'•  '  The  plan  was  to  Include  the  recom¬ 
mended  soilin'  n  slid  Identify  all  options 
investigated. 

A  three  phase  program  with  Incre-itio1  commit¬ 
ments  during  each  phase  was  conceived  to  met* 
the  objectives.  The  capability  to  perform  oil 
of  the  DADTA  procedures  was  developed  during 
the  first  phase.  The  concept  and  power  of  the 
teihnl'Mi-x  were  applied  to  actual  systems  m.ir 
agement.  situations  during  the  second  phase. 
Implementation  of  the  capability  throughout 
Air  Force  Logistics  Command  Is  scheduled  ' 
proceed  In  the  third  phase.  This  paper 
dresses  the  service  test  wtikh  comp*' ise*.  . :v 
first  two  phases. 

PHASE  ONE 

The  development  phase  Initiated  in  the  Service 
F.ngineering  Division  of  the  Directorate  of 
Materiel  Management  at  San  Ank-nlo  Air  Logistics 
Center.  The  principle  objectives  Included 
documentation  of  requirements,  1  dent.1  f Ir.atior 
and  acquisition  of  computer  h.  (1*  ire  and  soft¬ 
ware,  training  of  personnel,  and  initiation  •> 
the  T-37  and  7-3P  analyses. 

Phase  One  was  organized  under  a  formalized  pro¬ 
ject  management  concept  [53.  Specialists  from 
several  disciplines  were  brought  together  In  .- 
single  location  under  a  designated  project 
manager.  The  members  of  the  team  concentrated 
their  efforts  on  meeting  the  objectives  of  the 
service  test.  The  project  manager  was  dedicate  i 
to  the  service  lest  and  reported  to  the  third 
level  of  management  in  the  Engineering  Division 
st,  rue  turc 

The  Engineering  nvisfon  provided  analytiu.il 
support  to  system  and  Hem  managers  In  other 
divisions.  Tasks  wore  routinely  transmutes 
between  divisions  at  the  branch  level.  Ea«‘- 
brarch  was  further  divided  inlo  sections  l> 
•ngfnoerlng  specialty.  The  sections  were 
divided  Into  units  which  were  responsible  fo' 
support  of  a  specific  aircraft  system,  thu 
DA'JTA  5,r rvi re  r*--:*  •'"w*  »s  a  settle) 

and  routine  tasks  wrrr  tha'  Horn 

members  of  the  team.  This  .«ti„  .  -'fe« 

lively  isolated  the  project  from  *hc  stems 
support  environment.  The  sf-vUr  test  team 
Included  three  structural  engine  -  s  and  out- 
fractur«  mechanics  specialist.  >»  Rai.tu,. 

•v-i  Panto*  specialist  was  also  v-n  ,.oJe- 
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manager.  Experts  in  aerodynamics  and  computer 
engineering  were  part-time  members  of  the  team. 

The  members  of  the  team  attended  several  con¬ 
tinuing  engineering  short  courses  to  review 
principles  of  OAOTA  procedures.  A  40-hour 
short  course  in  finite  element  structural  anal¬ 
ysis  was  developed  and  presented  to  engineers 
at  San  Antonio  Air  Logistics  Center  on  three 
occasions. 

Ouring  Phase  One  an  exhaustive  trade-off  anal¬ 
ysis  of  proposed  design  modifications  to  the 
T-38  wing  was  completed.  This  effort  Included 
a  complete  analytical  model  of  the  structure. 
Crack  growth  studies  were  performed  on  a  crit¬ 
ical  area  of  the  T-38  wing  using  a  maneuver 
spectrum  for  one  of  the  T-38  missions.  A 
finite  element  model  of  the  entire  T-37  air¬ 
frame  was  constructed  and  a  preliminary  airloads 
computer  model  of  the  T-37  was  developed. 

PHASE  TN0 

The  second  phase  of  the  service  test  began 
during  a  major  reorganization  of  the  Director¬ 
ate  of  Materiel  Management.  The  Isolated 
environment  of  Phase  One  was  abandoned  as  the 
team  became  a  sub  unit  of  the  Aircraft  Struc¬ 
tural  Integrity  Unit  in  the  Systems  Management 
Division.  The  sub  unit  was  given  responsibility 
for  the  structural  integrity  programs  of  the 
T-38  and  was  directed  to  assist  in  supporting 
the  structural  integrity  programs  of  all  other 
aircraft  managed  by  the  division.  Team  members 
were  also  tasked  to  use  their  expertise  to 
support  accident  investigations,  repair  anal¬ 
yses,  and  field  problems.  This  visibility  led 
to  an  increased  awareness  of  the  power  of  DADTA 
by  management  and  by  other  engineers  assigned 
to  the  division.  As  understanding  of  OAOTA 
increased,  the  priorities  of  the  service  test 
personnel  were  extensively  realigned  by  manage¬ 
ment.  Their  expertise  was  applied  to  a  wide 
variety  of  operational  problems  and  the  organic 
DADTA  of  the  T-37  was  delayed. 

The  DADTA  Sub  Unit  continued  the  joint  DADTA 
of  the  T-38  with  the  contractor.  Preliminary 
results  of  this  effort  resulted  in  significant 
modifications  in  the  management  of  the  T-38. 
Several  recommended  changes  to  the  wing  design 
were  incorporated  in  spares  purchases.  A 
design  defect  was  found  to  be  more  severe  than 
anticipated  when  quantitatively  evaluated  and 
required  that  appropriate  action  be  taken  to 
ensure  safety. 

The  group  interacted  with  Non-Destructive 
Inspection  personnel  in  developing  and  imple¬ 
menting  Inspections  of  critical  structures. 

The  DADTA  personnel  frequently  acted  as  consult¬ 
ants  in  meetings  between  contractors  and  engi¬ 
neers  at  San  Antonio  Air  Logistics  Center.  In 
this  capacity  the  )ADTA  group  became  Involved 
in  engine  and  item  management  programs.  Finally, 
the  DADTA  Sub  Unit  personnel  were  frequently 


called  upon  to  present  briefings  to  upper 
management  and  to  visitors  from  outside  the 
Center.  These  briefings  Involved  a  wide  range 
of  topics  related  to  structural  Integrity— 
from  general  discussions  of  the  DADTA  concept 
to  recommended  solutions  of  specific  management 
problems. 

During  Phase  Two  a  comprehensive  master  plan 
for  Implementation  of  the  capability  to  perform 
DADTA  was  prepared  [1].  The  key  points  of 
the  plan  are  outlined  in  the  next  section. 


RECOMMENDATIONS 


ORGANIZATIONAL  STRUCTURE 

The  DADTA  group  should  be  within  the  Engineer¬ 
ing  and  Reliability  Branch  of  the  Systems 
Management  Division.  The  group  should  be 
placed  at  a  functional  level  that  will  permit 
support  to  all  aircraft  systems.  The  ideal 
situation  would  be  for  the  group  to  be  colo¬ 
cated  with  a  centralized  structural  integrity 
unit.  The  criticality  and  technical  sophis¬ 
tication  of  DADTA  will  not  permit  dispersal  of 
the  DADTA  group.  Such  dispersal  would  elimi¬ 
nate  qualified  technical  review  of  projects, 
since  supervisors  who  have  responsibility  over 
several  engineers  with  diverse  specialities 
cannot  be  an  expert  in  every  specialty. 

The  DADTA  resources  will  be  available  to  all 
engineers  at  each  Air  Logistics  Center  (ALC). 

The  DADTA  team  at  each  ALC  will  function 
independent  of  teams  at  the  other  ALCs.  The 
activities  of  each  ALC  DADTA  team  will  be 
monitored  by  the  Headquarters  AFLC  Aircraft 
Structural  Integrity  Program  office  to  ensure 
that  ALC  DADTA  program  objectives  are  being 
met. 

PERSONNEL 

The  initial  DADTA  unit  at  each  ALC  will  have 
two  lead  engineers.  One  will  be  a  structural 
engineer  with  a  finite  element  capability  and 
the  other  will  be  a  fracture  mechanics  spe¬ 
cialist.  These  engineers  will  receive  training 
and  will  oversee  the  implementation  of  the 
computer  hardware  and  software  systems.  Once 
the  capability  is  in  place,  the  DADTA  engineers 
will  begin  the  education  process  of  all  system 
engineers  associated  with  structures  or  struc¬ 
tural  Integrity.  One  year  after  initiation, 
the  lead  engineers  will  be  supplemented  with 
project  engineers  as  required.  The  lead  engi¬ 
neers  will  continue  to  act  as  consultants  and 
educators  while  the  project  engineers  will 
provide  routine  support  of  DADTA  requirements. 
All  projects  performed  by  the  DADTA  project 
engineers  must  be  checked  for  technical  accuracy 
by  the  lead  engineer. 
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COMPUTER  SOFTWARE 

All  computer  programs  used  by  DADTA  are  rou¬ 
tinely  available.  Several  finite  element 
structural  analysis  programs  are  currently  in 
use.  NASTRAN,  COSMIC  Version,  is  recommended 
for  AFLC  use  because  oc  organic  Air  Force 
support.  Tne  programs  SPCCA,  RPCM,  and  RSG 
are  recommended  for  use  in  spectrum  development. 
CRACKS  IV  is  recommended  for  crack  growth 
studies.  The  University  of  Arizona  GIFTS  inter¬ 
active  graphics  package  is  recommended  to  facil¬ 
itate  construction  and  evaluation  of  finite 
. -nt  models.  Several  other  pre  and  post 
■rjcfc  iir.u  prouiams  are  also  discussed  in 
Reference  1  j. 

COMPUTER  HARDWARE 

The  computer  support  required  for  DAOTA  Includes 
a  large  main  frame  computer  with  sufficient 
capacity  to  run  HASTRAH,  a  remote  site  with  a 
mini  computer  and  remote  interactive  graphics 
c inability,  and  a  4800  baud  communication  line 
..onrecting  the  remote  to  the  central  computer. 
The  main  frame  computer  must  be  located  at  each 
AtC  so  that  prioritization  of  systems  require¬ 
ments  may  be  maintained  by  the  Commander  of 
ea-.h  >rtor.  A  central  computer  serving  all 
Centers  would  result  in  priorities  being  set  at 
AFLC  level  and  would  penalize  efficient  users 
during  periods  of  increased  requirements. 

IRA  IN  I'lli 

'h’-ee  courses  must  be  administered  at  each  ALC. 
The  OAOTA  unit  will  have  responsibility  for 
instructing  courses  in  DAOTA  concepts.  Finite 
Element  Strjctural  Analysis,  and  Fracture 
Mt-chaiics.  All  of  these  courses  have  been 
prepared  at  CA-ALC  and  will  bn  distributed  to 
the  ocher  ALCs.  Several  industries  and  uni¬ 
versities  offer  short  courses  in  DADTA  concepts 
and  Finite  Flcment  Structural  Analysis.  It  is 
•ligniy  recommended  that  at  least  one  person 
from  each  OADIA  un>t  attend  both  of  these 
formal  courses  annually.  The  first  level  man¬ 
ager  above  the  0A01A  load  engineers  should 
also  attend  a  formal  course  in  DADTA  concepts 
to  gain  a  greater  perspr  Live  on  OAOTA 
potential.  Relerence  .  recoomends  specific 
courses  and  their  lo.  at  ,ns. 

OAOTA  QUALITY  CONTROL 

Safety  of  flight  is  directly  involved  in  OAOTA 
projects.  Repair  of  damaged  critical  airframe 
structure  requires  controls  to  guard  against 
the  possibility  of  a  faulty  analysis.  Most 
repair  analyses  within  AFLC  are  performed  by 
contract.  Implementing  the  technology  and 
capability  to  perform  DAOTA  of  aircraft  struc¬ 
tures  organically  calls  for  adherence  to  stand¬ 
ard  p>  iject  engineering  quality  control 
proce'  ires.  A  lead  engineer  will  check  t'- 
teclini  al  accuracy  of  Mir  analysis  performed 
hv  tin  nrolect  » sq  inert  HrviCw  for  inq'tiKt 


impact,  feasibility,  and  implementation  will 
be  provided  by  first  level  management. 
Approval  will  be  granted  at  whatever  manage¬ 
ment  level  is  necessary  for  implementation  of 
the  project  recommendations. 


CONCLUSION 


Organic  DADTA  is  a  viable  concept  if  management 
is  willing  to  support  the  requirements  of  this 
hicih  technology  analytical  tool.  An  effective 
DAOTA  prcgr.v  must  have  experienced  personnnl 
dedicated  to  OAOTA,  a  training  program,  computer 
resources,  and  a  library  of  technical  reference 
material.  Incorporation  of  DADIA  within  AFLC 
will  require  careful  evaluation  ot  cute  packages 
acquired  with  future  aircraft  systems.  The 
combination  of  organic  DADTA  capability  and 
coordinated  acquisition  of  data  will  signifi¬ 
cantly  enhance  the  capability  of  the  Air  Force 
iogistic*  Command  to  respond  to  the  needs  of 
the  user  ccmnands. 
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Nrw  INTTIAT ivrs  IN  SPinrifATlONS 

Joseph  L.  Welnqarten,  Deputy  for  Lnyliibet  Intj,  Aeronaut  Iral  ‘•yklume  DlvUluh 


The  Aeronautical  System  Division  has  un¬ 
dertaken  a  new  program  to  upgrade  its  methods 
of  uritlng  and  using  specifications  and  stan¬ 
dards  in  the  Research  and  Development  en¬ 
vironment. 

This  effort  represents  an  evolution  of 
the  specifications  and  standards  of  today  to 
meet  our  needs  in  a  very  fast  changing  tech¬ 
nical  society. 

Background 

Our  specifications  of  today  are,  in  them¬ 
selves,  not  bad  documents  as  many  have 
claimed  but  rather  are  misapplied.  In  reali¬ 
ty,  today's  specifications  are  written  to 
procure  a  specific  item.  Over  the  years, 
this  philosophy  of  the  detail  specification 
had  spread  into  Research  and  Development  pro¬ 
curements.  This  has  been  recognized  by 
various  groups  as  a  major  contributor  to  the 
high  cost,  of  military  systems. 

The  problems  associated  with  these  docu¬ 
ments  were  the  application  of  them.  A 
Defense  Science  Board  Task  Force  reviewing 
this  area  initial  findings  were  reported  by 
Deputy  Secretary  Clements  to  the  Military 
Department  Secretaries:  "The  Task  Force  has 
concluded  the  content  of  specifications  and 
standards  is  not  the  primary  contributor  to 
unnecessary  contract  costa  although  there  Is 
a  continuing  need  for  evolutionary  improve¬ 
ment.  Thi  main  cause  of  coat  escalation  was 
Identified  to  be  in  the  application,  inter¬ 
pretation,  demonstration  of  compliance  and 
enforcement  of  specifications  and  standards 
in  RFPs  (sic:  Request  for  Proposals)  and  con¬ 
tracts.  This,  therefore.  Is  a  fertile  area 
for  effective  cost  reductions  in  the  acquisi¬ 
tion  process."  Deputy  Secretary  Clements 
directed  the  Department  Secretaries  to  "In¬ 
stitute  Procedures  and  Policies  to  control 
blanket  contractual  Imposition  of  such  speci¬ 
fications  and  standards.  These  controls 
should  be  structured  to  force  technical  acti¬ 
vities  to  tailor  requirements  to  the  essential 
specific  operational  needs  of  the  end  Item  or 
system."  (Underlines  added)  The  overall 
theme  is  to  force  tailoring  and  state  require¬ 
ments  in  terms  of  operational  needo. 

The  Task  Force  recommended  two  steps  in 
its  April  1977  final  report;  an  evolutionary 
program  to  Improve  existing  specifications, 
and  an  immediate  program  throughout  the  ser¬ 
vices  and  Industry  to  improve  the  climate  of 
applying  the  specifications. 

During  this  same  time  period,  another  ex¬ 
amination  was  taking  place  viewing  the  overall 
budget  and  procurement  cycle.  This  reeulted 
in  reforms  established  by  the  Congressional 
Budget  Act  of  1974  (Public  Law  93-344)  vhich 
becomes  effective  with  the  FT  1979  budget. 


Within  the  Executive  Branch,  the  Office 
of  Management  and  Budget  issued  Circular  No. 
A-109  to  provide  policy  to  all  executive 
agencies.  Circular  A-109  basically  requires 
that  a  request  for  funds  should  be  based  on  a 
mission  need  rather  than  a  specific  hardware 
item. 

Figure  1  illustrates  the  difference  be¬ 
tween  the  current  system  and  the  A-109 
(mission)  approach.  Figure  2  shows  a  flow 
chart  of  how  the  mission  approach  would  con¬ 
tinue  down  to  the  various  R&D  projects. 

In  January  1976,  the  Aeronautical  Systems 
Division  started  an  effort  to  review  its  own 
utilization  and  development  of  military  speci- 

000 illustration 


UMM  CUMMtKT  <MOMN 


ADVIMC90  TACT)  coaster  Art* 
CAlfOMTtft 
I 


UtIMO  VtftOAC* 


MMKN  lacmai  »*a*auA« 


AllO"  U(t  •'•Timotcraow 


It M>  I  AlMMUTivt  MAUfclft 

Mtoacrti  ««MTfSMK4< 

i  MMOTISHOTUM 

vtsiur. 


MWIVwuTivl  MUM  fO»wt 

M*  M»o  **rt  1%  •**•!  O  tow **o 
ItWsMO  AMC««*  r  WtUTXyi 


Figure  1 


»  SOSOS  MT*0*C* 


Figure  2 


m-,  i 


with  the  back-up  rationale  in  the  handbook. 

In  developing  this  concept,  it  was  found 
that  in  some  cases  requirements  within  speci¬ 
fications  could  not  be  logically  verified.  In 
prime  documents,  any  requirement  must  be  veri¬ 
fied  by  a  corresponding  verification,  whether 
it  be  a  test,  analysis,  or  inspection. 

Two  other  typical  problems  are  trying  to 
find  the  right  person  to  ask  a  question  on  a 
specification;  and  second,  finding  the  indi¬ 
vidual  accountable  for  these  documents.  In 
the  present  system,  they  are  "anonymous".  A 
new  facet  will  be  the  inclusion  of  name, 
address,  and  phone  number  of  the  individual 
responsible  for  the  document,  keeping  it  up 
to  date,  in  a  manner  similar  to  *-he  crew  chief 
who  has  his  name  painted  on  the  side  of  an 
aircraft. 

While  we  have  described  the  specifications, 
standards  follow  the  same  basic  format;  the 
difference  being  chat  the  "standard  values" 
appear  in  the  document  and  that  we  are  not 
procuring  an  item  of  hardware.  In  writing 
the  primary  specifi.ation,  we  envision  only 
the  standards  as  being  referenced. 

In  practice  (sic:  Fig  3)  the  primary 
specification  is  a  guide  that  the  project 
engineer  must  now  tailor.  He  must  examine 
the  blanks,  fill  in  the  applicable  operational 
'w-  needs  based  on  user  input,  provide  interface 

requirements,  and  tailor  the  test  section  to 
the  mission  needs.  This  document  has  been 
designated  a  Type  I  specification,  and  it  la 
a  development  specification  stating  the  per¬ 
formance  requirement  for  design  or  engineer¬ 
ing  development  in  terras  of  the  operational 
nced3.  The  Type  I  specification  becomes  part 
of  the  Request  for  Proposal.  The  government 
evaluates  the  contractors'  proposals  against 
this  document  and  Issues  a  contract.  The  Item 
Is  then  developed  and  after  it  has  been  found 
acceptable,  either  the  contractor  or  govern¬ 
ment  would  prepare  a  Type  II  specification. 
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This  is  a  product  specification  6tating  detail 
design  requirements  for  procurement  of  a  pro¬ 
duct  in  terras  of  specific  design  needs,  basi¬ 
cally  what  today  Is  a  military  specification. 
It  may  even  be  possible  tbst  from  one  Type  I 
specification  a  series  of  Type  IIs  would  e- 
volve,  such  as  for  new  components  that  were 
developed  as  part  of  this  effort.  Today,  too 
often  we  directly  write  the  military  specifi¬ 
cation  (Type  II).  Tills  is  almost  like  having 
the  answer  before  the  question  is  asked. 

This  is  not  really  new  but  is  an  adoption 
of  a  technique  that  has  been  very  successfully 
used  in  development/reprocureraent  of  component 
items,  such  as  nircocircuits  and  switches 
within  today'B  specification  system.  For 
some  component  series,  a  general  design  speci¬ 
fication  exists  and  in  a  manner  they  contain 
blanka.  The  blanks  ore  stated  by  the  term 
"as  specified".  A  development  document  is 
provided  by  the  procuring  agency  which  states 
the  "as  specifieds" .  After  development,  a 
final  detail  specification  is  issued  for  re- 
procureraent.  The  primary  specification  is 
similar  to  the  general  design  document  and  tie 
Type  II  is  the  ease  36  the  detail  specifica¬ 
tion.  One  improvement  is  the  Type  I  specifi¬ 
cation,  which  now  would  provide  a  standard 
bridge  frora  the  start  to  the  final  document 
missing  in  today's  procurement  method. 

At  first,  this  appears  to  Increase  the 
number  of  specifications  and  it  nay  if  we 
were  to  view  the  military  specification  sys¬ 
tem  only.  In  reality,  there  are  additional 
specification  systems  within  the  Department 
of  Defense.  In  many  cases  today,  rather  than 
use  a  specification,  an  exhibit  of  MIL-STD- 
490  specification  is  prepared.  A  major  pro¬ 
blem  exists  In  the  49C  system.  In  many  cases, 
the  hardware  documentation  that  is  developed 
is  not  available  to  outside  activities;  ;  l 
as  a  result,  standardization  efforts  take  a 
second  seat. 

With  the  developnent  of  a  prime  document 
in  each  technical  area,  exhibits  or  MIL-STD- 
490  documents  will  no  longer  be  required. 
Figure  4  shows  the  relationship  of  the  cur¬ 
rent  specification  systems  to  the  prime  sys¬ 
tem.  This  will  result  in  using  one  baseline; 
the  prime  specifications  rather  than  the 
various  docioentutlor.  systems  in  use  today. 

One  thing  this  program  accomplishes  is  to 
raise  the  level  of  the  specification  to  a 
higher  level  in  the  procurement  tree.  We  have 
been  too  concerned  with  nut  >  and  bolts  and 
individual  items  such  ac  ,  '-rtlcular  radios 
and  radar  units.  The  Primary  Concept  allows 
us  to  move  up  to  entire  functions!  areas 
such  as  an  aircraft  structure,  offensive 
avionics,  or  even  to  categories  such  as  auto- 
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f  nations  and  standards.  At  the  time,  there 
was  no  attempt  to  marry  the  specification 
system  and  A-109  budget  syot  m.  What  has 
evolved,  however.  13  a  systems  approach  to 
specifications  in  the  RSD  cycle  that  fits  the 
objectives  of  A-109  and  meets  the  long  range 
reeommer.dat ion  of  the  Defense  Science  3oard. 
While  the  A-109  looks  towards  mission 
apptoach,  these  specifications  view  mission 
needs  and  at  the  same  time  have  evolved  into 
a  new  document  that  forces  tailoring.  It  is 
interesting  to  note  in  the  experimental  usage 
o '  •his  new  system  the  tailoring  philosophy 
lies  carried  over  from  specifications  into 
>'hcr  itei  s  v  -h  as  data  items  and  management 
plans. 

The  New  Specifications 

Arc  they  new?  No'.  But  rather  caking  the 
best  parts  of  a  variety  of  specification  sys¬ 
tems  from  both  government  and  industry  and 
putting  them  into  a  logical,  single  structure. 

In  developing  new  weapon  systems,  our 
military  services  are  facing  sharply  rising 
costs  from  two  directions.  The  first  is  due 
to  the  highly  sophisticated  equipment  required 
on  the  modern  battlefield  and  the  maintenance 
of  chat  equipment.  Toe  second  cost  driver  is 
nor.  very  visible;  it's  the  way  we  write  and 
use  our  specification  in  a  world  of  advancing 
technology. 

We  live  In  a  rapidly  changing  environment 
anu  we  need  documentation  that  is  adaptable 
to  change,  tuir  current  specification  systems 
is  not  adaptable  to  rapid  change.  Conse¬ 
quently,  it  has  come  under  repetitive  attack 
as  a  major  coot  driver.  However,  every  group 
investigating  the  system  has  generally  come 
to  the  came  conclusion.  It  is  a  required 
system,  hut  fine  tuning  and  slow  improvements 
wilt  not  meet  our  iuture  needs. 

In  various  aircraft  prototyping  programs. 
ASD  has  found  giving  contractors  maximum 
flexibility  and  minimum  supervision  has 
resulted  in  technica"  successes.  W.j  must 
applv  this  flexlbil  ,  to  all  weapon  s /stems 
programs.  To  accoc;  ian  thin,  we  have  devel¬ 
oped  a  new  series  documents  called  the 
Primary  Specification,  Standard,  and  Handbook. 
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will  consist  of  three  types  of  primary  docu¬ 
ment;  specifications,  standards,  and  handbooks 
Tito  primary  specification  (Mil-Prime)  are 
aimed  at  specifying  operational  needs  and 
general  parameters  for  a  physical  product 
family  with  the  specific  values  leit  blank. 

The  primary  standard  (Mil-Prime-Std)  provides 
the  criteria  and  qualities  applicable  to  a 
physical  product  but  Is  not  used  to  procure 
any  actual  product,  and  in  many  cases  Is  very 
similar  to  our  standards  of  todav.  The  pri¬ 
mary  handbook  (Mil-Prlrae-Kandbook)  contains 
technical  rationale  for  the  requirements 
stated  in  each  primary  specification  and  stan¬ 
dard,  provides  guidance  for  applying  the  speci¬ 
fications  and  standards,  and  is  a  depository 
for  lessons  learned  in  each  tech:--.nl  area. 

Ke  would  not  develop  a  primary  document  for 
each  individual  product  or  service;  this 
would  just  duplicate  the  44,000  military 
specifications  and  standards  in  today’s  sys¬ 
tem.  Instead,  a  broad  family  grouping  will 
be  established.  These  Mil-Prime  product 
families  will  cover  such  areas  as  airborne 
radios,  fasteners,  parachutes,  landing  gear, 
or  the  entire  airrraft  structure. 

The  prime  standards  basically  encompass 
the  "ilities”  (reliability,  maintainability, 
etc)  as  well  as  "standard  test  methods"  c.' 
"climatic  extremes".  The  handbooks  will  ex¬ 
plain  where  a  requirement  came  from  and  whv 
we  require  it  for  both  the  specifications  and 
standards. 

These  "Mil-Prime"  document.,  with  the 
operational  values  blank,  will  fo,v..  tailorin'-. 
They  also  provide  a  depository  for  "corpor.. 
memory”  and  will  allow  others  to  question  0 
requirements  based  on  facts.  No  longer  can 
anyone  say  "you  must  do  it  this  way  because 
the  specification  says  so",  and  so  the  argu¬ 
ment  ends.  Now  the  argument  must  rotate 
about  the  rationale  contained  in  the  hand¬ 
book.....!  logical  point  of  departure.  As  now 
lessons  are  learned  and  technology  changes, 
the  handbooks  will  be  updated. 

As  the  specification  is  used,  the  blanks 
are  filled  in  by  the  project  engineer,  .he 
handbook  assists  In  this  filling-in  pror 
by  ■.bowing  ..ov  o  rHi  in  the  blanks  and, 
most  important!'',  the  rati" 'ale  for  the 
requirements 

Of  course,  these  documents  are  not  Just 
blanks.  A  closer  look  at  the  primary  spofl- 
thflibv  would  shew  net  only  blank  oporatl*  -1 
.i«nh,  hut  in  add!' Ion,  a  section  on  Intel- 
taie  w.uid  be  nrovllc'.  The  project  engineer 
would  i-uviuc  ne  1 «. 4  .  U.ir  >. ,  eequireca  r' 
muh  .Hi  n  nlze  ot  a  b.tv,  1 ,  t  *.,  1  : 

number,  even  available  power  and  t>j*  ‘r 
detalln  on  gocrnmenl  famished  equipment . 

•  he  reran'  al  oomnunltv,  we  ha  *t  atnndnr1 1 
value1  ,  surh  nil  aafotv  factors.  Those  wi-ii 
’•*  -aiinaliicl  within  the  dorc-er  1  o'  v- 


Figure  4 

natie  test  equipment  and  Simula tore.  Within 
the  Department  of  Defense,  this  method  has 
been  very  successfully  utilized  at  the  com¬ 
ponent  level.  For  higher  order  procurements, 
this  same  concept  can  be  used.  These  are  the 
area*  the  Air  Force  program  is  attacking. 

With  experience,  it  may  even  be  possible  to 
view  whole  systems  ouch  as  the  air  vehicle 
or  support  vqulpcent. 

Tills  new  concept  also  offers  the  Depart¬ 
ment  of  Defense  with  an  opportunity  to  develop 
a  new  numbering  system  for  specifications. 
Today's  system  is  based  on  allocation  of  num¬ 
bers  to  branches  and  assignment  thereafter  in 
numerical  order.  This  does  not  facilitate 
data  retrieval  or  provide  a  convenient  method 
•o  trace  known  products  to  avoid  duplication. 
One  suggested  approach  has  been  that  each 
primary  spe- , fixation  area  be  assigned  a  num¬ 
ber.  The  handbook  would  have  the  same  number. 
The  Type  I  end  Type  II  specifications  would 
be  issued  an  additional  number  to  the  basic 
prime  number  such  ns  a  dash  number.  In 
areas  where  the  primary  document  covers  a 
broad  terlmologv,  additional  coding  may  be 
necessary.  The  end  objective  in  to  provide 
a  cumbering  system  chat  would  allow  easy 
examination  of  all  products  already  available 
within  DOD  that  have  been  developed  within 


any  one  class.  When  we  combine  this  new  num¬ 
bering  system  with  al1  types  of  specifications 
ir.  one  system,  we  also  move  forward  in  achiev¬ 
ing  another  important  goal  -  standardization. 
This  is  accomplished  by  putting  at  the  de¬ 
signers'  fingertips  what  is  available  in  a 
logical  order  not  only  what  is  in  the  current 
system,  but  also  the  MII.-STD-490  specification 
•hat  today  would  have  been  left  out.  For  ex¬ 
ample,  let  us  assume  we  want  to  use  a  blind 
rivet  on  an  aircraft.  The  primary  area  would 
be  fasteners,  and  we  would  have  additional 
coding  for  bolts,  nuts,  screws,  rivets,  etc. 
The  end  number  ir  shown  in  Figure  5. 

On  the  whole,  the  number  of  development 
specifications  will  decrease  and  the  number  of 
detail  specification  will  remain  the  smr-. 

But  we  will  know  where  things  ace,  and  what 
has  been  developed  with  DOD.  Thi3  In  Itself 
will  be  a  vast  improvement. 

In  viewing  standardization  we  must  remem¬ 
ber  that  the  amount  of  standardization  in  a 
management  decision.  The  specification  and 
standards  only  serve  as  a  catalog  of  what  is 
available.  Utilization  of  the  new  numbering 
system  will  improve  standardization  by  pro¬ 
viding  a  better  picture  of  what  is  available. 

At  this  point,  we  have  discussed  the  Pri¬ 
mary  Concept  and  what  it  does  accomplish.  The 
movement  to  operational  needs  will  allow  dif¬ 
ferent  contractors  to  bid  different  solutions 
to  a  particular  problem  rather  than  aolving 
the  mechanics  of  single  solution  ns  described 
in  so  cany  of  today’o  specifications  Tne  end 
result  will  be  a  better  product  more  respon¬ 
sive  to  the  user’s  needs.  It  will  encourage 
innovative  design  and,  at  the  same  time,  re¬ 
duce  gold  plating,  because  so  many  of  the 
"cover  your  _ "  (fill  in  the  blank)  docu¬ 

ments  will  no  longer  be  thrown  on  the  stack 
of  specifications.  Another  point  in  this 
area  is  the  forced  tailoring  which  will  con¬ 
tribute  very  strongly  to  meeting  these  object¬ 
ives.  The  concept  of  broad  primary  documents 
will  liave  an  effe-t  of  reducing  tiering  or 
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references  from  one  document  to  another.  This 
will  contribute  cost  savings  In  the  long  term 
as  well  as  a  reduction  In  paper  work.  It 
also  removes  problems  where  one  referenced 
document  conflicts  with  another  referenced 
document. 

One  document  that  has  lingered  in  the 
background  of  this  discussion  Is  the  handbook. 
Not  much  has  been  said  other  than  it  will  pro¬ 
vide  the  rationale  and  instructions  for  the 
specifications  and  standards.  If  we  examine 
this  new  document  carefully,  we  can  find  that 
it  is  one  of  the  most  important  aspects  of 
this  program.  Today,  we  do  not  have  a  true 
depository  in  each  technical  area  to  retain 
our  lessons  learned.  These  handbooks  would 
fulfill  this  need.  In  viewing  the  rationale 
behind  requirements  and  criteria,  these  may 
change  when  conditions  or  state-of-the-art 
progresses.  Today,  changes  to  criteria  can 
be  very  difficult  to  effect  when  you  do  not 
know  why  a  factor  was  established  30  years 
ago.  It  will  also  open  up  our  rationale  to 
the  public  for  our  requirements,  adding  an 
important  check  and  balance  that  is  missing 
today.  It  will  allow  us  to  apply  the  lessons 
learned  from  one  weapon  system  to  another 
since  we  are  using  the  "same  specification". 
Only  the  blanks  change  and  give  us  the  same 
baseline  for  different  programs. 

How  does  the  government  engineer  fit  in? 
First,  for  each  primary  document,  there  will 
be  known  focal  points.  We  project  him  to  be 
a  busy  man  maintaining  the  handbook  for  his 
specification  or  standard.  In  the  real  world, 
we  foresee  very  little  change  to  the  specifi¬ 
cation  or  standard;  but  constant  change  to  the 
handbook.  The  engineer  with  the  procurement 
team  will  be  required  to  fill  in  the  blanks 
and  prepare  the  Type  I  specification.  This  is 
a  prelude  to  an  extremely  hard  task,  that  of 
source  selection.  Determining  if  a  proposed 
solution  can  be  accomplished  ae  stated  and  its 
potential  for  success  will  not  be  a  simple  task 
and  will  require  the  highest  degree  of  pro¬ 
fessionalism  on  the  part  of  the  government 
engineer.  After  selection  ar.d  development, 
the  operational  test  program  will  provide  the 
engineer  with  another  challenge. 

How  does  this  affect  the  contractor?  He 
now  has  latitude  to  truly  design  a  solution 
within  his  area  of  expertise.  But  on  the 
other  side  of  the  coin,  he  must  now  take  a 
total  systems  approach.  The  handbook  gives 
him  a  baseline  to  depart  from.  In  meeting  the 
needs  of  the  Air  Force,  his  responsibility 
has  vastly  increased. 

Is  this  concept  a  dream?  No!  The  Aero¬ 
nautical  Systems  Division's  (ASD)  Deputy  for 
Engineering,  under  the  direction  of  the  Air 
Force  Systems  Conmund  and  Headquarters,  United 
States  Air  Force,  is  already  moving  into  this 
program  with  an  impressive  set  of  primary 


specifications  being  prepared.  These  include 
electronic  countermeasures  equipment,  landing 
gear,  parachutes,  and  airframe  structures. 

Some  of  these  documents  are  going  to  take  al¬ 
most  two  years  to  develop.  This  is  not  an 
easy  task.  When  the  program  will  be  finished 
in  1981-82  time  frame,  ASD  will  have  less  than 
100  documents.  The  Department  of  Defense  (DOD) 
is  viewing  this  effot:  :o  determine  if  it  can 
be  applied  to  all  DOD  agencies.  Success  at 
ASD  may  result  in  change  throughout  the  entire 
military  establishment. 

While  these  new  documents  are  being  pre¬ 
pared,  the  overall  philosophy  is  being  used  in 
development  of  current  system  specifications. 
The  F-16  and  YC-14/YC-15  aircraft  are  using 
this  concept  In  their  procurement.  Further, 
many  individual  equipment  items  will  be  pro¬ 
cured  in  this  manner.  Initial  findings  in 
use  of  this  concept  to  the  CX-1  program  (¥014/ 
YC-15)  show  significant  improvements  in  its 
use.  In  the  case  of  this  program,  both  con¬ 
tractors  have  found  savings  in  being  able  to 
respond  to  an  operational  need.  For  example, 
the  RFP  does  not  have  a  fastener  specification, 
but  rather  views  the  aircraft  mission.  Both 
contractors  have  approached  the  fastener  de¬ 
sign  from  a  different  standpoint;  and  in  both 
cases,  the  cost  savings  were  in  the  range  of 
the  cost  of  one  aircraft  in  this  program. 

Both  contractors  have  indicated  that  the 
procurement  and  specification  methods  used  in 
this  program  have  saved  $50-75  million  (actual 
data  not  releasable  as  program  ia  still  under 
source  selection) . 


Over  the  past  years,  the  Department  of 
Defense  has  tried  many  different  procurement 
techniques.  It  seems  that  many  of  these 
techniques  have  not  resolved  our  procurement 
problems.  A  major  contributor  to  these  pro¬ 
blems  has  been  the  application  of  specifica¬ 
tions.  The  specifications  have  been  a  common 
denominator  over  the  years  and  possibly  these 
documents  have  been  the  problem. 

The  Mil-Prime  program  in  combination  with 
A-109  offers  an  opportunity  to  provide  a  mean¬ 
ingful  procurement  system.  We  have  also  found 
the  tailoring  philosophy  of  the  Mil-Prime  con¬ 
cepts  has  flowed  to  data  items  and  management 
plans  in  their  U6e  on  a  particular  program. 

The  Mil-Prime  Program  is  new,  and  ASD's 
testing  of  the  new  system  will  result  in  fine 
tuning  over  the  next  few  years.  Results  so 
far  indicate  this  is  a  viable  approach  to 
vastly  improve  our  procurement  of  new  systems. 


601 


COMPUTER-ENHANCED  LAW-ORIENTED  RESEARCH 

Lieutenant  Colonel  Michael  E.  Murphy,  Federal  Legal  Information  Through  Electronics 


INTRODUCTION 


Federal  Legal  Information  Through  Electronics 
(FLITE)  is  a  service  organization.  It  har¬ 
nesses  computer  technology  to  assist  in  law- 
oriented  research.  Its  services  are  available 
to  the  entire  federal  government.  Its  charter 
appears  in  Department  of  Defense  (DOD) 
Directive  5160.64,  Federal  Legal  Information 
Through  Electronics  (FLITE),  dated  9  October 
1974. 


ORGANIZATION  AND  MISSION 


The  DOD  General  Counsel  provides  policy 
guidance  for  the  administration  and  management 
of  FLITE.  The  Department  of  the  Air  Force 
serves  as  executive  agency  for  DOD.  The 
Secretary  of  the  Air  Force  has  delegated  to 
The  Judge  Advocate  General,  United  States  Air 
Force,  the  duty  to  operate  FLITE.  FLITE  is 
operated  in  the  Gilchrist  Building  at  Lowry  Air 
Force  Base,  Denver,  Colorado,  as  a  detached 
Executive  Services  component  of  The  Judge 
Advocate  General's  Office.  It  is  headed  by 
the  Chief  of  FLITE  and  has  three  major 
functional  areas:  Administration  and  Resource 
Management,  Electronic  Data  Processing,  and 
User  Services.- 

The  FLITE  mission  is  to: 

create  and  maintain  data  bases  consisting 
of  legal  information  for  use  in  law  and 
related  fields; 

provide  computer  search  services  for  all 
established  data  bases; 
produce  special  computer  products; 
provide  advisory  service  to  federal, 
state,  and  local  government  agencies  on 
computerized  legal  information  research. 


HOLDINGS 


FLITE  maintains  the  following  computerized, 
full-text  data  bases: 

U.  S.  Constitution 
U.  S.  Code 

U.  S.  Code  of  Federal  Regulations 
U.  S.  Reports 

U.  S.  Supreme  Court  Reporter 
Federal  Reporter  2nd  Series 
Federal  Supplement 
Decisions  of  the  U.  S.  Comptroller 
General  (published  and  unpublished) 


Armed  Services  Procurement  Regulation 
U.  S.  Court  of  Claims  Reports 
Court-Martial  Reports 
Manual  for  Courts-Martial 
International  Agreements  of  Special 
Interest  to  DOD  (published  and 
unpublished) 

The  following  data  bases  are  scheduled  for 
addition  in  1978: 

Public  Laws  and  Reorganization  Plans 
appearing  in  U.  S.  Statutes  at  Large 
Opinions  of  the  U.  S.  Attorney  General 
Bevans  (international  agreements)  Series 
U.  S.  Treaties  Series 
Federal  Reporter  1st  Series 
Legislative  Histories  and  Executive 
Orders  appearing  in  U.  S.  Code 
Congressional  and  Administrative  News 
Opinions  of  The  Judge  Advocates  General 
of  the  Armed  Forces 

Decisions  and  Reports  on  Rulings  of  the 
Assistant  Secretary  of  Labor  for 
Labor-Management  Relations,  Pursuant  to 
Executive  Order  11491 
Decisions  and  Interpretations  of  the 
Federal  Labor  Council 
Rulings  on  Requests  for  Review  of  the 
Assistant  Secretary  of  Labor  for 
Labor-Management  Relations,  Pursuant 
to  Executive  Order  11491,  as  Amended 
U.  S.  Tax  Court  Reports 
Board  of  Tax  Appeals  Decisions 


PUBLICATIONS 


FLITE  has  published  a  pamphlet,  FLITE:  J,cgal 
Research  For  You,  and  each  quarter  publishes 
the  FLITE  Newsletter,  Air  Force  Recurring 
Publication  110-3. 


INFORMATION  SERVICES 


FLITE  User  Services  attorney-advisors  have 
access  to  the  FLITE  data  bank  and  to  the 
Justice  Retrieval  and  Inquiry  System  (JURIS) 
data  bank.  These  attorney-advisors  provide 
computer  search  information  based  on  user 
requests.  Authorized  users  include  all 
entities  of  the  federal  government.  Search 
services  are  provided  without  fee  to  the 
Office  of  the  Secretary  of  Defense  and  all 
DOD  components  (Including  the  U-  S.  Coast 
Guard),  the  Executive  Office  of  the  President 
of  the  United  States  (including  the  Library  of 
Congress),  and  the  U.  S.  Supreme  Court.  All 
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Although  the  library  is  now  working  on  in¬ 
creasing  the  book  portion  of  the  collection, 
volume-wise  books  will  always  be  a  minor  part 
of  its  holdings.  Traditional,  hard-bound 
books  on  contracting  and  related  subjects  arc 
relatively  scarce;  however,  this  Is  not  the 
case  for  the  additional  subjects  now  being 
incorporated  in  the  collection.  Due  to  the 
short  shelf  life  of  information  in  this  field, 
the  growth  in  the  library's  holdings  will  be 
concentrated  in  the  report  literature  section. 
It  is  through  the  reports,  theses,  conference 
and  seminar  proceedings,  and  journals  that 
most  new  Ideas  are  presented,  criticized,  re¬ 
fined  and  disseminated  to  colleagues.  A 
highly  specialized  collection  of  this  type 
requires  non-trnditional  methods  for  acquiring, 
organizing,  cataloging,  and  circulating  its 
materials.  Therefore,  the  FAI  library  is 
already  a  non-traditional  research  center,  and 
it  plans  to  h"come  even  more  so  in  the  future. 

Satisfying  user  needs  and  requirements  is  the 
"raison  d'etre"  of  any  worthwhile  library, 
especially  one  vliose  chief  patrons  are  en¬ 
gaged  in  research  and  management.  Although 
still  In  the  process  of  determining  the  full 
extent  of  the  informational  needs  of  the 
Office  of  Federal  Procurement  Policy,  the  FAI 
member  agencies,  and  the  rest  of  the  acquisi¬ 
tion  community,  the  library's  initial  effort 
to  facilitate  the  transfer  of  information  has 
proven  quite  successful.  On  a  bi-monthly 
basis,  the  library  compiles  and  Issues  an  in- 
house  publication  entitled  Procurement  Litera¬ 
ture  Abstracts,  which  gives  a  brief  descrip¬ 
tion  of  selected  articles  appearing  in  Journals 
received  in  the  library.  Originally  developed 
for  the  use  of  OFPP  and  FAI  staff  members,  it 
is  now  distributed  to  over  400  individuals 
throughout  the  Federal  acquisition  work  force, 
private  industry,  law  firms,  and  educational 
institutions.  In  its  current  format,  the 
Abstracts  is  a  modest,  relatively  informal 
attempt  to  record  the  burgeoning  amount  of 
information  being  produced  in  acquisition  and 
assistance  and  hopefully  it  will  serve  a,s  the 
springboard  for  a  more  extensive  future  effort 
which  can  be  captured  in  machine-readable  form. 

Prcviuing  bibliographic  services  is  another 
user-oriented  capability  of  the  library.  Upon 
request,  and  with  sufficient  advance  notice, 
bibliographies  are  compiled  on  subjects 
selected  by  the  user.  For  instance,  a  bibli¬ 
ography  on  pro-World  War  XI  procurement  and 
one  on  government  contract  disputes  were 
furnished  to  the  Congressional  Research  Service 
of  the  Library  of  Congress,  and  a  bibliography 
on  Federal  acquisitions  was  recently  compiled 
for  the  Subcommittee  on  Federal  Spending 
Practices  and  Opt-  Government  of  the  Senate 
Cotmltcee  on  Governmental  Affairs.  At  the 
present  time,  due  to  limited  personnel  and 
financial  resources,  this  service  is  available 
only  to  government  agencies. 


As  an  additional  resource  for  its  users,  the 
FAI  library  is  considering  organizing  and 
maintaining  a  repository  for  education  and 
learning  mate) Inis  In  Fudersl  acquis) lion  and 
ass  I  n  umes  (]).  Such  a  collection  would  h« 
composed  of  textbooks,  Instructors'  guldst, 
curricula  plans,  und  audio-visual  aids  from 
both  public  and  private  institutions.  Since 
these  sources  often  include  narrow  subjects 
not  covered  elsewhere  and  emphasize  the 
state-of-the-art  in  those  subjects,  research¬ 
ers  should  find  it  advantageous  to  have  all 
the  material  grouped  together  in  one  location. 
Nevertheless,  plans  for  the  learning  materials 
repository  are  still  in  the  developmental 
stage. 


FUTURE  PLANS 


In  ail  probability,  the  role  of  the  FAI 
library  in  the  future  will  be  influenced  by 
two  rapidly  emerging  developments  —  the 
computet  and  library  networks.  Though 
separate  and  disLlnct  elements,  one  being 
physical  and  the  other  conceptual,  they  are 
on  the  path  to  becoming  interactive  and 
mutually  beneficial.  The  computer  is  an 
information  storage  and  communication  device; 
networking  is  a  management  and  logistics 
principle  by  which  library  resources,  such 
as  computers,  are  shared  by  many.  Coordinat¬ 
ing  the  two  developments  into  computer 
assisted  library  networks  will  be  of  profound 
significance  to  all  researchers. 

The  computer  has  three  basic  applications  in 
the  library;  bibliographic  control,  document 
reproduction  and  distribution,  and  informa¬ 
tion  retrieval  (5:316).  So  far  most  studies 
and  implementations  have  been  concentrated  in 
the  first  two  applications.  Operators  of  a 
computer  system  search  titles  in  a  data  base 
and  deliver  to  the  requestor  one  or  more  of 
the  documents  selected.  Most  of  these  sys¬ 
tems  are  off-line  and  are  queried  by  a 
trained  search  strategist,  not  the  requestor. 
An  off-line  system  must  rely  on  conventional 
delivery  methods,  mostly  mall  service,  to 
relay  the  search  results  to  the  requestor. 
This  delivery  system  is  the  weakest  link  in 
the  chain  of  information  transfer.  Since 
off-line  systems  fail  to  allow  interaction 
between  the  requestor  and  the  data  bank,  and 
since  the  response  time  is  not  immediate,  the 
searches  are  often  not  properly  refined  and 
focused  to  be  as  productive  as  ponfible.  For 
tnese  reasons,  the  relatively  recenr  develop¬ 
ment  of  on-line  systems  marks  the  most 
Important  advance  in  information  dissemina¬ 
tion  in  the  past  decade.  The  capability  of 
an  on-line  system  for  immediate  search  and 
display  and  user/computer  interaction  make 
it  the  key  information  retrieval  device  of 
the  future. 
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THE  FEDERAL  ACQUISITION  INSTITUTE  LIBRARY:  TODAY  AND  TOMORROW* 


Helen  T.  Hertel 

Librarian,  Federal  Acquisition  Institute 


lniormation  dissemination  is  an  integral  part  ment  Procurement .  The  Commission  members, 

of  acquisition  research  and  development:  com™  realizing  the  permanent  value  of  the  back™ 

municating  vhat  is  already  known  to  those  who  ground  papers  ard  supporting  documents  which 

want  to  know  is  essential  in  helping  to  reduce  they  had  gathered,  arranged  for  the  General 

the  number  of  times  the  wheel  is  reinvented.  Services  Administration  to  maintain  the  col- 

The  volume  of  information  and  die  diversity  of  lection  intact  from  the  termination  of  the 

Its  sources  necessitate  the  existence  of  a  Commission  until  the  establishment  of  the 

specialized  information  center  to  serve  the  ieU«.."r!  Acquisition  Institute.  In  addition  to 

needs  of  those  working  in  the  Federal  acqulsi™  their  recoarr.endation  for  the  creation  of  the 

lion  and  assistance  field.  One  unit  must  be  Institute,  the  Commission  strongly  aavised 

responsible  .  .r  'dentifying,  locating,  acquir-  that  the  COGP  collection  be  co-sid. rod  the 

log,  organizing,  storing  and  disseminating  the  nucleus  of  a  central  repository  in  acouisi- 

iniormation  gleaned  from  the  ephemeral  and  tlon  and  assistance  to  support  the  research 

lugicive  materials'-  which  abound  in  this  disci™  function  of  the  FAI  and  to  serve  the  lnforma- 

pliue.  Most  of  the  Information  iu  produced  tion  needs  of  the  entire  acquisition  communi- 

not  in  book  form,  but  in  Journals,  conference  ty  (6:52).  Under  this  arrangement,  the 

proceedings,  research  reports,  student  papers,  library  was  operated  by  GSA's  Federal  Supply 

handbooks,  correspondence,  and  memoranda  —  Service  i„  Ctystal  City,  Virginia  for  the 

most  of  which  have  limited  distribution.  To  period  April  1973  to  August  1977. 

add  to  the  problem  of  identifying  and  locating 

acquisition  materials,  the  standard  literature  When  the  Federal  Acquisition  Institute  beent' 

indexing  and  abstracting  services  barely  operational  in  September  1977.  the  library 

scratch  the  surface  in  thiu  subject  ores.  It  moved  to  its  precent  location  In  the  FAI 

is  impractical  and  nearly  impossible  for  the  offices  at  5001  Eisenhower  Avenue,  Alexandria, 

individual  researcher  to  cope  with  these  Virginia.  How  that  the  library's  origins  have 

problems.  Hence,  the  need  for  the  Federal  been  briefly  related,  the  remainder  of  this 

Acquisition  Institute  (FAX)  Library  ro  func-  article  will  focus  on  the  present  and  future 

tlon  as  a  specialized  Information  center  in  role  of  the  FA'-  Library  as  a  specialized 

Federal  acquisition  and  assistance.  information  center. 


*  Opinions  expressed  herein  are  the  responsi¬ 
bility  of  the  author  and  are  not  to  be  int  .-r- 
preted  as  official  FAI  policy. 

1/  Broadly  defined,  the  terra  "acquisition"  en¬ 
compasses  contracting  and  contract  administra¬ 
tion.  quality  and  reliability  assurarce,  sys¬ 
tems  acquisition  and  piogram/budget  management, 
and  logistics. 

2/  Ephemeral  and  fugitive  materials  are  those 
documents  Issued  outside  regular  publishing 
channels  and  usually  kno-  only  to  a  relatively 
small  number  of  people,  abound  and  uncon- 
toiled,  they  are  unav„Uible  forever  unless 
obtained  from  the  source  immediately  upon 
release. 

3/  Originally  named  the  Federal  Procurement 
Institute,  the  agency  was  renamed  the  Federal 
Acquisition  Institute  effective  March  1,  1978 
by  a  vote  of  the  Policy  Board.  For  uniformity, 
the  current  name  will  be  used  throughout  this 
article  regardless  of  time  frame. 


BACKGROUND 


The  id -a  for  a  spec  in’.  Iced  collection  In  thiu 
fluid  i»  bor:  in  the  Commission  on  Covern- 


CURRENT  STATUS 


The  library  is  a  vital  and  active  participant 
in  FAI's  mission  to  promote  acquisition  re¬ 
search  and  to  develop  and  monitor  acquisition 
education,  training  and  career  development, 
in  keeping  with  this  function,  the  library 
will  continue  to  concentrate  its  material 
gathering  efforts  in  Federal  acquisition  and 
assistance,  but  will  also  add-educai" -n, 
training,  personnel,  and  business  research 
and  management  as  supplemental  subjects. 

At  present  the  llbrnry'9  unique  collection 
consists  of  approximately  300  books;  5200 
reports,  theses  and  proceed  Inga;  60  journals 
and  looscleaf  services;  27  file  cabinets  of 
COGP  back-up  material;  congressional  hearings, 
repirts  and  bills;  and  a  legal  section,  in¬ 
cluding  the  U.S.  Code,  V.S.  Code  Annotated. 
Ro«rc,  of  Contract  Appeals  decisions,  Comp- 
troIJir  General  decisions,  the  Cede  cl 
Federal  Regulations,  the  Armed  Services  Pro- 
c.ureme  it  Regulation,  federal  rerrent 

Regula  Ions,  and  various  othei  - 

regu’  ittons,  directives  and  circulars. 
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Though  clearly  a  desirable  method  of  informa¬ 
tion  storage  and  transfer,  computer  systems 
are  nevertheless  quite  expensive.  In  view  of 
ever  increasing  budget,  staff,  and  space  con¬ 
straints,  computer  use  would  almost  seem  beyond 
the  reach  of  the  smaller,  specialized  librar¬ 
ies,  educational  departments  and  coiroie-clnl 
firms.  However,  a  solution  lies  in  the  concept 
of  resource  sharing  networks.  With  libraries 
now  being  forced  to  abandon  the  traditional 
doctrine  of  complete  self-sufficiency  and  to 
place  more  emphasis  on  access  rather  than 
possession,  maximizing  che  availability  of 
.tale-  ials  and  services  and  minimizing  expenses 
v  ">*'  of  che  fundamental  goals  of  resource 
•haring  ‘ '•  '> 

The  information  needs  of  the  acquisition/ 
assistance  cocctunity  will  be  net  most  satis¬ 
factorily  If,  over  the  next  several  years,  all 
libraries  In  this  field  form  n  res,,  -so  shar¬ 
ing  network.  At  present  the  libraries  of  the 
Defense  Systems  Management  College,  the  Army 
Logistics  Management  Center,  the  School  of 
Systems  and  Logistics  at  the  Air  Force  Insti¬ 
tute  of  Technology,  and  the  Naval  Postgraduate 
School  agree,  on  an  informal  basis,  to  share 
some  resources.  Most  of  this  cooperation  is 
in  che  form  of  assistance  in  identifying  and/ 
cr  locating  a  publication  and  short-term 
borrowing  of  materials.  Although  this 
approach  is  adequate  now,  it  will  not  be  ade¬ 
quate  in  the  future  ns  the  volume  of  informa¬ 
tion  proliferates. 

Under  the  auspices  of  che  Research  Directorate, 
the  Federal  Acquisition  Institute  is  planning 
to  study  rhe-  feasibility  of  "implementing  a 
collecting,  cataloging,  and  indexing  system 
in  terms  of  computer  hardware  and  software, 
time  sharing,  terminals,  data  and  documents, 
and  users  to  be  serviced"  (1).  It  is  en¬ 
visioned  that  the  entire  holdings  of  the  FAI 
library,  as  well  as  those  of  other  interested 
libraries,  will  be  Included  in  this  data  bank 
as  one  method  of  coping  with  the  amount  of 
information  forthcoming. 

Recent  visits  to  other  libraries  having  some 
interest  In  the  Federal  -.quisition  and 
assistance  fields  ind  ate  that  no  other 
llbrnry  concentrates  exclusively  In  thin 
highly  specialized  subject  area.  Being  pri¬ 
marily  book-or tented,  they  ire  ur.oble  to  cover 
the.  subject  in  depth  -since,  as  mentioned 
eorller,  wricten  communication  regarding 
acquisition  appears  mostly  in  non-book  form. 

As  moot  of  these  other  libraries  arc  part  of 
educational  Institutions,  their  report  liter¬ 
ature  le  of ton  limited  to  the  studies  and 
theses  conducted  by  tholr  own  students.  In 
other  subject  categories  they  ore  far  stronger 
than  he  FAI  library;  but  In  Federal  acqt>*si- 
tion  -ad  assistance,  the  FAI  llbrnry  has  v  re 
aubject  depth  and  a  greater  variety  in  types 
of  material  sought  and  retained. 


A  large  percentage  of  the  acquisition  communi¬ 
ty  doeB  not  have  access  to  these  other 
scattered  collections.  Libraries  belonging 
to  military  educational  institutions  and  to 
civil  agency  headquarters  serve  only  thetr 
own  students  and/or  staff.  While  some  mate¬ 
rial  does  pass  between  military  and  civil 
agencies  through  Interlibrary  loan,  this 
procedure  is  not  encouraged.  Furthermore, 
although  almost  every  civil  agency  has  a  pto- 
eurement  activity,  only  one  has  a  library 
which  collects  some  material  in  this  subject. 
n'...r,  there  Is  a  very  significant  number  of 
individuals  outside  the  Federal  Government 
who  do  not  have  recourse  to  the  service-;  of 
the  military  or  civil  agency  I  !hr..i  *<*s. 
Lawyers,  state  and  local  purchasing  lf-ents, 
industry  officials,  consultants,  ami  inde¬ 
pendent  researchers  concerned  with  the  busi¬ 
ness  of  Federal  acquisition  and  assistance 
need  to  have  ready  access  to  information  in 
the  area.  Additionally,  many  potential  users 
are  too  geographically  removed  from  these 
other  libraries  to  be  served  by  them. 

Obviously,  there  Is  a  real  need  for  one 
library  that  can  meet  the  informational 
requirements  of  all  those  concerned  with 
Federal  acquisition  and  assistance.  Users 
require  a  library  which  is  devoted  exclusive¬ 
ly  to  monitoring  this  one  subject  area,  which 
gathers  all_  available  Information  regardless 
of  Its  physical  nature,  and  which  is  man¬ 
dated  to  serve  all  Interested  parties.  The 
FAI  library  is  investigating  the  possibility 
of  becoming  such  a  facility.  With  all  of 
its  energy  focused  in  this  effort.  It  would 
benefit  the  acquisition  coranunlty  by  central¬ 
izing  the  sources  of  information  and  it  would 
benefit  other  libraries  by  eliminating  one 
of  the  areas  which  choir  stretched  resources 
might  be-  required  to  rover. 

This  type  of  resource  sharing  would  consti¬ 
tute  3  star  network,  whereby  "one  partici¬ 
pant  holds  substantially  all  the  resources 
vo  be  utilized  by  other  participants"  (4-.  13). 
In  this  instance,  the  FAI  library  would  hold 
the  substantial  amount  of  material  available 
In  acquisition  and  assistance,  to  be  accessi¬ 
ble  to  and  utilized  by  all  other  libraries 
t>nd  interested  individuals.  Within  this 
framework,  the  various  cons ldc-al Ions  and 
approaches  that  would  characterize  the  net¬ 
work  are  too  numerous  to  detail  at  this 
time.  Suffice  It  to  say  there  Is  enough 
flexibility  in  the  concept  to  accosayidate 
the  Interests  of  all  participating  members. 

Of  course,  having  the  FAI  library  serve  as 
the  lead  library  in  a  resource  s  'inp  net¬ 
work  is  only  one  potential  rou*>-  ider. 

Another  possibility  is  the  formation  f  ar 
"equally  distributed  network"  ir>  which  "all 
participants  old  equal  (but  different) 
quantities  of  material  to  be  utilize.;  only 
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by  participants."  (4:28).  Although  perhaps 
more  difficult  to  adminiscer,  this  type  of 
network  also  has  several  advantages.  Addi¬ 
tional  alternatives  for  the  FAI  Library's  role 
In  the  Information  gathering  process  of  the 
future  are  presently  being  explored.  The  final 
format  Is  not  likely  to  crystallize  for  quite  a 
while. 

Regardless  ol  the  type  of  sharing  ultimately 
Implemented,  resource  enhancement  will  be  the 
unquestionable  result.  And,  particularly  if 
computer  services  are  one  of  the  shared  com¬ 
ponents,  this  writer's  first  long-range  goal 
for  the  FAI  Library  becoming  truly  an 
information  dissemination  center  will  be 
achieved. 

For  now,  it  is  a  library — though  already  a 
nontradltlonal  one  in  many  aspects.  Its 
strongest  points  are  these:  (1)  it  has  a  firm 
foundation  in  the  subject  field,  albeit  the 
necessity  to  acquire  some  materials  missad 
during  the  transition  year  in  1977;  and  (2)  it 
is  willing  to  serve  everyone  across  the  entire 
spectrum  comprising  the  acquisition  community, 
regardless  of  employment  affiliation  or 
geographic  location. 
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